How can I get javascript function parameters from html by python?

Question

                        01대기신청가능02대기신청가능03미오픈
04확정예약
05대기신청가능06대기신청가능07미오픈
08대기신청가능09대기신청가능10미오픈
11미오픈
12미오픈
13미오픈
14미오픈
15대기신청가능16대기신청가능17미오픈
18미오픈
19미오픈
20미오픈
21미오픈
22대기신청가능23대기신청가능24미오픈
25미오픈
26미오픈
27미오픈
28미오픈
29대기신청가능30대기신청가능31미오픈

I am trying to sort upper html data just like:

{'01': ['20221001','210','7','0','Y'], '02': ['20221002','210','1','0','Y'], '03': [], ...}

I need to get javascript function html to list form.

how can I ?

Andrej Kesely · Answer

Try:

from ast import literal_eval
from bs4 import BeautifulSoup

html_doc = """                        01대기신청가능02대기신청가능03미오픈
04확정예약
05대기신청가능06대기신청가능07미오픈
08대기신청가능09대기신청가능10미오픈
11미오픈
12미오픈
13미오픈
14미오픈
15대기신청가능16대기신청가능17미오픈
18미오픈
19미오픈
20미오픈
21미오픈
22대기신청가능23대기신청가능24미오픈
25미오픈
26미오픈
27미오픈
28미오픈
29대기신청가능30대기신청가능31미오픈"""

soup = BeautifulSoup(html_doc, "html.parser")

out = {}
for i, a in enumerate(soup.select("a[href^='javascript:fnStep2']"), 1):
    t = list(literal_eval(a["href"].replace("javascript:fnStep2", "")))
    out["{:>02}".format(i)] = t

print(out)

Prints:

{
    "01": ["20221001", "210", "7", "0", "Y"],
    "02": ["20221002", "210", "1", "0", "Y"],
    "03": ["20221005", "110", "4", "0", "Y"],
    "04": ["20221006", "110", "5", "0", "Y"],
    "05": ["20221008", "210", "7", "0", "Y"],
    "06": ["20221009", "210", "1", "50", "Y"],
    "07": ["20221015", "210", "7", "0", "Y"],
    "08": ["20221016", "210", "1", "0", "Y"],
    "09": ["20221022", "210", "7", "0", "Y"],
    "10": ["20221023", "210", "1", "0", "Y"],
    "11": ["20221029", "210", "7", "44", "Y"],
    "12": ["20221030", "210", "1", "44", "Y"],
}

Ahmed Arshed · Answer

##You can get all the href from a tage and mapped that data to your desire form.

result_response = response.css("a::attr(href)").getAll()
count = 0
response_array = []
for data in result_response:
    response_array.append(data.css("a::attr(href)::text".get()))
return response_array

αԋɱҽԃ αмєяιcαη · Answer

from pprint import pp
from bs4 import BeautifulSoup

html = """
   
      
      
      
      
      
      
      01대기신청가능
   
   
      02대기신청가능
      
         03미오픈
      
      
         04확정예약
      
      05대기신청가능
      06대기신청가능
      
         07미오픈
      
      08대기신청가능
   
   
      09대기신청가능
      
         10미오픈
      
      
         11미오픈
      
      
         12미오픈
      
      
         13미오픈
      
      
         14미오픈
      
      15대기신청가능
   
   
      16대기신청가능
      
         17미오픈
      
      
         18미오픈
      
      
         19미오픈
      
      
         20미오픈
      
      
         21미오픈
      
      22대기신청가능
   
   
      23대기신청가능
      
         24미오픈
      
      
         25미오픈
      
      
         26미오픈
      
      
         27미오픈
      
      
         28미오픈
      
      29대기신청가능
   
   
      30대기신청가능
      
         31미오픈
      
      
      
      
      
      
   
"""

soup = BeautifulSoup(html, 'lxml')
goal = [x['href'].split("'")[1::2] for x in soup.select('a.day-wrap')]
pp(goal)

Output:

[['20221001', '210', '7', '0', 'Y'],
 ['20221002', '210', '1', '0', 'Y'],
 ['20221005', '110', '4', '0', 'Y'],
 ['20221006', '110', '5', '0', 'Y'],
 ['20221008', '210', '7', '0', 'Y'],
 ['20221009', '210', '1', '50', 'Y'],
 ['20221015', '210', '7', '0', 'Y'],
 ['20221016', '210', '1', '0', 'Y'],
 ['20221022', '210', '7', '0', 'Y'],
 ['20221023', '210', '1', '0', 'Y'],
 ['20221029', '210', '7', '44', 'Y'],
 ['20221030', '210', '1', '44', 'Y']]

How can I get javascript function parameters from html by python?

3 Answers