Find the text from a row and column in a table

Question

I have a table in a html like below, I need to extract for example the End Snap value under Snap Time column which is 03-Sep-20 02:00:01


Snap Id Snap Time Sessions Cursors/Session Instances
Begin Snap: 121525 03-Sep-20 01:30:07 167      10.4 6
End Snap: 121526 03-Sep-20 02:00:01 174      11.2 6
Elapsed:                 29.90 (mins)      
DB Time:                 67.15 (mins)

the required value is requested in the format : columnname_row name :

Snap Id_Begin Snap
Snap Id_End Snap
Snap Time_Begin Snap
Snap Time_End Snap

which goes into a variable called namesplit. I am trying to first pull the column number,and row number to then print the required value :

dbii = soup.find_all("table", attrs={"summary": "for snapshot information"})

for tables in dbii:
    vcols=tables.findChildren('th')
    #print(type(rows))  #bs4.element.ResultSet
    #print(rows)
    #print(ti)
    ii=0
    for value ivcols:
        #print(value.strip)
        #print(value.string)
        #print(type(value))     # bs4.element.Tag
        if(value.text!=None and value.text.lower() == namesplit[0].lower()):         # this matches the column name string
            print("match")
            col_no=ii
            table_no=ti
        else:
            ii+=1
    ti+=1

    print(table_no,col_no,namesplit[1]) # correctly gives table 0, column as 1 or 2

    print("abc")
    #print(dbii[table_no])
    #print(type(dbii[table_no]))
    # Find Row number.
    drow=dbii[table_no].find_all(scope = 'row' )
    j=0
    print(row_no)
    for value in drow:
        #print("row",j,"asdasdsad:",value,value.text)
        if(value.text!=None and namesplit[1].lower() in value.text.lower() ):
            row_no=j

        j+=1
    print(row_no)               # correctly picks the td row as 0(for begin) or 1 (for end) 

    # We have Table no , column number, Row_no  .. get the corresponding value.
    fvalue=dbii[table_no].find_all(tr)[row_no] ## this doesnt work. as its a tag.
    print(type(fvalue)) ## tag ?? 
    print(fvalue)

user_10035985 · Answer

To print the value from End Snap row and third column, you can do:

from bs4 import BeautifulSoup

html_text = '''

Snap Id Snap Time Sessions Cursors/Session Instances
Begin Snap: 121525 03-Sep-20 01:30:07 167      10.4 6
End Snap: 121526 03-Sep-20 02:00:01 174      11.2 6
Elapsed:                 29.90 (mins)      
DB Time:                 67.15 (mins)      

'''

soup = BeautifulSoup(html_text, 'html.parser')

print(soup.select_one('tr:has(td:contains("End Snap:")) td:nth-child(3)').text)

Prints:

03-Sep-20 02:00:01

To get all values, you can do:

all_data = []
for row in soup.select('tr:has(td)'):
    tds = [td.get_text(strip=True) for td in row.select('td')]
    all_data.append(tds)

for row in all_data:
    print('{:<20} {:<20} {:<20} {:<20} {:<20} {:<20}'.format(*row))

Prints:

Begin Snap:          121525               03-Sep-20 01:30:07   167                  10.4                 6                   
End Snap:            121526               03-Sep-20 02:00:01   174                  11.2                 6                   
Elapsed:                                  29.90 (mins)                                                                       
DB Time:                                  67.15 (mins)

Find the text from a row and column in a table

1 Answers