Python3 - BeautifulSoup - Get value between two tags, where values between

Question

I have below HTML blocks, that are generated by pdftotext using the -bbox-layout option:



    
        
            My text string located here!
    




[...]


    
        Another string
        
        And another!

Now, I am trying to dynamically parse the above structure, and get each [...] content, where the values xMin and xMax is between two numbers.

Imagine I have below numbers:

areas[0] = (100, 0, 200, 792)
areas[1] = (200, 0, 612, 792)

with open(path_to_html_document) as html_file:
    parsed_html = BeautifulSoup(html_file)
    for (i, area) in enumerate(areas):

        xMinValue, xMaxValue = areas[i][0], areas[i][2]

        block_tags = parsed_html.find_all(
            "block", attrs={"xMin": xMinValue, "xMax": xMaxValue})

        print(block_tags)

Above code doesn't return anything, because there are no matching tags. The find_all() search for exact matches for block tags with the specific numbers - but I am trying to search for block tags, where xMin and xMax is:

areas[0] is between 100 and 200

areas[1] is between 200 and 612

is this possible with BeautifulSoup?

user_4286590 · Answer

Replace your code :

block_tags = parsed_html.find_all(
            "block", attrs={"xMin": xMinValue, "xMax": xMaxValue})
print(block_tags)

TO:

block_tags = parsed_html.find_all("block")

for block in block_tags:
    if float(block['xmin']) >= xMinValue and  float(block['xmax']) <= xMinValue:
        print(block)

If debug html code print(parsed_html), you will see html block all attribute in small letter.

user_9785875 · Answer

try

parsed_html.select("block")

and filt the result with key "xMin" and "xMax".

For example, if you want to get , you can first get all block tags by

all_blocks = parsed_html.select("block")

And you want to get one of the block whose xMin is 1 and xMax is 2, you can make it like:

target = filter(lambda x: x["xMin"] == "1" and x["xMax"] == 2, all_blocks)

user_10035985 · Answer

You can select with attributes xMin and xMax with CSS selector block[xMin][xMax]. Then you do filtering through list comprehension:

data = '''

    
        
            My text string located here!
    






    
        Another string
        
        And another!
    

'''

from bs4 import BeautifulSoup

soup = BeautifulSoup(data, 'lxml')

def blocks_min_max(soup, x_min, x_max):
    return [b for b in soup.select('block[xMin][xMax]') if float(b['xmin']) >= x_min and float(b['xmax']) <= x_max]

for b in blocks_min_max(soup, 10, 200):
    print(b.prettify())

Prints:


 
  
   My text string located here!

Python3 - BeautifulSoup - Get value between two tags, where values between

3 Answers