Python BeautifulSoup select div class

Question

I am scraping an HTML like this

 ... 
 ... 
 ... 
 ... 
 ... 
 ...

I am using this

soup_object.find_all("div", {"class": "col-xs-12"})

I want only a div with a class "col-16", but it is returning all the divs.

How can I select only a div class with "col-16"?

Edit

I want to get this

 ... 
 ...

But I am getting this

 ... 
 ... 
 ... 
 ... 
 ... 
 ...

user_6106791 · Answer

Just filter the divs by number of class attributes.

For example:

from bs4 import BeautifulSoup

if __name__ == '__main__':
    sample_html = """ ... 
 ... 
 ... 
 ... 
 ... 
 ... """
    soup = BeautifulSoup(sample_html, "html.parser").find_all("div")
    filtered = [div for div in soup if len(div.attrs["class"]) == 1]
    print(filtered)

Output:

[ ... 
,  ... ]

user_13548379 · Answer

I think these would help:

BeautifulSoup webscraping find_all( ): finding exact match

https://medium.com/@epicshane/using-beautifulsoup4-to-find-class-exact-match-3e263a95e330

I have tried the solution from: https://stackoverflow.com/a/22735249/13548379

from bs4 import BeautifulSoup

html_doc = """ ... 
 ... 
 ... 
 ... 
 ... 
 ... 
"""

soup = BeautifulSoup(html_doc, 'html.parser')
#print(soup.prettify())
item = soup.find_all(lambda tag: tag.name == 'div' and 
                                   tag.get('class') == ['col-16'])
for x in item:
    print(x.prettify())

And the result is:


 ...



 ...

Python BeautifulSoup select div class

2 Answers