How to grab all headers from a website using BeautifulSoup?

user_8259531 0
Viewed 17814

I'm trying to grab all the headers from a simple website. My attempt:

from bs4 import BeautifulSoup, SoupStrainer
import requests

url = "http://nypost.com/business"
page = requests.get(url)
data = page.text
soup = BeautifulSoup(data)
soup.find_all('h')

soup.find_all('h') returns [], but if I do something like soup.h1 or soup.h2, it returns that respective data. Am I just calling the method incorrectly?

python-requests web-scraping beautifulsoup python
4 Answers

when using the method find or find_all you can pass a string or a list of tags

soup.find_all([f'h{i}' for i in range(1,7) ])

or 

soup.find_all(['h{}'.format(i) for i in range(1,7)])
user_127486890
Related