Extract title with BeautifulSoup

user_5735928 0
Viewed 50413

I have this

from urllib import request
url = "http://www.bbc.co.uk/news/election-us-2016-35791008"
html = request.urlopen(url).read().decode('utf8')
html[:60]

from bs4 import BeautifulSoup
raw = BeautifulSoup(html, 'html.parser').get_text()
raw.find_all('title', limit=1)
print (raw.find_all("title"))
'<!doctype html public "-//W3C//DTD HTML 4.0 Transitional//EN'

I want to extract the title of the page using BeautifulSoup but getting this error

Traceback (most recent call last):
  File "C:\Users\Passanova\AppData\Local\Programs\Python\Python35-32\test.py", line 8, in <module>
    raw.find_all('title', limit=1)
AttributeError: 'str' object has no attribute 'find_all'

Please any suggestions

beautifulsoup python-3.x
4 Answers

You can directly use "soup.title" instead of "soup.find_all('title', limit=1)" or "soup.find('title')" and it'll give you the title.

from urllib import request
url = "http://www.bbc.co.uk/news/election-us-2016-35791008"
html = request.urlopen(url).read().decode('utf8')
html[:60]

from bs4 import BeautifulSoup
soup = BeautifulSoup(html, 'html.parser')
title = soup.title
print(title)
print(title.string)
user_115903140

Make it simple as that:

soup = BeautifulSoup(htmlString, 'html.parser')
title = soup.title.text

Here, soup.title returns a BeautifulSoup element which is the title element.

user_120651500

In some pages I had the NoneType problem. A suggestion is:

soup = BeautifulSoup(data, 'html.parser')
if (soup.title is not None):
    title = soup.title.string
user_37602510
Related