soup.find_all works but soup.select doesn't work

Viewed 1347

I'm playing around with parsing an html page using css selectors

import requests
import webbrowser
from bs4 import BeautifulSoup

page = requests.get('http://www.marketwatch.com',  headers={'User-Agent': 'Mozilla/5.0'})
soup = BeautifulSoup(page.content, 'html.parser')

I'm having trouble selecting a list tag with a class when using the select method. However, I have no trouble when using the find_all method

soup.find_all('ul', class_= "latestNews j-scrollElement")

This returns the output I desire, but for some reason I can't do the same using css selectors. I want to know what I'm doing wrong.

Here is my attempt:

soup.select("ul .latestNews j-scrollElement")

which is returning an empty list.

I can't figure out what I'm doing wrong with the select method.

Thank you.

1 Answers
Related