I am trying to return the address from find_all

Question

I am attempting to web scrape using Python and Beautiful Soup. Url for reference = https://www.zoopla.co.uk/for-sale/property/london/?q=London&results_sort=newest_listings&search_source=home

This is how far I have managed to get:

>>>address = container.find_all("span")
>>>print(address)
[Guide price, Just added, Wolseley Road, Crouch End, London N8, , Hornsey, , Crouch Hill]

Why does the following not work?

address = container.find_all("span", attrs={"class": "listing-results-address"})

I am trying to get the address only i.e. Wolseley Road, Crouch End, London N8

user_10035985 · Answer

You should search for tag, not tag:

import requests
from bs4 import BeautifulSoup


url = 'https://www.zoopla.co.uk/for-sale/property/london/?q=London&results_sort=newest_listings&search_source=home'
soup = BeautifulSoup(requests.get(url).content, 'html.parser')

for a in soup.find_all('a', class_='listing-results-address'):
    print(a.get_text(strip=True))

Prints:

Linstead Way, London SW18
Tudor Court, London E17
Pendlestone Road, Walthamstow, ...
Discovery House, Juniper Drive, Wandsworth, London SW18
Woodlea Grove, Northwood HA6
Elsham Road, London W14
Lytham Street, London SE17
Isleworth, London TW7
Islip Manor Road, Northolt UB5
Teignmouth Road, Welling, Kent DA16
Wimpole Street, London W1G
Cranborne Crescent, Potters Bar, Herts EN6
Forest Road, London E17
Highclere Road, New Malden KT3
Coppermill Lane, London E17
Diana Road, London E17
Chiswick High Road, London W4
Holmesdale Road, London SE25
Warrington Crescent, London W9
Grasmere Road, Purley CR8
Bonar Place, Chislehurst BR7
Samos Road, London SE20
Tredegar Road, London E3
Widdenham Road, Islington, London N7
Eddystone Road, London SE4
Benhurst Avenue, Hornchurch RM12
Woodfield Gardens, New Malden KT3
Old Road, London SE13

EDIT: To get price along the address, you can do:

import requests
from bs4 import BeautifulSoup


url = 'https://www.zoopla.co.uk/for-sale/property/london/?q=London&results_sort=newest_listings&search_source=home'
soup = BeautifulSoup(requests.get(url).content, 'html.parser')

for a in soup.find_all('a', class_='listing-results-address'):
    price = a.find_previous(class_='listing-results-price').find(text=True).strip()
    print('{:<15} {}'.format(price, a.get_text(strip=True)))

Prints:

£1,500,000      Brondesbury Park, Brondesbury ...
£460,000        2D Harold Road, Upper Norwood SE19
£450,000        Anerley Road, London SE20
£450,000        Grange Road, London SE19
£225,000        Bath Road, Harlington, Hayes UB3
£440,000        George Beard Road, London SE8
£615,000        Cumberland Drive, Chessington KT9
£800,000        Woodmansterne Road, Carshalton SM5
£600,000        Willow Close, Bexley DA5
£165,000        Essex Road, Islington On The Green, Islington, London N1
£695,000        Advance House, 101 Ladbroke Grove, London W11
£1,500,000      Riverview Gardens, London SW13
£350,000        Church Road, London SE19
£935,000        Ansdell Road, Nunhead SE15
£350,000        Marlborough Close, London SE17
£380,000        Graveney Road, London SW17
£360,000        Violet Lane, Croydon CR0
£325,000        Montana Gardens, Sutton SM1
£550,000        Albert Road, Bromley, Kent BR2
£365,000        Hadleigh Walk, London E6
£650,000        Eton Rise, Eton College Road, London NW3
£480,000        Russell Road, London N13
£500,000        Heligan House, Watergarden Square, Canada Water SE16
£1,850,000      Melrose Gardens, Brook Green, London W6
£475,000        Cowper Close, Welling DA16
£4,950,000      Edwardes Square, London W8
£735,000        Arbuthnot Road, New Cross SE14
£750,000        Gosterwood Street, London SE8

I am trying to return the address from find_all

1 Answers