Empty dataframe in pandas

user_7993917 0
Viewed 200

hi i am new in web scraping this code works perfectly but it is printing on the last row into the csv file.I don't know why I printed values also on console and its printing all the rows 

import bs4 as bs
import urllib
import pandas as pd
dfs = pd.read_html('http://www.espn.com/mlb/team/roster/_/name/nyy/new-york-yankees/' ,header= 0)

for df in dfs:
    df.to_csv('losangeles.csv', sep='\t',encoding='utf-8')
pandas web-scraping beautifulsoup python
2 Answers

You shouldn't iterate DataFrame. You actually get each row and save it to the same file.

To save all DataFrame in one file, do so:

dfs.to_csv('losangeles.csv', sep='\t',encoding='utf-8')
user_61740240

There is problem you overwrite file, always write df to same filename.

Solution is create unique file names, e.g. add count by enumerate:

for i, df in enumerate(dfs):
    df.to_csv('losangeles_{}.csv'.format(i), sep='\t',encoding='utf-8')
user_29010020
Related