How do convert the output of a nested for loop into a list in Python?

user_15754709 0
Viewed 79

I am very new to Python so apologies for this basic question. I am trying to match columns of keywords with a list of text. If the keyword(s) can be found in the text, these should be appended to the spreadsheet which currently ends at the 'Engagement' column.

I currently get the following error message in the 2nd line of the 'for-loop': TypeError: 'in ' requires string as left operand, not float

What's wrong with my code and how should I correct it? Thank you.

df_rawdata = pd.read_excel (r'test.xlsx', sheet_name ='rawdata')
my_rawdatalist = df_rawdata['Text'].tolist()


df_all_words = pd.read_excel (r'test.xlsx', sheet_name ='pet_dict')

keywords_list = set(df_all_words['Animals'].tolist()+df_all_words['Cities'].tolist())

matchlist = []

for rawdata in my_rawdatalist:
        matches = [keyword for keyword in keywords_list if keyword in rawdata]
        matchlist.append("|".join(matches))

print(matchlist)

enter image description here

nested-loops python-3.x
2 Answers

I actually don't get why you want to have an empty string there, but maybe this helps you:

enter image description here

user_22304660

I think a list comprehension might go a long way to making this easier. Note that it will also allow you to deal with a phrase that contains multiple keywords:

my_rawdatalist = [
    "The cat is out",
    "The zoo is fun",
    "The dog is tired",
    "The dog chases the cat"
]
keywords_list = ["cat", "dog", "NaN"]
matchlist = []

for rawdata in my_rawdatalist:
    matches = [keyword for keyword in keywords_list if keyword in rawdata]
    matchlist.append("|".join(matches))

print(matchlist)

Will give you:

['cat', '', 'dog', 'cat|dog']

If you have "many" keywords, then you can cast your keyword_list to a set() as that will help make lookup more efficient.

keywords_list = set(["cat", "dog", "NaN"])

If you have multiple columns of keywords (if I understand what you are saying) then I would just append each column to the set.

keywords_list = set(
    ["cat", "dog", "NaN"] ## keywords from column A
    + ["Person", "Woman", "Man", "Camera", "TV"] ## keywords from column B
)

The code should continue to work:

my_rawdatalist = [
    "The cat is out",
    "The zoo is fun",
    "The dog is tired",
    "The dog chases the cat on TV"
]

keywords_list = set(
    ["cat", "dog", "NaN"] ## keywords from column A
    + ["Person", "Woman", "Man", "Camera", "TV"] ## keywords from column B
)

matchlist = []

for rawdata in my_rawdatalist:
    matches = [keyword for keyword in keywords_list if keyword in rawdata]
    matchlist.append("|".join(matches))

print(matchlist)

Gives you:

['cat', '', 'dog', 'dog|cat|TV']
user_2186630
Related