How to split sentences in a dataframe by dot to build another dataframe but keeping sentence ID

user_19917575 0
Viewed 26

I have a dataframe with ID and TEXTfield. I want to create another dataframe splitting the sentences in TEXT field by the dot and keeping the original ID

So the phrase: "I loves cats. I hate snakes" becomes two sentences in 2 rows in the new dataframe:

0 `I love cats`
0 `I hate snakes`

Original Dataframe:

ID                      TEXT
1    This is a msg. Another msg
2    The weather is hot, the water is cold. My hands are freezing

Transformed Dataframe:

ID
1      This is a msg
1      Another msg
2      The weather is hot, the water is cold
2      My hands are freezing

the code to build the dataframe:

df = pd.DataFrame({'ID':[1,2], 'TEXT':['This is a msg. Another msg', 'The weather is hot, the water is cold. My hands are freezing']})

I am trying to use split -> df['TEXT'].astype(str).split('.') but I keep getting errors because series objects has no split method.

jupyter-notebook pandas python-3.x
2 Answers

You also need to set ID as index beforehand so that the exploded rows will have the respective IDs

df.set_index('ID', inplace=True)
split = df['TEXT'].str.split('.').explode()
user_192557490

Instead of df['TEXT'].astype(str).split('.')

try: df['TEXT'].str.split('.').explode()

user_108363090
Related