Extract HTML information from df variable

Question

Dear stackoverflow community,

This is my first time asking a question here. Hope you could cut me some slack. Here is the description of a problem:

I convert KML file to CSV using ogr2org
ogr2ogr -f CSV output.csv 'some KML file'.kml
I then read in the csv file in pandas
data = pd.read_csv('output.csv')

After deleting some bizarre columns I end up having the following:

In[1]: data.head(8)
Out[1]: 
                                          description   ID
0   
ID: 1...   1
1   
ID: 1...   10
2   
ID: 1...   100
3   
ID: 1...   1000
4   
ID: 1...   10000
5   
ID: 1...   10001
6   
ID: 1...   10002
7   
ID: 1...   10003



The representative string under description variable is as follows:

    
    ID: 1

    class: 1

    fold: 5
    

My question is how can I extract clean information from the 'description' column and add it to the same row using all the ...<\b> as a column names.

Thank you.
P.S. Please let me know how I can improve my questions in the future.

user_9192284 · Answer

You could use str.extractall with...

df[['ID1', 'class', 'fold']] = df['description'].str.extractall(r'\s?(\d+)<').unstack()

Or str.findall with something like this...

df[['ID1', 'class', 'fold']] = df['description'].str.findall(r'\s?(\w+)<', expand=True)

These are based on a string like...

ID: 1
class: 1
fold: 5

With the regex matching the three values you need from the string being extracted and passed to the three new columns on the left of the = sign.

Regex: https://regex101.com/r/wVl2cI/1

This is assuming you only have three values to find and the HTML is all the same.

Outputs (example):

    description             ID1    class    fold
0

Extract HTML information from df variable

1 Answers