Update/ Add Nested Data using BeautifulSoup

Question

I'm working with BeautifulSoup/Python to parse an HTML page and update the content as required. A dummy structure of my HTML page structure is as follows:





Some content here 
Another content here

I would like to update the content of

. I'm able to successfully use BeautifulSoup parser to get the contents of

. I'm also able to save the new data that I would like to have in my HTML page as list as displayed below:

['Some content here ', 
'Updated new content here ', 
'Hello new div here! ']

How can I get the following? I tried replace_with but it replaces < with < which isn't desirable and I'm not too familiar with Beautiful soup so not sure what other options are available that can help me achieve the following.





Some content here 
Updated new content here 
Hello new div here!

user_10035985 · Answer

Try:

from bs4 import BeautifulSoup

html_doc = """




Some content here 
Another content here 


"""

new_content = [
    'Some content here ',
    'Updated new content here ',
    'Hello new div here! ',
]

soup = BeautifulSoup(html_doc, "html.parser")

# locate the correct  element:
p = soup.select_one(".class_1 p")

# delete old content:
# tags:
for t in p.find_next_siblings():
    t.extract()
# text (if any):
for t in p.find_next_siblings(text=True):
    t.extract()

# place new content:
p.insert_after(BeautifulSoup("
" + "
".join(new_content) + "
", "html.parser"))

print(soup)

Prints:





Some content here 
Updated new content here 
Hello new div here!

Update/ Add Nested Data using BeautifulSoup

1 Answers