Regex - How to account for random spacing/line breaks in a term

user_19745533 0
Viewed 38

I am using Python and have the following regular expression to extract text from text files:

    pattern = r'\bItem\s+5\.02\s*([\w\W]*?)(?=\s*(?:Item\s+[89]\.01|Item\s+5\.03|Item\s+5\.07|SIGNATURES|SIGNATURE|Pursuant to the requirements of the Securities Exchange Act of 1934)\b)'

    pd_00['important_text'] = pd_00['text'].str.extract(pattern, re.IGNORECASE, expand=False)

My issue is specifically with the last term, "Pursuant to the requirements of the Securities Exchange Act of 1934". In the text files, this sentence is sometimes spaced randomly and starts different parts of the sentence on new lines. How do I account for this randomness? Right now it is only picking it up when it is written with even, normal spacing.

python regex
3 Answers
s = "Pursuant to the requirements of the Securities Exchange Act of 1934"


reg = re.compile(r'[A-Za-z\s]+.*?1934$')

print(reg.search(s))

<re.Match object; span=(0, 67), match='Pursuant to the requirements of the Securities Ex>
user_51711690

Simply change the spaces in the regex to the whitespace character class:

pattern = r'\bItem\s+5\.02\s*([\w\W]*?)(?=\s*(?:Item\s+[89]\.01|Item\s+5\.03|Item\s+5\.07|SIGNATURES|SIGNATURE|' + r'Pursuant to the requirements of the Securities Exchange Act of 1934)\b)'.replace(' ', '\s*')
user_134122250

First, note that your pattern is too verbose, you can shrink some parts:

Item\s+[89]\.01|Item\s+5\.03|Item\s+5\.07  =>  Item\s+(?:[89]\.01|5\.0[37])
SIGNATURES|SIGNATURE                       =>  SIGNATURES?

SIGNATURES? matches SIGNATURES or SIGNATURE as S? matches one or zero S chars.

So, now, re-vamp the pattern as indicated and replace spaces in your pattern with \s+:

pattern = r'\bItem\s+5\.02\s*([\w\W]*?)(?=\s*(?:Item\s+(?:[89]\.01|5\.0[37])|SIGNATURES?|Pursuant\s+to\s+the\s+requirements\s+of\s+the\s+Securities\s+Exchange\s+Act\s+of\s+1934)\b)'

See the regex demo.

user_38329700
Related