How to check all the folder inside files and subfolder inside files have particular string present

user_15299206 0
Viewed 259
  • I have folders and files present
  • I have subfolders and files also
  • I need to search a particular string present also in same file other string not present
  • all the files are in .txt
  • I need to check files which string 20210624 is present inside the file and string 20210625 not in the files
  • My output return the file names
import os
match_str = ['20210624']
not_match_str =  ['20210625']
for root, dirs, files in os.walk(path):
    for name in files:
        if name.endswith((".txt")):
             ## search files with match_str `20210624`  and not_match_str `20210625`

Can i use using import walk

operating-system python
4 Answers

You can set the recursive keyword argument in the glob.glob() method to True for the program to search recursively through the files of the folders, subfolders, etc.

from glob import glob

path = 'C:\\Users\\User\\Desktop'
for file in glob(path + '\\**\\*.txt', recursive=True):
    with open(file) as f:
        text = f.read()
        if '20210624'  in text and '20210625' not in text:
            print(file)

If you don't want to entire path of the files to be printed; only the filenames, then:

from glob import glob

path = 'C:\\Users\\User\\Desktop'
for file in glob(path + '\\**\\*.txt', recursive=True):
    with open(file) as f:
        text = f.read()
        if '20210624'  in text and '20210625' not in text:
            print(file.split('\\')[-1])

In order to use the os.walk() method, you can use the str.endswith() method (as you have done in your post) like so:

import os

for path, _, files in os.walk('C:\\Users\\User\\Desktop'):
    for file in files:
        if file.endswith('.txt'):
            with open(os.path.join(path, file)) as f:
                text = f.read()
                if '20210624'  in text and '20210625' not in text:
                    print(file)

And to search within a maximum level of subdirectories:

import os

levels = 2
root = 'C:\\Users\\User\\Desktop'
total = root.count('\\') + levels

for path, _, files in os.walk(root):
    if path.count('\\') > total:
        break
    for file in files:
        if file.endswith('.txt'):
            print(os.path.join(path, file))
user_135524700

You can achieve this with pathlib and glob.

import pathlib
path = pathlib.Path(path)
maybe_valids = list(path.glob("*20210624*.txt"))
valids = [elem for elem in maybe_valids if "20210625" not in elem.name]
print(valids)

maybe_valids list is created taking every element that contains "20210624" and ends with .txt, while valids are the ones that doesn't contain "20210625".

user_116470250

Continue from here -

if name.endswith((".txt")):
   f = file.read(name,mode='r')
   a = f.read()
   if match_str[0] in f.read():
      # Number is present

You can use for loops for reading too if you have more than one match_str. Similarly, you can use not in keyword to check for not_match_str

user_159141590

You can get the file names with several simple shell commands:

find . -name "*.txt" | xargs grep -l "20210624" | xargs grep -L "20210625"
user_95647930
Related