How to wait for a file to be downloaded in Selenium and Python before moving forward

user_14059931 0
Viewed 667
print('Hello world!')

I am attempting to download a file from Chrome using selenium. Every time I download a file, it starts with 'TCBT', but the remaining file name will be different every time. I only want to download that one file.

An interesting thing occurs when I hit the last click to download the file. The website is slower and the file is larger so once I click download an indeterminable amount of time passes (20-60 seconds). Then a popup window occurs which then starts downloading the file which takes another 10-30 seconds.

I've have tried several different infinite loops to identify when the file finishes downloading, but it always gets stuck in the loop or skips it. I believe that it has something to do with the file name as I am only able to use a glob to find the one I want. See some examples:

One try:

while True:
download_folder = os.path.expanduser('~')+'/Downloads/'
filenames = glob.glob(download_folder+'TCBT*')
for name in filenames:
    if name.endswith('.crdownload'):
        time.sleep(1)
    if name.endswith('.xls'):
        break
    else:
        continue

This keeps looping no matter what. I am attempting to use the "continue" portion to go back and get the filename because for the first 20-60 seconds (waiting for the popup to begin downloading) there will be no file.

I have also tried using a function I found online:

def download_wait(directory, timeout, nfiles=None):
    """
    Wait for downloads to finish with a specified timeout.

    Args
    ----
    directory : str
        The path to the folder where the files will be downloaded.
    timeout : int
        How many seconds to wait until timing out.
    nfiles : int, defaults to None
        If provided, also wait for the expected number of files.

    """
    seconds = 0
    dl_wait = True
    while dl_wait and seconds < timeout:
        time.sleep(1)
        dl_wait = False
        files = os.listdir(directory)
        if nfiles and len(files) != nfiles:
            dl_wait = True

        for fname in files:
            if fname.endswith('.crdownload'):
                dl_wait = True

        seconds += 1
    return seconds

download_wait(download_folder, 30)

When I use this, nothing happens and my script finishes. I'm assuming it is checking the folder, not seeing any file (because it takes 20-60 seconds to begin downloading) and completing.

Any thoughts on how to solve this?

selenium operating-system python
2 Answers

If your workaround didn't worked, you can create a new method to cover the download logic:

  1. Check if the file is present (based on name)
  2. Inside a loop take file's size and compare after 5 (or how many you want) seconds again with its size until you have a match so you can break the loop and consider the download done.
user_89376490

Here is how I solved it. I needed to add a second break to break out of the second loop. Added a few more to the tree:

# Wait for download
while True:
    download_folder = os.path.expanduser('~')+'/Downloads/'
    filenames = glob.glob(download_folder+'TCBT*')
    if len(filenames) > 0 and not any('.crdownload' in name for name in filenames):
        break
    for name in filenames:
        if name.endswith('.crdownload'):
            continue
        if name.endswith('.xls'):
            print('')
            print('Download complete.')
            print('')
            break
        else:
            break
user_140599310
Related