I have an FTP server that stores a very heavy text file (over 250G) and I need to run some queries on it ie. parse it and extract some specific data. Is there a way in python to interact with it without the need to download it all? I am aware of ftplib package but couldn't find get it to work for this specific task. I guess what I would like to do is: connect to FTP server, open a text file, run the queries, save the output of the queries, close the file and disconnect from FTP.
PS. I checked the forum for a possible duplicate but couldn't find anything that could answer my question. However, apologies if it's been asked before.
Many thanks