Maybe it is to broad for this place, but I have to work on a huge database /dataframe with some text processing. The dataframes are stored on my computer as csv.
Is it faster in terms of runtime to use spyder or jupyter notebook?
I am mainly using: pandas, nltk
The outcome is only a csv file, which I have to store on my computer.
Jupyter is basically a browser application, whereas spyder is a dedicated IDE. When I work with large datasets, I never use Jupyter as Spyder seems to run much faster. The only way to truly compare this would be to run/time the same script on both Spyder and Jupyter a couple of times, but in my experience Spyder always beats Jupyter when it comes to computation time.
EDIT: As @carlos mentions in his comment: "in principle both Spyder and Jupyter use the exact same technology to run your code. On top of that, we have a lot of customizations to improve user experience."
When testing, I noticed however that jupyter always runs slower. I think it has to do with how many resources your PC allocates to a browser versus an IDE.
