I am trying to run Elasticsearch BERT application and would like to understand the minimal configuration for fine-tuning the model using GPU. What machine configuration should I be using?
Reference github: Fast-Bert
I am trying to run Elasticsearch BERT application and would like to understand the minimal configuration for fine-tuning the model using GPU. What machine configuration should I be using?
Reference github: Fast-Bert
You would probably need to attach different GPUs to your compute instance to test performance. The Tesla T4 is the cheapest, while the Tesla V100 is the most expensive.
The n1-highmem or the n1-highcpu families of compute instance would be a good place to start.