I was reading about the performance of gRPC and found a couple of interesting benchmarks:
gRPC is capable of processing approx. 36K requests per second using a single core server and approx. 62K requests per second using two cores (using the Java implementation).
When it comes to latency we're looking at 77ms for p99 which is not acceptable when sub millisecond latency is required.
I thought the latency/throughput can be improved dramatically when two or more servers communicate over the same network.
Does gRCP open a local TCP connection by default when available? Can I assume the latency/throughput would be dramatically faster than the benchmarks shown in such cases?
Thanks