SSL enabled TCP services on nginx-ingress causing SSL handshake failure

I am running a zookeeper service with SSL in the k8s environment and exposing the same via Nginx ingress by specifying the ClusterIP port in the TCP-services configmap, This works fine. But the problem is that the Nginx does a TCP healthcheck every 5 seconds that causes SSL handshake failures at zookeeper since the Nginx does not have the necessary certificates with it. Is there a way to configure Nginx to use necessary certificates or to disable healthcheck altogether using the TCP configmap