Spark Cassandra Connector with java WARN message for ConnectionInitException

user_4089900 0
Viewed 940

I keep getting this WARN messages for spark project when i run the cassandra job

WARN ChannelPool: [s0|/172.17.0.3:9042]  Error while opening new channel (ConnectionInitException: [s0|connecting...] Protocol initialization request, step 1 (STARTUP {CQL_VERSION=3.0.0, DRIVER_NAME=DataStax Java driver for Apache Cassandra(R), DRIVER_VERSION=4.5.0, CLIENT_ID=ef6bf95c-e93f-4f59-860a-829ae07e80cb, APPLICATION_NAME=Spark-Cassandra-Connector-local-1593841648738}): failed to send request (java.nio.channels.ClosedChannelException))

i dont see any data loss but i'm not also sure why this happens

i have 3 node cassandra docker running in my pc

cassandra version :- 3.11.6 spark version :- 2.4.6 java : jdk8

keyspace info :

keyspace_name    durable_writes        replication
mykeyspace          true           {class=org.apache.cassandra.locator.NetworkTopologyStrategy, datacenter1=1, datacenter2=1}
spark-cassandra-connector apache-spark cassandra java
1 Answers

Answering my own question!

So to solve this we need to get into the docker networking, And map your containers IP to broadcast from eth0 to external world.

Below link could be of some help

https://docs.docker.com/network/network-tutorial-standalone/

To be frank, I haven't explored the whole docker networking myself as we eneded up not using docker for Cassandra in our case.

user_40899000
Related