-bash: bin/kafka-topics.sh: No such file or directory installed via ambari

Viewed 6907

Im new in hadoop and apache environment. Now I'm trying to learn about kafka I've installed hadoop via ambari. And i can see that there are some services installed. Including zookeeper . When i click on that service it shows zookeeper server started with green dot. I assume that zookeeper installed correctly. Now i added kafka services. Assuming that kafka and zookeeper installed i try to create some topics according to this source kafka docs.

I try this code

bin/kafka-topics.sh --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic test

it returns

-bash: bin/kafka-topics.sh: No such file or directory

it makes me wonder if kafka really installed via ambari? i checked ambari services and kafka has been added and the broker is running with started status with green dot.

same thing also happened to zookeeper

bin/zookeeper-server-start.sh config/zookeeper.properties

it returns

-bash: bin/zookeeper-server-start.sh: No such file or directory

Questions

How do i know if any services installed correctly via ambari? I just try this with kafka, but what if i have to add any other source. Are there any other configuration needed after added ther service via ambari?

Thank you.

3 Answers

I found the Kafka binaries under /usr/bin. You can execute a Kafka command for a Dockerize Kafka Broker like this:

docker exec -t kafka_kafka1_1 /usr/bin/kafka-topics --bootstrap-server localhost:9092 --list

Everything installed with default settings and installed via ambari. I try to locate kafka-topics.sh , and it was located

/usr/hdp/3.1.4.0-315/kafka/bin/kafka-topics.sh

same thing goes for zookeeper-server-start.sh, it was located in

/usr/hdp/3.1.4.0-315/kafka/bin/zookeeper-server-start.sh

i dont know what they are located different than default location.

For that problem when trying to run $ bin/zookeeper-server-start.sh config/zookeeper.properties from git bash

a quick solution is to open kafka-run-class.sh and enable #!/bin/bash, then add "set -x" without the quotation to the next line. run the command again

Repeat the same steps for kafka-server-start by enabling #!/bin/bash and add "set -x" on the next line. I only got this resolved on git bash.

Related