6

Im new in hadoop and apache environment. Now I'm trying to learn about kafka I've installed hadoop via ambari. And i can see that there are some services installed. Including zookeeper . When i click on that service it shows zookeeper server started with green dot. I assume that zookeeper installed correctly. Now i added kafka services. Assuming that kafka and zookeeper installed i try to create some topics according to this source kafka docs.

I try this code

bin/kafka-topics.sh --create --bootstrap-server localhost:9092 --replication-factor 1 --partitions 1 --topic test

it returns

-bash: bin/kafka-topics.sh: No such file or directory

it makes me wonder if kafka really installed via ambari? i checked ambari services and kafka has been added and the broker is running with started status with green dot.

same thing also happened to zookeeper

bin/zookeeper-server-start.sh config/zookeeper.properties

it returns

-bash: bin/zookeeper-server-start.sh: No such file or directory

Questions

How do i know if any services installed correctly via ambari? I just try this with kafka, but what if i have to add any other source. Are there any other configuration needed after added ther service via ambari?

Thank you.

Olaf Kock
  • 46,930
  • 8
  • 59
  • 90
yuliansen
  • 470
  • 2
  • 14
  • 29
  • 1
    That is a $PATH and-or environment issue with the user that tries to run these commands. Notice how it starts at `bin/...`. This is not the full path. So the user or application is now in the parent directory of that `bin/`. – Nic3500 Jun 09 '20 at 04:47
  • is it means those who installed using ambari haven different command that those insalled manually? – yuliansen Jun 09 '20 at 04:58
  • 1
    That is at the operating system level. You log on the server, you have an environment and certain permissions that apply to your user. Same for the service user that runs ambari. Read on unix user environments and the $PATH variable. Each user can have access to different parts of the system. – Nic3500 Jun 09 '20 at 05:00
  • Hi, thank you so much for your respond, i will try this real quick with another access – yuliansen Jun 09 '20 at 05:42

3 Answers3

7

I found the Kafka binaries under /usr/bin. You can execute a Kafka command for a Dockerize Kafka Broker like this:

docker exec -t kafka_kafka1_1 /usr/bin/kafka-topics --bootstrap-server localhost:9092 --list
NKSM
  • 5,422
  • 4
  • 25
  • 38
Cosmin Mircea
  • 71
  • 2
  • 2
2

Everything installed with default settings and installed via ambari. I try to locate kafka-topics.sh , and it was located

/usr/hdp/3.1.4.0-315/kafka/bin/kafka-topics.sh

same thing goes for zookeeper-server-start.sh, it was located in

/usr/hdp/3.1.4.0-315/kafka/bin/zookeeper-server-start.sh

i dont know what they are located different than default location.

yuliansen
  • 470
  • 2
  • 14
  • 29
0

For that problem when trying to run $ bin/zookeeper-server-start.sh config/zookeeper.properties from git bash

a quick solution is to open kafka-run-class.sh and enable #!/bin/bash, then add "set -x" without the quotation to the next line. run the command again

Repeat the same steps for kafka-server-start by enabling #!/bin/bash and add set -x on the next line. I only got this resolved on git bash.

Nav
  • 19,885
  • 27
  • 92
  • 135
Celestine Njukang
  • 11
  • 1
  • The clarity and readability of your post might benefit from using this info https://stackoverflow.com/editing-help I for example find it hard to parse the "without quotation marks. Code formatting probably helps you to make clear what exactly you propose. – Yunnosch Sep 08 '22 at 10:34