Kafka logs in go service

user_5507931 0
Viewed 360

I need kafka consumer logs for debug. I do the following:


    chanLogs := make(chan confluentkafka.LogEvent)
    go func() {
        for {
            logEv := <-chanLogs
            logger.Debug("KAFKA: " + logEv.String())
        }
    }()

    configMap["go.logs.channel.enable"] = true
    configMap["go.logs.channel"] = chanLogs

    consumer, err := confluentkafka.NewConsumer(&configMap)

    err := consumer.SubscribeTopics(Topics, nil)

And I never get a line. I tried it with kafka chan (consumer.Logs()) with the same result. What I do wrong?

UPD In initial post I wrongfully set parameter name. The correct one is go.logs.channel.enable. But sometimes this still don't work.

apache-kafka go logging
2 Answers

As described in the doc, you should enable that feature:

go.logs.channel.enable (bool, false) - Forward log to Logs() channel.
go.logs.channel (chan kafka.LogEvent, nil) - Forward logs to application-provided channel instead of Logs(). Requires go.logs.channel.enable=true.

So change your code like:

    configMap["go.logs.channel"] = chanLogs
    configMap["go.logs.channel.enable"] = true

    consumer, err := confluentkafka.NewConsumer(&configMap)

See also in the doc or in the sample on the code repo here

user_22700410

The solution was to add

    configMap["debug"] = "all"

I found it here

user_55079310
Related