Stack Overflow
Stack Overflow

Questions tagged [message-hub]

Based on Apache Kafka, IBM® Message Hub for Bluemix™ is a scalable, distributed, high throughput message bus to unite your on-premise and off-premise cloud technologies.

Based on Apache Kafka, IBM® Message Hub for Bluemix™ is a scalable, distributed, high throughput message bus to unite your on-premise and off-premise cloud technologies. You can wire microservices together by using open protocols, and you can connect stream data to analytics to realize powerful insights. Check the documentation for more information

97 questions
47
votes
7 answers

When does the Apache Kafka client throw a "Batch Expired" exception?

Using the Apache Kafka Java client (0.9), I'm trying to send a long series of records to the broker using the Kafka Producer class. The asynchronous send method returns immediately for a while, then starts blocking on each call for a short time…
James Thomas
  • 4,303
  • 1
  • 20
  • 26
16
votes
2 answers

Consumer Stuck in Re-join

I've read other threads and I've gotten around the problem by using a new group ID, however I'd like to understand what could cause this. I have a topic with 16 partitions, I've set session.timeout.ms=30000, and max.poll.interval.ms=30000000. I run…
kyl
  • 475
  • 1
  • 5
  • 16
9
votes
1 answer

Failed to send SSL Close message

I have a thread which once in a while is going to list the topics on the Message Hub. But once in a while, I am getting a :Failed to send SSL Close message. Any ideas? KafkaConsumer consumer = new…
John Chu
  • 91
  • 1
  • 2
7
votes
1 answer

Kafka Streams KTable configuration error on Message Hub

This issue is now solved on Message Hub I am having some trouble creating a KTable in Kafka. I am new to Kafka, which is probably the root of my problem, but I thought I could ask here anyway. I have a project where I would like to keep track of…
jawwe
  • 638
  • 1
  • 5
  • 13
5
votes
1 answer

Kafka enable.auto.commit set to false but poll still fetch "next" messages

I want to tell Kafka when my consumer has successfully processed a record so I have turned auto-commit off by settting enable.auto.commit to false. I have two messages on a topic I am subscribed to at offset zero and one and have created a consumer…
Mike Gorman
  • 189
  • 2
  • 10
4
votes
1 answer

Error: Invalid value "sasl_ssl" for configuration property "security.protocol"

I'm using node-rdkafka to connect to IBM MessageHub with the following options: var options = { // 'debug': 'all', 'metadata.broker.list': brokers, 'security.protocol': 'sasl_ssl', 'ssl.ca.location': '/etc/ssl/certs', 'sasl.mechanisms':…
B.Tong
  • 53
  • 1
  • 4
4
votes
1 answer

Error in streaming-analytic service in Bluemix

I followed this tutorial to use the streaming-analytic service in Bluemix to interface with message-hub: …
jd76
  • 117
  • 9
4
votes
2 answers

With python pure SASL, can we now write python clients to access Message Hub?

The question has been raised before as to if we can use Python to access Message Hub. The answer was generally no until a SASL implementation was written in Python. Now, there is a pure Python SASL called pure-sasl!, is it now possible to call…
Aaron B
  • 173
  • 7
3
votes
1 answer

How to use kafkacat with message-hub

In trying to use kafkacat with message hub, I've used the following: kafkacat -X client.id=xxxxx \ -X sasl.jaas.config='org.apache.kafka.common.security.plain.PlainLoginModule required username="xxxx" password="xxxx";' \ -X…
Zach
  • 63
  • 1
  • 8
3
votes
1 answer

Kafka Streams cast to string issues with KTable when grouping and aggregating

I have a Kafka stream with incoming messages that looks like sensor_code: x, time: 1526978768, address: Y I want to create a KTable that stores each unique address at each sensor code. KTable KTable numCount = streams …
jawwe
  • 638
  • 1
  • 5
  • 13
3
votes
1 answer

UI console to browse topics on Message Hub

I have a Message Hub instance on Bluemix, and am able to produce / consume messages off it. I was looking for a quick, reasonable way to browse topics / messages to see what's going on. Something along the lines of kafka-topics-ui. I installed…
Deven
  • 156
  • 1
  • 1
  • 13
3
votes
2 answers

Kafka Recover from Commit Failed Exception

I have an issue where my commit fails because poll() is too long (why this happens I don't know, there was no messages and it was simply read/committing on an empty queue, and my poll-interval is set to hours). Then when it hits read() again it…
kyl
  • 475
  • 1
  • 5
  • 16
3
votes
1 answer

Create topic in Message-Hub via curl command

I am trying to create a topic in Message-Hub using a curl command. I followed this yaml: https://github.com/ibm-messaging/message-hub-docs/blob/master/kafka-administration-api/KafkaTopicManagement.yaml I'm getting HTTP 405 Method Not Allowed when…
jd76
  • 117
  • 9
3
votes
1 answer

Why Kafka REST Proxy API not Consuming data in JSON Format?

I'm try to access message hub instance by using kafka rest API. when i'm sending post request through Postman Client and giving Content-Type as application/vnd.kafka.json.v1+json it's giving me the following response { "error_code": 415, …
satyam bansal
  • 31
  • 1
  • 4
3
votes
1 answer

Can I inject external service VCAP_SERVICES into my app?

If I have a MessageHub service in one space, MY_ANALYTICS_SPACE, and I have an application in another space MY_WEBAPPS_SPACE. These spaces represent two different parts of the organisation and have been designed to be kept separate. However,…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
2 3 4 5 6 7