Stack Overflow
Stack Overflow

Questions tagged [apache-pulsar]

Apache Pulsar is an open-source distributed pub-sub messaging system

339 questions
57
votes
4 answers

What are the advantages and disadvantages of Kafka over Apache Pulsar

Yahoo developed Pulsar, pub-sub messaging system and made it open source. Its now Apache's incubating project. Since Kafka is also used for same purpose. Want to know, major plus and minus points of Kafka over Pulsar.
Ajit Dongre
  • 871
  • 2
  • 8
  • 11
14
votes
1 answer

Is it possible to scale Axon Framework without Axon Server Enterprise

Is it possible to scale Axon Framework without Axon Server Enterprise? I'm interested in creating a prototype CQRS app with Axon, but the final, deployable system has to be be free from licensing fees. If Axon Framework can't be scaled to half a…
ahoffer
  • 6,347
  • 4
  • 39
  • 68
10
votes
1 answer

Apache Pulsar vs. Apache RocketMQ

Apache Pulsar (by Yahoo) seems to be the next generation of Apache Kafka. Apache RocketMQ (by Alibaba) seems to be the next generation of Apache ActiveMQ. Both are open source distributed messaging and streaming data platforms. But how do they…
krn
  • 6,715
  • 14
  • 59
  • 82
6
votes
1 answer

Run apache pulsar using docker-compose

I am able to run Apache Pulsar using this docker command: docker run -it \ -p 6650:6650 \ -p 8080:8080 \ --mount source=pulsardata,target=/pulsar/data \ --mount source=pulsarconf,target=/pulsar/conf \ apachepulsar/pulsar:2.6.0 \ …
ChrisRTech
  • 547
  • 8
  • 25
6
votes
1 answer

Why Use MessageListeners in Apache Pulsar and Not Simply Consumer.receive()?

Apache Pulsar's APIs (https://pulsar.apache.org/api/client/org/apache/pulsar/client/api/Consumer.html) include at least two methods of consuming messages from a Pulsar topic/queue: Using Consumer.receive() (or Consumer.receiveAsync()) Using…
nathandelane
  • 83
  • 8
5
votes
0 answers

How to configure logging to file for Apache Pulsar in standalone mode?

I want to configure Apache Pulsar to log output to file when in standalone mode. I am running Pulsar in standalone mode from a systemd service, with an exec command like this: /var/lib/apache-pulsar/bin/pulsar standalone Now the Pulsar log…
lars
  • 640
  • 4
  • 10
5
votes
2 answers

Apache Pulsar vs Kafka - do consumers pull (poll) messages off the topics?

I know that in Kafka, the consumer pulls messages off the broker topics (pull) ? I get the feeling that Pulsar works the same way, considering that the receive method blocks. But I can't find a confirmation. Can someone point me to a reference or…
Vinay B
  • 673
  • 8
  • 21
5
votes
1 answer

Can I publish/consume to/from multiple namespaces and topic of Apache Pulsar using single pulsar client?

I am trying to write a multi-tenant (multiple namespaces) system using Apache Pulsar. What I cannot seem to achieve is publishing to multiple namespaces and topics in those namespaces using single client/connection. And the same goes on consumer…
Anudeep Agarwal
  • 61
  • 2
5
votes
1 answer

Apache Pulsar - acknowledge from different thread

I've spun up a Pulsar Java consumer in thread T1 and I'm handing over the messages for processing to thread T2. Is it safe to acknowledge messages from T2? Specifically, is calling consumer.acknowledge(messageId) on the instance shared between two…
David Siro
  • 1,826
  • 14
  • 33
4
votes
1 answer

Apache Pulsar maximum supported message size

What is the maximum message size supported by Apache Pulsar? I tried reading the documentation. But I couldn't find any relevant information.
Balasubramanian Naagarajan
  • 338
  • 3
  • 17
4
votes
1 answer

Docker build how to add libraries to golang build

I am building a GO application dealing with Apache Pulsar. Go client requires C++ libraries, as asked by the Pulsar documentation (same thing for Kafka btw). I want to package all this into a Container, the smallest possible. I usually use SCRATCH…
fredczj
  • 167
  • 2
  • 2
  • 11
4
votes
2 answers

How to avoid the automatic deleting of inactive topics in Apache Pulsar

I have an application that produces messages to Pulsar under a specific topic and shut down the application when it's finished; at the same time, no consumer exists to read this topic. After a while, when I create a consumer and want to read the…
yjshen
  • 6,583
  • 3
  • 31
  • 40
4
votes
3 answers

Apache pulsar infinite retention

In Apache Pulsar topic documentation it says can we set a topic time retention policy to -1 for infinite time based retention, What are the downsides of having infinite retention and can we use pulsar as message store where data lives forever in…
Paul
  • 159
  • 2
  • 9
4
votes
1 answer

Is creating a lot of topics with pulsar is a good scenario?

Is that possible and good scenario with pulsar to create a topic ( or a partition ) for each hash on the fly, and delete the topics (or partition ) when it is no more used? The idea is to be able to read data with the same hash in an ordered fashion…
crak
  • 1,635
  • 2
  • 17
  • 33
3
votes
1 answer

Can we expose Apache Pulsar metrics through Micrometer?

The broker metrics are exposed under "/metrics/" at port 8080. But, what about the client metrics (both consumer and producer)? Can we expose Apache Pulsar metrics through Micrometer (particularly with Prometheus)? It would be interesting if we are…
Scoby
  • 148
  • 3
  • 17
1
2 3
…
22 23