Questions tagged [azure-eventhub]

Microsoft Azure EventHubs is a highly-scalable high-throughput low-latency durable event ingestion system in Azure cloud. EventHubs serves as an event buffer for applications to process events with variable load profiles. Microsoft Azure Event Hubs is comparable to Apache Kafka or AWS Kinesis. This is a fully-managed service-offering built & run by the teams at Microsoft.

Microsoft Azure EventHubs is a highly scalable high throughput low latency durable event ingestion system in Azure cloud. EventHubs serves as an event buffer for applications to process events with variable load profiles.

Stream millions of events per second into multiple applications

Event Hubs is a highly scalable publish-subscribe ingestor that can intake millions of events per second so that you can process and analyze the massive amounts of data produced by your connected devices and applications. Once collected into Event Hubs you can transform and store data using any real-time analytics provider or with batching/storage adapters.

Enable applications to process events with variable load profiles

Today’s connected world is defined by big data. Big data originates from many sources such as connected cars and thermostats that produce telemetry data every few minutes, application performance counters that generate events every second or mobile apps that capture telemetry for every user’s individual action. In this connected world, you need a managed ingestor service capable of elastic scale in order to accommodate variable load profiles as well as the spikes caused by intermittent connectivity.

Connect millions of devices across platforms

The rapid proliferation of connected devices raises challenges due to the variety of platforms and protocols involved. Connecting these disparate data sources while handling the scale of the aggregate stream is a significant challenge. Event Hubs provide easy provisioning of capacity to ingest events from millions of devices while preserving event order on a per device basis. Support for AMQP and HTTP allow many platforms to work with Event Hubs. Native client libraries also exist for popular platforms.

1941 questions
86
votes
4 answers

Message bus vs. Service bus vs. Event hub vs Event grid

I'm learning the messaging system and got confused by those terminology. All the messaging system below provides loose coupling between services with different sets of features. queue - FIFO, pulling mechanism, 1 consumer each queue but any number…
43
votes
4 answers

Looking for clarity on Event Hubs vs Topics in Azure Service Bus

I've been learning about Event Hubs and just want to get confirmation or correction on my perspective on Event Hubs? I’m used to leveraging retries, poison messages, at least once delivery and so on for normal enterprise messaging solutions, which…
JBO
  • 563
  • 1
  • 4
  • 8
38
votes
2 answers

Forcing EventProcessorHost to re-deliver failed Azure Event Hub eventData's to IEventProcessor.ProcessEvents method

The application uses .NET 4.6.1 and the Microsoft.Azure.ServiceBus.EventProcessorHost nuget package v2.0.2, along with it's dependency WindowsAzure.ServiceBus package v3.0.1 to process Azure Event Hub messages. The application has an implementation…
Chrisgh
  • 1,016
  • 2
  • 10
  • 18
31
votes
2 answers

Multiple triggers for an Azure Function

We have an Azure Function that has an event hub trigger. Is it possible to have a trigger on more than one event hub for the same Azure Function?
Naren
  • 735
  • 1
  • 9
  • 19
27
votes
2 answers

What are the options for local development with Azure Event Hubs?

I am looking to start a new project using Azure Event Hubs. Part of the project is a set of integration tests that can be run from any development machine (plus CI). In the past, I've used the local emulators (e.g., Cosmos DB, Storage, Service…
Erick T
  • 7,009
  • 9
  • 50
  • 85
26
votes
2 answers

What is causing Azure Event Hubs ReceiverDisconnectedException/LeaseLostException?

I'm receiving events from an EventHub using EventProcessorHost and an IEventProcessor class (call it: MyEventProcessor). I scale this out to two servers by running my EPH on both servers, and having them connect to the Hub using the same…
plukich
  • 635
  • 1
  • 6
  • 14
23
votes
1 answer

understanding check pointing in eventhub

I want to ensure that, if my eventhub client crashes (currently a console application), it only picks up events it has not yet taken from the eventhub. One way to achieve this, is to exploit offsets. However, this (to my understanding) requires the…
cs0815
  • 16,751
  • 45
  • 136
  • 299
20
votes
1 answer

Azure event hubs and multiple consumer groups

Need help on using Azure event hubs in the following scenario. I think consumer groups might be the right option for this scenario, but I was not able to find a concrete example online. Here is the rough description of the problem and the proposed…
infinity
  • 1,900
  • 4
  • 29
  • 48
19
votes
0 answers

Is there a docker image for running in place of an Azure Event Hub in a Test or CI environments?

Is there docker image for running in place of an Azure Event Hub in a Test or CI environment? I want to be able to stand up a full stack with mock event hubs running as docker containers, how are people doing this? The only other option I can think…
hally9k
  • 2,423
  • 2
  • 25
  • 47
17
votes
5 answers

Azure Event Hub vs Kafka as a Service Broker

I'm evaluating the use of Azure Event Hub vs Kafka as a Service Broker. I was hoping I would be able to create two local apps side by side, one that consumes messages using Kafka with the other one using Azure Event Hub. I've got a docker…
Nore Gabbidon
  • 351
  • 1
  • 4
  • 10
16
votes
2 answers

How to use the ServiceBus EventData Offset Value

I have some code that uses the Service Bus Event Data, and I suspect that I need to use the offset property as, currently, my program is (or seems to be) re-running the same Event Hub data over and over again. My code is as follows: public class…
Paul Michaels
  • 16,185
  • 43
  • 146
  • 269
13
votes
3 answers

What is Consumer Group in azure Event Hub?

Can anyone please figure out what is Consumer Group in Azure Event Hubs. And What is the use of it? I have surfed a lot of sites but I can't get a clear answer.
12
votes
1 answer

EPOCH Error while communicating with Azure Event Hub

I am using Azure Event Hub for listening to real-time data in my application. Most of the times, it works fine but sometimes it throws the following error - New receiver with higher epoch of '3109' is created hence current receiver with epoch…
Anil C
  • 1,045
  • 3
  • 16
  • 38
11
votes
4 answers

Azure IoT Hub - Save telemetry best practice

I am working on a IoT solution that will save weather data. I have googled for some days now on how to set up the backend. I am going to use Azure IoT Hub for handling communication, but the next step is the problem. I want to store the telemetry to…
11
votes
2 answers

Should the event hub have same number of partitions as throughput units?

For Azure event hub 1 though put unit equals 1MB/sec ingress. So it can take 1000 messages of 1 KB. If I select 5 or more throughput units would I be able to ingest 5000 messages/ second of 1KB size with 4 partitions? What would be egress in that…
azuredeveloper
  • 111
  • 1
  • 3
1
2 3
99 100