Questions tagged [stream-analytics]
87 questions
9
votes
2 answers
How to find Duplicate documents in Cosmos DB
I have seen like a huge amount of data write to cosmos DB from stream analytics job on a particular day.
It was not supposed to write huge amount of documents in a day. I have to check if there is duplication of documents on that particular day.
Is…

Antony
- 970
- 3
- 20
- 46
7
votes
3 answers
Streaming Analytics job not receiving inputs from IOT hub
I followed a IOT Hub tutorial and got it working. I then created a Stream Analytics job and used the above as an Input (which upon test connection works).
However I do not see any inputs being received. When running a sample test I get the…

dataEng
- 83
- 2
- 7
3
votes
2 answers
Azure Stream Analytics - Query along the stream
I am using Azure Stream Analytics. I have data coming into event hubs. The data coming in looks as below:
[
{
"id": "a2b8bcd8-ff79-4bb7-a86f-615556104c1f",
"mechanism": "geo",
"datetimereporting": "2017-07-23…

ajones
- 31
- 1
3
votes
1 answer
stream analytics query union
I have issue with stream analytics query UNION operation result.
The following query if part one has no rows return, part two has 5 rows return, the UNION suppose to return 5 rows as result, but it return nothing.
SELECT EventKey,…

frank
- 31
- 2
2
votes
2 answers
Stream analytics - How to handle json in reference input
I have an Azure Stream Analytics (ASA) job which processes device telemetry data from event hub. The stream should be joined with reference data from a sql table, to enhance each message with additional device meta data. The merged entry should be…

filip
- 1,444
- 1
- 20
- 40
2
votes
1 answer
azure stream analytics custom json output
I need to convert simple json telemetry packet to custom json output. Can you please help me to achieve this.
INPUT to stream analytics
{"Id":80,"deviceId":"10004","temperature":21.94489404790873,"humidity":63.377043919318496}
Output of stream…

mbr
- 913
- 1
- 11
- 22
2
votes
1 answer
How to check null values in JSON property in stream analytics?
I am Passing the following Json input from Eventhub to Stream Analytics.
{"meter_totalcycleenergy":null,"Test2": 20}, {"meter_totalcycleenergy":40,"Test2":20}
But the job is failing stating the error.
Encountered error trying to write 1 event(s):…

Kiran B Chitari
- 111
- 10
2
votes
2 answers
Pivoting JSON Data Rows into Column
I need Help in Following.
I have data like
[{
"id": "0001",
"type": "donut",
"name": "Cake",
"topping":
[
{ "id": "5003", "type": "Chocolate" },
{ "id": "5004", "type": "Maple" }
]
}]
I want to Convert this into…

Sagar Malandkar
- 49
- 7
2
votes
2 answers
Azure Stream Analytics Pivoting Rows To Columns
I have a data like;
[
{"deviceid":"d1","parameter"="p1" value="1" timestamp="2018-03-22T12:33:00"},
{"deviceid":"d1","parameter"="p2" value="2" timestamp="2018-03-22T12:34:00"},
{"deviceid":"d1","parameter"="p2"…

Metehan Mutlu
- 127
- 10
1
vote
1 answer
what value should we put for Devices attribute while calculating azure stream analytics pricing
I need to calculate pricing for azure stream analytics and i'm confused with the field 'Devices' under 'Stream Analytics on IoT Edge'. is it important for estiamating pricing ? if yes, how to fill it?

ciao_bella
- 31
- 1
- 6
1
vote
1 answer
How to enrich events using a very large database with azure stream analytics?
I'm in the process of analyzing Azure Stream Analytics to replace a stream processing solutions based on NiFi with some REST microservices.
One step is the enrichment of sensor data form a very large database of sensors (>120Gb).
Is it possible with…

motobói
- 1,687
- 18
- 24
1
vote
0 answers
Deploying Azure Stream Analytics error (The number of template input parameters limit exceeded. Limit: '256') using DevOps pipeline
I have generated the ARM templates for my Azure Stream Analytics (ASA) solution using
However, since I have multiple inputs and outputs in my ASA, when…

Sheegy
- 103
- 7
1
vote
1 answer
Arithmetic operation overflow in Azure Stream Analytics with reference data
I have an Azure Stream Analytics job that enhances incoming data with some reference data. Some of them, e. g. physical addresses change not so often.
A generic script would look like this.
SELECT
a.input1
a.input2
b.input1
INTO…

MichaelA
- 1,866
- 2
- 23
- 38
1
vote
0 answers
No output when one side of UNION is empty
I have an Azure Stream Analytics job that combines the results of multiple queries and outputs them to the same sink. To do this, I define my queries within a WITH statement, then combine them using UNION and then write them to my sink. However,…

Leon Cullens
- 12,276
- 10
- 51
- 85
1
vote
1 answer
cross apply an array of values recorded every 10 mins from a timestamp and generate their timestamps in stream analytics
I have the following stream analytics input:
{ "ID":"DEV-001-Test",
"TMSMUTC":"2021-10-14T14:00:00.000",
"MSGTYP":"TELEMETRY",
"THING":[
{
"TMSDUTC":"2021-10-14T13:00:00.000",
"DATA":[
{
…

Ahmed Essam
- 57
- 4