Questions tagged [stream-analytics]

87 questions
9
votes
2 answers

How to find Duplicate documents in Cosmos DB

I have seen like a huge amount of data write to cosmos DB from stream analytics job on a particular day. It was not supposed to write huge amount of documents in a day. I have to check if there is duplication of documents on that particular day. Is…
7
votes
3 answers

Streaming Analytics job not receiving inputs from IOT hub

I followed a IOT Hub tutorial and got it working. I then created a Stream Analytics job and used the above as an Input (which upon test connection works). However I do not see any inputs being received. When running a sample test I get the…
dataEng
  • 83
  • 2
  • 7
3
votes
2 answers

Azure Stream Analytics - Query along the stream

I am using Azure Stream Analytics. I have data coming into event hubs. The data coming in looks as below: [ { "id": "a2b8bcd8-ff79-4bb7-a86f-615556104c1f", "mechanism": "geo", "datetimereporting": "2017-07-23…
ajones
  • 31
  • 1
3
votes
1 answer

stream analytics query union

I have issue with stream analytics query UNION operation result. The following query if part one has no rows return, part two has 5 rows return, the UNION suppose to return 5 rows as result, but it return nothing. SELECT EventKey,…
frank
  • 31
  • 2
2
votes
2 answers

Stream analytics - How to handle json in reference input

I have an Azure Stream Analytics (ASA) job which processes device telemetry data from event hub. The stream should be joined with reference data from a sql table, to enhance each message with additional device meta data. The merged entry should be…
2
votes
1 answer

azure stream analytics custom json output

I need to convert simple json telemetry packet to custom json output. Can you please help me to achieve this. INPUT to stream analytics {"Id":80,"deviceId":"10004","temperature":21.94489404790873,"humidity":63.377043919318496} Output of stream…
mbr
  • 913
  • 1
  • 11
  • 22
2
votes
1 answer

How to check null values in JSON property in stream analytics?

I am Passing the following Json input from Eventhub to Stream Analytics. {"meter_totalcycleenergy":null,"Test2": 20}, {"meter_totalcycleenergy":40,"Test2":20} But the job is failing stating the error. Encountered error trying to write 1 event(s):…
2
votes
2 answers

Pivoting JSON Data Rows into Column

I need Help in Following. I have data like [{ "id": "0001", "type": "donut", "name": "Cake", "topping": [ { "id": "5003", "type": "Chocolate" }, { "id": "5004", "type": "Maple" } ] }] I want to Convert this into…
2
votes
2 answers

Azure Stream Analytics Pivoting Rows To Columns

I have a data like; [ {"deviceid":"d1","parameter"="p1" value="1" timestamp="2018-03-22T12:33:00"}, {"deviceid":"d1","parameter"="p2" value="2" timestamp="2018-03-22T12:34:00"}, {"deviceid":"d1","parameter"="p2"…
Metehan Mutlu
  • 127
  • 10
1
vote
1 answer

what value should we put for Devices attribute while calculating azure stream analytics pricing

I need to calculate pricing for azure stream analytics and i'm confused with the field 'Devices' under 'Stream Analytics on IoT Edge'. is it important for estiamating pricing ? if yes, how to fill it?
1
vote
1 answer

How to enrich events using a very large database with azure stream analytics?

I'm in the process of analyzing Azure Stream Analytics to replace a stream processing solutions based on NiFi with some REST microservices. One step is the enrichment of sensor data form a very large database of sensors (>120Gb). Is it possible with…
motobói
  • 1,687
  • 18
  • 24
1
vote
0 answers

Deploying Azure Stream Analytics error (The number of template input parameters limit exceeded. Limit: '256') using DevOps pipeline

I have generated the ARM templates for my Azure Stream Analytics (ASA) solution using However, since I have multiple inputs and outputs in my ASA, when…
1
vote
1 answer

Arithmetic operation overflow in Azure Stream Analytics with reference data

I have an Azure Stream Analytics job that enhances incoming data with some reference data. Some of them, e. g. physical addresses change not so often. A generic script would look like this. SELECT a.input1 a.input2 b.input1 INTO…
MichaelA
  • 1,866
  • 2
  • 23
  • 38
1
vote
0 answers

No output when one side of UNION is empty

I have an Azure Stream Analytics job that combines the results of multiple queries and outputs them to the same sink. To do this, I define my queries within a WITH statement, then combine them using UNION and then write them to my sink. However,…
1
vote
1 answer

cross apply an array of values recorded every 10 mins from a timestamp and generate their timestamps in stream analytics

I have the following stream analytics input: { "ID":"DEV-001-Test", "TMSMUTC":"2021-10-14T14:00:00.000", "MSGTYP":"TELEMETRY", "THING":[ { "TMSDUTC":"2021-10-14T13:00:00.000", "DATA":[ { …
1
2 3 4 5 6