Stack Overflow
Stack Overflow

Questions tagged [u-sql]

U-SQL is a query language designed for Azure Data Lake. It provides a way to mingle SQL keywords with syntactic C# expressions, so that within a single script, a programmer can schematize the data from an unstructured source, use SQL to aggregate the data into the desired form, and then write the output to a file or table.

771 questions
12
votes
2 answers

Moving a DocumentDB Collection to Azure Data Lake Storage

I was wondering what's the best practice moving a documentDB to the Azure Data Lake Storage. Should I create a file for each document in a collection or move the entire documentDB? Also I didn't find much information on how I can access the…
reachify
  • 3,657
  • 2
  • 19
  • 22
11
votes
1 answer

Azure Spark SQL vs U-SQL

I have a lot of data files that will be eventually be pushed and stored on the Azure Storage/Data Lake at a regular interval of time. I want to provide an ability to do Analytic on this data but then I see that on Azure there are two approach:…
Kiran
  • 2,997
  • 6
  • 31
  • 62
9
votes
1 answer

Azure Databricks vs ADLA for processing

Presently, I have all my data files in Azure Data Lake Store. I need to process these files which are mostly in csv format. The processing would be running jobs on these files to extract various information for e.g.Data for certain periods of dates…
Jobi
  • 93
  • 1
  • 3
7
votes
1 answer

Choosing between PartiQL vs U-SQL

I was going through the article here : https://aws.amazon.com/blogs/opensource/announcing-partiql-one-query-language-for-all-your-data/ It looks like "PartiQL" is similar like U-SQL provided by Microsoft. Here it is :…
AskMe
  • 2,495
  • 8
  • 49
  • 102
7
votes
2 answers

Parse json file in U-SQL

I'm trying to parse below Json file using USQL but keep getting error. Json…
Saz
  • 75
  • 1
  • 6
7
votes
3 answers

Reasons to use Azure Data Lake Analytics vs Traditional ETL approach

I'm considering using Data Lake technologies which I have been studying for the latest weeks, compared with the traditional ETL SSIS scenarios, which I have been working with for so many years. I think of Data Lake as something very linked to big…
Carlos Moreno
  • 141
  • 2
  • 6
7
votes
3 answers

U-SQL Output in Azure Data Lake

Would it be possible to automatically split a table into several files based on column values if I don't know how many different key values the table contains? Is it possible to put the key value into the filename?
peterko
  • 503
  • 1
  • 6
  • 18
6
votes
2 answers

How to schedule a U-SQL Query in Azure Data Lake?

I want to execute a query in azure data lake daily. Can we schedule a U-SQL query in azure data lake?
Jai
  • 416
  • 6
  • 20
6
votes
1 answer

U-SQL How can I get the current filename being processed to add to my extract output?

I need to add meta data about the Row being processed. I need the filename to be added as a column. I looked at the ambulance demos in the Git repo, but can't figure out how to implement this.
Carolus Holman
  • 175
  • 9
6
votes
2 answers

U- SQL Unable to extract data from JSON file

I was trying to extract data from a JSON file using USQL. Either the query runs successfully without producing any output data or results in "vertex failed fast error". The JSON file looks like: { "results": [ { "name": "Sales/Account", …
Sarath Rachuri
  • 2,086
  • 2
  • 18
  • 18
5
votes
0 answers

Error: Could not find ADLA Account in any resource group - DataLakeStoreGen1

I am trying to check whether the DataLake Analytics account State is active or not with the below power shell script through Service Principal authentication. Application is given the access to datalake analytics account. And it is present in one of…
ravi kiran
  • 371
  • 1
  • 5
  • 17
5
votes
3 answers

Folder Statistics in Azure Data Lake

I'm trying to summarize how much data has been written to a folder in my Data Lake. What is the best way to do this? Should I use a U-SQL job? HDInsights?
BadRaabutation
  • 113
  • 1
  • 3
  • 10
5
votes
1 answer

Does U-SQL allow custom code to call external services

In U-SQL custom code (code behind or Assemblies) can external services be called e.g. bing search or map. Thanks, Nasir
Nasir
  • 167
  • 6
5
votes
1 answer

U-SQL - Extract data from json-array

Already tried the suggested JSONPath option, but it seems the JSONExtractor only recognizes root level. In my case I have to deal with a nested json-structure, with an array as well (see example below). Any options for extracting this without…
Sander
  • 51
  • 1
  • 2
5
votes
3 answers

Type conversion in U-SQL

I am very new to USQL and wondering how to cast a "datetime" to "date" in a select statement. Also, how do i get rid of the millisecond and am/pm? I'd really appreciate any help on this. Thank you all.
enufeffizy
  • 121
  • 2
  • 5
1
2 3
…
51 52