Stack Overflow
Stack Overflow

Questions tagged [sql-data-warehouse]

108 questions
11
votes
2 answers

Table Variables in Azure Data Warehouse

In a SQL Server database, one can use table variables like this: declare @table as table (a int) In an Azure Data Warehouse, that throws an error. Parse error at line: 1, column: 19: Incorrect syntax near 'table' In an Azure Data Warehouse, you…
Dan Bracuk
  • 20,699
  • 4
  • 26
  • 43
4
votes
1 answer

Set a variable dynamically within a SELECT statement

I have an SQL database with several SAP data tables and an SQL statement which looks like this: SELECT DISTINCT AFKO.PLNBEZ AS 'Material', MAKT.MAKTX AS 'Material Number', AFKO.AUFNR AS 'Order', AFVC.VORNR AS 'Operation Number', CRTX.KTEXT AS…
nopassport1
  • 1,821
  • 1
  • 25
  • 53
4
votes
1 answer

Why CTAS statement is so fast in Azure SQL DW?

I have noticed that Create Table As Select (CTAS) in SQL Data Warehouse statements are extremely fast compared to Select into statement. I want to know what magic microsoft did to make it so fast?
HimalayanNinja
  • 421
  • 3
  • 11
3
votes
1 answer

Column Name also appear as a row when querying the external table for specific column

I have a file in azure data lake store. I am using polybase to move data from data lake store to data warehouse. I followed all the steps which are mentioned here. Let's say I have created external table as External_Emp which has 3 columns : ID,…
Jai
  • 416
  • 6
  • 20
3
votes
1 answer

Access Azure Data Lake Analytics Tables from SQL Server Polybase

I need to export a multi terabyte dataset processed via Azure Data Lake Analytics(ADLA) onto a SQL Server database. Based on my research so far, I know that I can write the result of (ADLA) output to a Data Lake store or WASB using built-in…
user796246
  • 33
  • 2
3
votes
2 answers

Azure Data Lake - HDInsight vs Data Warehouse

I'm in a position where we're reading from our Azure Data Lake using external tables in Azure Data Warehouse. This enables us to read from the data lake, using well known SQL. However, another option is using Data Lake Analytics, or some variation…
MMartin
  • 172
  • 2
  • 10
3
votes
1 answer

Create External Table in Azure SQL Data warehouse to a wild card based file or folder path

I know we can create an External table in Azure SQL Data warehouse pointing to a LOCATION that is either a file path or a folder path. Can this file or folder path be based on a wild card pattern instead of an explicit path. Here my file path is a…
Shahzad Badar
  • 83
  • 1
  • 5
3
votes
1 answer

Azure data factory copy activity performance tuning

https://learn.microsoft.com/en-us/azure/data-factory/data-factory-load-sql-data-warehouse. According this link with 1000 DWU and polybase I should get 200MBps throughput. But I am getting 4.66 MBps. I have added user in xlargerc resource class to…
vidyak
  • 173
  • 4
  • 14
2
votes
0 answers

Dimension model (recursive / hierarchical) for Data Warehouse

I'm having difficulty connecting a dimension table (recursive/hierarchical) to a fact table as there are concerns/issues to deal with: The dimension table belongs to a parent-child relationship structure From the original table, it keeps…
zysirhc
  • 37
  • 7
2
votes
2 answers

How to find unused rows in a dimension table

I have a dimension table in my database that has grown too large. With that I mean that is has too many records - over a million - because it grew at the same pace as the linked facts. This is mostly due to a bad design, and I'm trying to clean it…
Hanneke Debie
  • 61
  • 4
2
votes
0 answers

Historical Load SCD2 In Kimball model involving multiple source tables

I am keen find an efficient design solution, that Ralph Kimball's model propose to handle historical load of SCD Type 2 dimension, involving multiple source tables, without using a PIT Table. The source data is comprises of many CDC enabled tables,…
DataGuy
  • 21
  • 2
2
votes
0 answers

Best practices for fact table that depends on two processes

I am building a star schema for an online business. One of the key processes is email newsletter signup. But the analysis depends on two processes and I can't figure out how to model it the best way. Here's how the process works: Person visits…
user3505886
  • 710
  • 7
  • 7
2
votes
2 answers

Unable to publish DB project on Azure SQL Data Warehouse

With Visual Studio 2019 (already updated to the latest version), I have created a new SQL Server Database Project connected to an Azure SQL Datawarehouse Database. I imported all the object already present on the database (tables, stored procedure…
Lorenzo Benassi
  • 621
  • 1
  • 8
  • 31
2
votes
1 answer

disable column store in azure sql dataware house

I am writing a dataframe from Azure Databricks onto a sql dataware house with res.write \ .format("jdbc") \ .option("url", url) \ .option("dbtable", table) \ .option("user", user) \ .option("password", password) \ …
Dee
  • 199
  • 4
  • 17
2
votes
1 answer

not able to install SSDT for visual studio 2017 professional

Need your help I have successfully installed VS2017 on my computer . But when I tried to install SQL server data tools 15.6.0 or 15.5.1 it gives me error as below : Setup failed The configuration registry key could not be opened(0x800703F3) Thanks…
user7854107
  • 21
  • 1
  • 3
1
2 3 4 5 6 7 8