Questions tagged [parallel-data-warehouse]

A massively parallel database environment built on top of SQL Server and run from custom hardware. Parallel Data Warehouses use a modified version of T-SQL to support enhanced parallelization.

A massively parallel database environment built on top of SQL Server and run from custom hardware. Parallel Data Warehouses use a modified version of T-SQL to support enhanced parallelization.

Also known as Analytics Platform System. https://www.microsoft.com/en-us/sql-server/analytics-platform-system

51 questions
7
votes
2 answers

How to insert multiple rows into SQL Server Parallel Data Warehouse table

I am on PDW AU5 with SQL Server 2012 servers. I have an empty replicated table that I'm trying to load data into. I'm only loading 2 records. So, I'm doing: INSERT INTO dbo.some_table (Col1, Col2, Col3) VALUES (1, 'x', 'a'), (2, 'y', 'b') From…
skyline01
  • 1,919
  • 8
  • 34
  • 55
5
votes
6 answers

Azure SQL Data Warehouse Surrogate Keys

So Azure SQL Data Warehouse doesn't support identity columns, and therefore it's tricky to deal with surrogate keys.. anyone got any bold solutions on this one? This is best i have found, and it's pretty horrific.
m1nkeh
  • 1,337
  • 23
  • 45
5
votes
1 answer

Azure SQL Data Warehouse and PolyBase can't read CSV files generated using U-SQL and ADLA

I have a U-SQL script that generates a CSV file in Azure storage and an external table in Azure SQL Data Warehouse (SDW) using PolyBase to read that CSV file. When the CSV file is generated using the U-SQL script, SDW is unable to read the data and…
Tiam
  • 73
  • 4
4
votes
2 answers

Azure Data Warehouse PolyBase File format

We have a file that looks like this: Col1,Col2,Col3,Col4,Col5 "Hello,",I,",am",some,data! It therefore has the following 'properties': Comma-separated Double-quote column delimiter Commas in some of the columns Now, I am not sure if it's actually…
m1nkeh
  • 1,337
  • 23
  • 45
4
votes
1 answer

Error While using SQLCMD in PDW

I'm using SQLCMD in PDW for extracting data into a flat file. The command line syntax is given below: sqlcmd -S "10.20.30.40,19001" -d MyPDW_DB -U PDW_User -P Password1 -Q "SET QUOTED_IDENTIFIER ON; SELECT * FROM MyPDW_DB.dbo.SampleFact" -o…
Triumph Spitfire
  • 663
  • 15
  • 38
3
votes
2 answers

Differences between Azure Data Warehouse and Microsoft Parallel Datawarehouse (PDW)

I'd like to know the key differences between Azure Data Warehouse and Microsoft Parallel Datawarehouse (PDW). I read an article on Azure Data Warehouse here. Also, an article on Microsoft PDW. Looking at features and functionalities, they look…
Ash
  • 1,180
  • 3
  • 22
  • 36
3
votes
1 answer

Escaping quotes in Polybase with STRING_DELIMITER

I've got a pipe delimited flat file I want to load with Polybase. String columns are quoted with double quotes and if there are double quotes in the value, they are doubled. I believe that's a valid file format: SizeDescription|SizeCode "3.5…
GregGalloway
  • 11,355
  • 3
  • 16
  • 47
2
votes
3 answers

Relationships in Azure synapse (DWH)

I'm currently working in Azure synapse DWH and I have some theoretical questions: How I can create relationships between tables (Dim's and Fact's) and what implications I would have If I want to create those relationships. I read that To create a…
Reco Jhonatan
  • 1,503
  • 4
  • 23
  • 35
2
votes
2 answers

WaitFor Delay not working in Azure SQL DW

I am trying to run this simple code in SSMS connected to Azure SQL DW and it fails. I have tried some different variation but none of them seems to be working. BEGIN PRINT 'Hello '; WAITFOR DELAY '00:00:02' PRINT 'Another'; END Msg 103010, Level…
NSS
  • 1,835
  • 2
  • 29
  • 66
2
votes
0 answers

How do i export data from SQL Query in SQL Data WareHouse to Blob File

Is there way to export the data from T-SQL statement to Azure blob storage .csv with headers in Azure Data Warehouse ?
user3799325
  • 590
  • 1
  • 8
  • 20
2
votes
1 answer

Does statistics help fields on JOINS like hashing does in Azure Data Warehouse?

In Azure Data Warehouse, it is recommended to use HASH for distributed tables on the fields you plan to JOIN and potentially even aggregate on. It's also recommended that you create statistics on the fields you plan to use. Let's say you have two…
Fastidious
  • 1,249
  • 4
  • 25
  • 43
2
votes
2 answers

"Unknown property PrimaryFilePath" error when connecting to Azure SQL Data Warehouse database

I've tried to make a new data Connection From Microsoft Visual Studio Entity Framework Data Model Wizard to Azure SQL Data Warehouse , but got an error: Failed to retrieve data for this request. unknown property PrimaryFilePath I can…
2
votes
0 answers

override default script for initialization of flyway metadata table

I'm working with the Microsoft Parallel Data Warehouse appliance and attempting to use flyway to handle table migrations in that environment. The issue I'm running into is that the default script for establishing the schema_version table…
Frank
  • 21
  • 5
2
votes
0 answers

Insert dbcc output into a temporary table in pdw (Parallel Datawarehouse)

I am trying to run the below code in PDW but am facing error: Create table #t ( rspace int, dspace int, ispace int, uspace int, pnode int ) with (location = user_db) insert into #t dbcc pdw_showspaceused When I try to run…
2
votes
3 answers

How do I homebrew an identity column?

We're moving some processes from a Sql Server database environment which allows identity columns to a Sql Server database environment that does not allow identity columns. How can we effeciently create unique integer values for surrogate primary…
quillbreaker
  • 6,119
  • 3
  • 29
  • 47
1
2 3 4