Stack Overflow
Stack Overflow

Questions tagged [azure-synapse]

Questions about Azure Synapse Analytics, bringing together enterprise data warehousing and big data analytics.

Azure Synapse is a limitless analytics service that brings together enterprise data warehousing and Big Data analytics. It gives you the freedom to query data on your terms, using either serverless or provisioned resources—at scale. Azure Synapse brings these two worlds together with a unified experience to ingest, prepare, manage, and serve data for immediate BI and machine learning needs.

2525 questions
13
votes
4 answers

How to calculate Azure SQL Data Warehouse DWU?

I am analyzing Azure SQL DW and I came across the term DWU (Data warehouse units). The link on Azure site only mentions a crude definition of DWU. I want to understand how DWU is calculated and how should I scale my system accordingly. I have also…
ViSu
  • 462
  • 2
  • 4
  • 17
12
votes
3 answers

What is a difference between table distribution and table partition in sql?

I am still struggling with identifying how the concept of table distribution in azure sql data warehouse differs from concept of table partition in Sql server? Definition of both seems to be achieving same results.
Amit Soni
  • 147
  • 1
  • 1
  • 5
12
votes
4 answers

DROP TABLE IF EXISTS not working on Azure SQL Data Warehouse

I used the SQL Server management studio to generate script against Azure Data Warehouse. I selected Edition Azure Data Warehouse, it generates below the script to drop table if it exists and create table. However, the script cannot pass validation.…
Edison
  • 287
  • 1
  • 6
  • 18
10
votes
2 answers

Do you know how to install the 'ODBC Driver 17 for SQL Server' on a Databricks cluster?

I'm trying to connect from a Databricks notebook to an Azure SQL Datawarehouse using the pyodbc python library. When I execute the code I get this error: Error: ('01000', "[01000] [unixODBC][Driver Manager]Can't open lib 'ODBC Driver 17 for SQL…
user2364105
  • 138
  • 1
  • 1
  • 6
10
votes
3 answers

how to change Data Factory in Microsoft Integration Runtime COnfiguration Manager?

I have Installed Microsoft Integration Runtime configuration Manager When I have Migrated Data from On-Premise SQL Server to Azure Data Lake and when I'm trying to use for another Azure Data Factory I don't find a space to add new key for the data…
Saranraj K
  • 412
  • 1
  • 7
  • 19
10
votes
4 answers

How to set any column as primary key in Azure SQL data warehouse

I am trying to set one column in DB as primary key but I always get this error: Enforced unique constraints are not supported in Azure SQL Data Warehouse. To create an unenforced unique constraint you must include the NOT ENFORCED syntax as part of…
shweta_kaushish
  • 141
  • 1
  • 3
  • 17
9
votes
2 answers

Azure Data Explorer (ADX) vs Polybase vs Databricks

Question Today I discovered another Azure service called Azure Data Explorer (ADX). Sorry for such comparison of services, I have good understanding of all except ADX. I feel like there is a big functionality overlay, so want to know the exact role…
VB_
  • 45,112
  • 42
  • 145
  • 293
8
votes
2 answers

Not able to create table in Azure Synapse Analytics

I am new in Azure Synapse Analytics. I have created database in workspace but when I am trying to create a new table it is showing below error. Failed to execute query. Error: CREATE TABLE is not supported. Attaching screenshot of…
Praval Sharma
  • 1,921
  • 2
  • 14
  • 20
8
votes
3 answers

SQLAlchemy error: An attempt to complete a transaction has failed. No corresponding transaction found

I have installed: Ubuntu (18.04) Python (3.6.8) msodbcsql17 (Microsoft ODBC Driver 17 for SQL Server) SQLAlchemy (1.3.5) Pandas (0.24.2) and I want to create just a proof of concept using SQLAlchemy with an Azure SQL Data Warehouse. However, when…
Efstathios Chatzikyriakidis
  • 1,341
  • 2
  • 15
  • 33
8
votes
4 answers

Insert values statement can contain only constant literal values or variable references in SQL Data Warehouse

Consider this table: CREATE TABLE t (i int, j int, ...); I want to insert data into a table from a set of SELECT statements. The simplified version of my query is: INSERT INTO t VALUES ((SELECT 1), (SELECT 2), ...); The real query can be much more…
Lukas Eder
  • 211,314
  • 129
  • 689
  • 1,509
7
votes
0 answers

Synapse Spark - Deltalake configs for Schema evolution and write optimizations

I am looking for databricks equivalent properties in Synapse spark. Please let me know if there are any or workaround for the same. Using MERGE command to Insert/update the data. However, it does not support schema merge. Is there any property to…
Ram
  • 71
  • 1
7
votes
2 answers

Spark pool taking time to start in azure synapse Analytics

I have created 3 different notebook using pyspark code in Azure synapse Analytics. Notebook is running using spark pool. There is only one spark pool for all 3 notebook. when these 3 notebook run individually, spark pool starts for all 3 notebook by…
kshitiz sinha
  • 113
  • 1
  • 7
7
votes
1 answer

Optimal SSIS data flow settings to load to stage table in Azure SQL DW

I have a 350MB table that's fairly wide with two varchar(2000) columns. Via an SSIS data flow it takes 60 minutes to load via OLEDB "fast load" destination to Azure SQL DW. I changed the destination on that data flow to be the Azure Blob Destination…
GregGalloway
  • 11,355
  • 3
  • 16
  • 47
7
votes
1 answer

Azure SQL Data Warehouse and Entity Framework

Does anybody know if/when we will be able to use Entity Framework with the Azure SQL Data Warehouse? I have searched high and low and cannot seem to find anything other than a question posted on MSDN in Auguts 2015 saying: "We have not yet…
How 'bout a Fresca
  • 2,267
  • 1
  • 15
  • 26
6
votes
1 answer

Data Factory, Synapse Analytics and DataBricks Comparison

I'm little bit new on Azure and I'm wondering when is recommendable to use ADF, Synapse, or DataBricks. What are their use cases for best practices and performance? Could you help me with this theorical question? Cheers!
Xkid
  • 338
  • 1
  • 4
  • 17
1
2 3
…
99 100