Stack Overflow
Stack Overflow

Questions tagged [polybase]

PolyBase enables SQL Server 2016 instance to process Transact-SQL queries that read data from Hadoop/Azure Storage. The same query can also access relational tables in your SQL Server. PolyBase enables the same query to also join the data from Hadoop and SQL Server. In SQL Server, an external table or external data source provides the connection to Hadoop.

179 questions
9
votes
2 answers

Azure Data Explorer (ADX) vs Polybase vs Databricks

Question Today I discovered another Azure service called Azure Data Explorer (ADX). Sorry for such comparison of services, I have good understanding of all except ADX. I feel like there is a big functionality overlay, so want to know the exact role…
VB_
  • 45,112
  • 42
  • 145
  • 293
6
votes
2 answers

EXTERNAL TABLE access failed due to internal error: 'Java exception raised on call to HdfsBridge_IsDirExist. Java exception message:

I am trying to create external table through polybase with below syntax on Visual Studio 2015. Its giving me the below error. Can some one pls help on this CREATE EXTERNAL TABLE dbo.DimDate2External ( DateId INT NOT NULL, CalendarQuarter…
ravi kiran
  • 371
  • 1
  • 5
  • 17
4
votes
1 answer

Polybase doesn't create external file format

I get the good old Incorrect syntax near 'EXTERNAL'. error. I am exactly doing what this answer describes. But SQL Server returns the aforementioned error when I come to this code-chunk: CREATE EXTERNAL FILE FORMAT csvformat WITH ( …
5th
  • 2,097
  • 3
  • 22
  • 41
4
votes
3 answers

Azure SQL DW to Azure SQL DW using Polybase

I know you can use polybase using external table to load large volume of data from Blob Storage to Azure SQL DW. But is there any possibility that we can import the data from SQL DW to another SQL DW using polybase directly? Or is there some other…
HimalayanNinja
  • 421
  • 3
  • 11
3
votes
0 answers

Error while importing date type from an Oracle database to Sql Server using external tables (Polybase)

For a client I'm trying to create an external table which connects to an Oracle database using Polybase. While executing a select on this external table I receive the following msg: Cannot execute the query "Remote Query" against OLE DB provider…
justsander
  • 91
  • 5
3
votes
0 answers

Snowflake ODBC driver and SQL Server Polybase

We're currently running a POC with Snowflake and want to integrate it with our existing on premises SQL Server 2019 data warehouse. I've been playing with the standard ODBC driver provided by snowflake, and can get Polybase to connect and talk to…
Chris
  • 103
  • 3
3
votes
1 answer

sqldumper error leads to C drive getting full

I've installed Microsoft SQL Server 2019 following this guide. At 10:30 it was advised to change the User database directory, the User log directory and the backup directory from default to directories on drive D. Now I got dump files being…
diplodocus
  • 67
  • 1
  • 1
  • 7
3
votes
1 answer

Import external table

I created an external table using polybase with CREATE EXTERNAL TABLE [ext].[gendertable] ( gender_id TINYINT NOT NULL, gender VARCHAR(16) NOT NULL ) WITH ( LOCATION = '/MovieDB/gender.csv', DATA_SOURCE = AzureBlobHDP,…
5th
  • 2,097
  • 3
  • 22
  • 41
3
votes
1 answer

Install and configure Polybase on Azure SQL Server - Could not find stored procedure 'sp_configure'

I am trying to setup a PolyBase (external) table with data in Azure SQL Server database hosted on a Azure SQL Server (setup through the portal) Azure Blob storage (CSV data) SQL Server version: Microsoft SQL Azure (RTM) - 12.0.2000.8 Nov 2…
kpython
  • 363
  • 2
  • 8
  • 21
3
votes
1 answer

GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt) while connecting Polybase with Kerberos

We want to connect our SQL Server 2016 Enterprise via Polybase with our Kerberized OnPrem Hadoop-Cluster with Cloudera 5.14. I followed the Microsoft PolyBase Guide to configure Polybase. After working few days on this topic I'm not able to continue…
Gigi
  • 69
  • 1
  • 1
  • 6
3
votes
1 answer

Column Name also appear as a row when querying the external table for specific column

I have a file in azure data lake store. I am using polybase to move data from data lake store to data warehouse. I followed all the steps which are mentioned here. Let's say I have created external table as External_Emp which has 3 columns : ID,…
Jai
  • 416
  • 6
  • 20
3
votes
1 answer

Azure data factory copy activity performance tuning

https://learn.microsoft.com/en-us/azure/data-factory/data-factory-load-sql-data-warehouse. According this link with 1000 DWU and polybase I should get 200MBps throughput. But I am getting 4.66 MBps. I have added user in xlargerc resource class to…
vidyak
  • 173
  • 4
  • 14
3
votes
2 answers

How to a Drop Poly Base external table if exists?

I have loaded the File data from Azure blob storage to Azure SQL DW external table through poly-base. Now the File present in Blob container has been updated. Now I want to load the fresh data. Can any one suggest how the fresh data can be loaded to…
ravi kiran
  • 371
  • 1
  • 5
  • 17
2
votes
1 answer

What if the DB coin stake is exceeded by the incentive to misbehave?

If protocols built with Polybase base their own rewards on DB data, could a bad DB indexer not abuse its storage power? I just wanted to understand more on the Polybase incentive structure and how you guys make sure that there is no bad actor in the…
Srini
  • 31
  • 1
2
votes
2 answers

String delimiter present in string not permitted in Polybase?

I'm creating an external table using a CSV stored in an Azure Data Lake Storage and populating the table using Polybase in SQL Server. However, I ran into this problem and figured it may be due to the fact that in one particular column there are…
jcoke
  • 1,555
  • 1
  • 13
  • 27
1
2 3
…
11 12