Stack Overflow
Stack Overflow

Questions tagged [dremio]

64 questions
20
votes
3 answers

SQL on top of apache arrow in-browser?

I have data that is stored on a client's browser in-memory. For example, let's say the dataset is as follows: "name" (string), "age" (int32), "isAdult" (bool) "Tom" , 29 1 "Tom" , 14 …
David542
  • 104,438
  • 178
  • 489
  • 842
3
votes
2 answers

Unable to persist data from a Dremio Docker container using volumes

I am able to get a working instance of Dremio on Docker, but, I would like to persist the data on the container on my local. I tried the approach mentioned in this post, and crafted my own version of the docker run query, but upon running the…
smartyputty
  • 31
  • 1
3
votes
2 answers

Apache2 server and Superset, 502 Proxy Error, error reading from remote server while dashboards loading

Short introduction I have Apache Superset and Apache2 server located on the same EC2 instance. Apache2 is acting as a proxy server. It accepts HTTPS requests and transfers them to Apache Superset. Apache Superset is run using…
Vladyslav Moisieienkov
  • 4,118
  • 4
  • 25
  • 32
3
votes
1 answer

ISTIO Ingress Gateway logs

We have set up Istio, and we are using ISTIO ingress gateway for inbound traffic. We have set up TLS for TCP port. Sample code can be found here. We also enabled logs by following this ISTIO guide We tested the TLS connection using openssl and it…
Abba
  • 519
  • 6
  • 17
2
votes
1 answer

Iterate pyarrow._flight.FlightStreamReader

How do I iterate through a reader, assuming its a pyarrow._flight.FlightStreamReader object. Which can be obtained from reader = client.do_get(flight_info.endpoints[0].ticket, options) Entire example.py script came from…
user1179317
  • 2,693
  • 3
  • 34
  • 62
2
votes
1 answer

Is there a way to include element index when using FLATTEN in a Dremio query?

I have a number of rows in a parquet file exposed via Dremio, e.g.: id data 1 [1.5,8.5,23.004] 2 [0.3,4.44, 2.59] What I'm trying to achieve is a query that will flatten the array but give me an explicit index so I know which row…
user1387735
  • 141
  • 2
  • 10
2
votes
1 answer

Adding a data source via REST call in Dremio

I am trying to create a new data source in Dremio using REST API. While the docs are pretty decent, they lack real examples which is where I fail. So wanting to add a new data source I do the following REST calls: Login to get the session…
diginoise
  • 7,352
  • 2
  • 31
  • 39
1
vote
1 answer

Unable to connect to Dremio with ODBC in Golang

I am new to Golang and I am trying to connect to Dremio using ODBC in Golang with Dremio host, port, username and password. The following code gives me error 2022/04/19 17:36:42 missing username and password exit status 1 import ( …
Namrata Kumari
  • 158
  • 1
  • 13
1
vote
0 answers

On Dremio, how do i add a blank/pseudo column in Select statement?

I'd like to know how to add a pseudo column in select statement using Dremio? on MS SQL, I am able to simply use below statement to add a blank column on my result. SELECT ' ' as [Pseudo_Colum] FROM Table How am I doing it on Dremio?
user2251216
  • 13
  • 1
  • 5
1
vote
1 answer

Field with index 0 exceeds the size limit of 32000 bytes,dremio

I have googled and read articles from the community, but I still can't solve this. This is my job profile, https://community.dremio.com/uploads/short-url/edtC2D5EKmhPJViVSEo4V5RbGAe.zip I don’t know what “Field with index 0” means which field in the…
lovan zhang
  • 11
  • 1
1
vote
1 answer

Pyodbc connection closing before query finishes

Setup: I'm running Dremio on a Centos 7.6 VM connected to an HDFS with a large csv (200Gb). Now I'm querying Dremio through pyodbc however if I use the method: cnxn =…
Maximilian Powers
  • 25
  • 5
1
vote
1 answer

How to add an Amazon S3 data source via REST API?

I have CSV files in a directory of an S3 bucket. I would like to use all of the files as a single table in Dremio, I think this is possible as long as each file has the same header/columns as the others. Do I need to first add an Amazon S3 data…
James Adams
  • 8,448
  • 21
  • 89
  • 148
1
vote
0 answers

How to pull dremio data from databricks workspace using pyodbc?

I am able to get data from dremio using pyodbc when I run my python script locally. To make it run locally, I had to install Windows 64 bit odbc driver from the below link using the guide. https://www.dremio.com/drivers/ I don't know, how can I…
Sarvesh Pandey
  • 322
  • 7
  • 17
1
vote
2 answers

What does "poddisruptionbudgets.policy "zk-pdb" already exists" mean while installing with helm?

I've been following this tutorial for setting up dremio with k8s: https://www.dremio.com/tutorials/python-dremio-and-kubernetes/ when attempting to install using charts in https://github.com/dremio/dremio-cloud-tools/, I get the following error…
k8ask
  • 13
  • 3
1
vote
1 answer

How to add new data source in dremio

How can i add new data source type other than the currently listed source types. Is it possible to add other relational database source to dremio. Currently in dremio it's connecting hive through metastore is it possible to connect through…
Rahul
  • 459
  • 2
  • 13
1
2 3 4 5