Questions tagged [apache-arrow-flight]
17 questions
3
votes
1 answer
What is the best way to send Arrow data to the browser?
I have Apache Arrow data on the server (Python) and need to use it in the browser. It appears that Arrow Flight isn't implemented in JS. What are the best options for sending the data to the browser and using it there?
I don't even need it…
Brian
- 563
- 1
- 5
- 15
1
vote
0 answers
Rust + Apache Flight: how to get around a library trait method defined on &self
The Apache Arrow Flight protocol's Rust implementation defines a FlightService trait with a static lifetime
pub trait FlightService: Send + Sync + 'static {
...
and a non-mutable handshake method:
// Required methods
fn handshake<'life0,…
jwimberley
- 1,696
- 11
- 24
1
vote
1 answer
How do I enable TLS on an Apache Arrow FlightClient in Java?
The documentation for the Java Apache Arrow (v11.0.0) FlightClient.Builder has several methods related to constructing a TLS-enabled client:
clientCertificate(InputStream clientCertificate, InputStream clientKey)
useTls()
overrideHostname(String…
c_sagan
- 482
- 3
- 15
1
vote
0 answers
How do I convert a Polars DataFrame to Vec?
edit: To hopefully be more concise, how do I do this?-
use polars::prelude::{DataFrame, NamedFrom, df};
use arrow::record_batch::RecordBatch;
fn main() {
let polars_df: DataFrame = df!("cat_data" => &[1.0, 2.0, 3.0, 4.0],
…
user21083829
- 11
- 2
1
vote
0 answers
Apache Arrow Flight: Releasing the flight stream that was created by GetFlightInfo
According to the Arrow Flight protocol definition, a client(consumer) can let the server generate a flight stream through a specified descriptor in GetFlightInfo. And the flight stream will be available for the duration defined by the server(a…
zeodtr
- 10,645
- 14
- 43
- 60
1
vote
0 answers
Create a graphql api in Java which streams an arrowflight stream
I need to create a graphql api which streams an arrowflight stream. I'm unable to find any documentation which can help me figure out a way to do this in Java. Below is the sample code I have:
String query = String.format(
"SELECT %s…
ekta mantri
- 11
- 1
1
vote
0 answers
How to get list of objects using Mono ResponseEntity objects, as it returns single object
@RequestMapping("/api/v1")
public class RemoteActionHistoryController {
public Mono>> excaliburData(@PathVariable(name = "deviceId", required = true)
String deviceId) {
return…
Nagma Firdose
- 96
- 6
1
vote
1 answer
How to decode Arrow Flight `FlightData` with a pure gRPC client
I came across a situation where we need to use a plain gRPC client (through the grpc.aio API) to talk to an Arrow Flight gRPC server.
The DoGet call did make it to the server, and we have received a FlightData in response. If our understanding of…
liuyu
- 1,279
- 11
- 25
0
votes
0 answers
Can I use Apache Flight for sending and receiving byte data?
I am using Apache Http client for sending and receiving data from server. For large requests I have chunked the data manually and sending them one by one . Is there any way to send these data chunks parallelly. That's when I read about Apache…
0
votes
0 answers
Pyarrow flight server to expose custom endpoints
Can i create a pyarrow flight server that can expose custom end points which the client can call ?
I have seen only code where do_get method returning pyarrow tables.
Can the client pass on parameters that can be used to filter the data on the…
0
votes
0 answers
2nd row is not getting inserted with BitVector in Apache Arrow Flight Sql in Java
main.java
Schema schema = new Schema(mtasks.asFlightFieldList(), metadata);
try (VectorSchemaRoot vectorSchemaRoot = VectorSchemaRoot.create(schema, rootAllocator)) {
VarCharVector idVector = (VarCharVector) vectorSchemaRoot.getVector("ID");
…
0
votes
1 answer
Apache Arrow Flight: Getting sorted data from multiple endpoints
According to the document (https://arrow.apache.org/docs/dev/format/Flight.html), an Apache Arrow Flight client cannot get sorted data from multiple endpoints. It seems that this is by design.
In the introduction document…
zeodtr
- 10,645
- 14
- 43
- 60
0
votes
1 answer
Convert Arrow Flight Response to JSON
I have been looking into Dremio and Arrow Flight recently and intrigued by the possibilities. One thing I’m not sure on is can you convert an Arrow Flight response to JSON easily with Java? Use case would be a service that interacts with Dremio…
user12641216
- 7
- 2
0
votes
1 answer
Transform Arrow.Table to Arrow.RecordBatch
I'm working with some Arrow data in C# as a Table and need to convert this to RecordBatch to send over the wire via Arrow Flight. It's trivial to go the other way via Table.TableFromRecordBatches like this:
var schema = recordBatch.Schema;
var table…
Kirk Broadhurst
- 27,836
- 16
- 104
- 169
0
votes
1 answer
How to close pyarrow connection to Dremio?
I am using pyarrow to connect to the Dremio cloud and query the datasets.
Documentation - https://docs.dremio.com/cloud/client-applications/python/
My question is how can I close the connection to Dremio after I finish the job?
idkman
- 169
- 1
- 15