Stack Overflow
Stack Overflow

Questions tagged [foundry-data-connection]

Questions related to development using Palantir Foundry's Data Connection application are appropriate to use here.

Data connection is Foundry’s tool to perform and schedule large uploads of data.

31 questions
5
votes
2 answers

How does Foundry Magritte append ingestion handle deleted rows in the data source?

If I have a Magritte ingestion that is set to append, will it detect if rows are deleted in the source data? Will it also delete the rows in the ingested dataset?
datawizard
  • 73
  • 2
4
votes
2 answers

How to integrate Palantir Foundry with Amazon S3 or HDFS

Within Palantir Foundry platform, I am working in Data integration. I need some help as I am new to Palantir software. Is there any documents, white-papers, links or tutorials on this topic? How do I integrate data from another source, for example…
Saurabh Chakraborty
  • 101
  • 1
  • 11
2
votes
1 answer

In Palantir Foundry's Data Connection tool, what's the difference between the transaction type options?

When setting up a file-based sync in Data Connection, I see there are a few different options for 'Transaction Type'. What's the difference between them? When might I use them?
hjones
  • 168
  • 1
  • 8
2
votes
1 answer

how to apply schema of one dataframe to another empty dataframe using rest call

I have two datasets in foundry : df1 & df2, df1 has data with a schema. the df2 is the empty dataframe with no schema applied. Using data proxy i was able to extract the schema from df1 { "foundrySchema": { "fieldSchemaList": [ {... } …
Asher
  • 175
  • 11
2
votes
1 answer

Creating bulk sync using YAML does not create the schedule time

Ref below YAML config part for schedule time which is 12 minutes past the hour every 8 hours the bulk syncs get created however the schedule time does not generate. Using the default bulk sync configuration also yields the same result, the schedule…
Asher
  • 175
  • 11
1
vote
0 answers

Add transaction rid, generated timestamp or any other uuid to each imported file from S3/directory

in the Foundry Data Connection app, I can apply Transformers to the files ingested from S3 or any other Filesystem like source. Is there any Transformer available to add an identifier (e.g. current transaction_rid, a generated timestamp when the…
nicornk
  • 654
  • 3
  • 11
1
vote
1 answer

Is there an AMQP data connector in Palantir Foundry?

I'm mostly interested in ingesting data but would also be curious to know if there a also a way to emit messages.
GuiguiDt
  • 263
  • 1
  • 11
1
vote
0 answers

How to calculate pagination in magritte YAML configs?

I'm looking to pull data from a REST API that uses a record offset system. I need to perform basic arithmetic on the returned (current_offset + item_count) data to calculate the next offset. Unfortunately, this API uses a variable page size, so…
Ari Gesher
  • 603
  • 4
  • 6
1
vote
1 answer

Connect QuickBooks with Foundry

Has anyone connected their QuickBooks instance with Foundry? I'm a little unclear on how to setup things on QuickBooks & then on the Foundry side (using the Rest Source) to get the data in. Any help appreciated!
youssefrizk
  • 129
  • 3
1
vote
1 answer

how to access the data frame without my_compute_function

How to use the data set without my_compute_function. From file1 in repository, I want to call a function which is defined in another file. In the second file, I want to make use of the data set, my_input_integration, may be without…
Ram D
  • 167
  • 1
  • 8
1
vote
1 answer

How can you use Data Connection to sync a dataset with only a schema and no rows?

I'm looking to create a dataset using Data Connection from a source file that has only a header in it. That is, I want the synced dataset to have a schema but 0 rows. The automatic schema created will not consider the only row provided in the file…
kevpl541991
  • 161
  • 4
1
vote
1 answer

Can I stop a Foundry Data Connection ingest if it runs for too long?

Recently, a Data Connection ingest ran without making progress for 6 hours (versus the typical ingest time of 30 mins). This caused the source database server to grind to a halt, so we needed to kill the ingest process. Is there a way to…
Adil B
  • 14,635
  • 11
  • 60
  • 78
0
votes
2 answers

Overriding Safety for Webhook Multiple Calls in Palantir Foundry

I'm trying to create a webhook with multiple calls on a direct connection REST-API in Palantir. The first call is to get a token and then pass it to second call and post some data to the source. But when i'm saving the webhook, its throwing an error…
DR_S
  • 77
  • 9
0
votes
1 answer

Foundry Data Connection Rest responses as rows

I'm trying to implement a very simple single get call, and the response returns some text with a bunch of ids separated by newline (like a single column csv). I want to save each one as a row in a dataset. I understand that in general the Rest…
ollie299792458
  • 222
  • 3
  • 16
0
votes
1 answer

How do I ensure my JDBC source is possible to connect to from Foundry?

I want to ensure I can connect to my JDBC-capable source, but I want to ensure my firewall rules are correctly set up to allow this. How can I ensure my network infrastructure is correctly set up to connect?
vanhooser
  • 1,497
  • 3
  • 19
1
2 3