Stack Overflow
Stack Overflow

Questions tagged [fivetran]

20 questions
3
votes
1 answer

Grant access to a specific future table in Snowflake

I'm currently using Fivetran to pipe data into Snowflake. Once the data has landed, every 6 hours DBT runs some simple saved queries, which appear as tables in a schema. However, the permissions for various roles keep being reset and they can no…
LittleBobbyTables
  • 4,361
  • 9
  • 38
  • 67
1
vote
0 answers

Is there an efficient way to sync MongoDB documents containing schema and data to SQL-Servers?

Context: I'm currently working on a data pipeline project where the aim is to sync MongoDB documents into a SQL server. However, the schema and data are on separate documents in the form shown below: Schema Document: { schema_id: someHex, …
NeroM1
  • 11
  • 3
1
vote
0 answers

About Fivetran custom connectors

[Introduction] I want to connect SAP ECC ERP (old version of S/4HANA) with Fivetran. Fivetran's data source connector is compatible with S/4HANA and ByDesign for SAP products, I couldn't find a connector for SAP ECC ERP (Old version of…
小谷昂平
  • 41
  • 1
1
vote
0 answers

How to get marketing conversion data by ad, adset, and campaign via Facebook's API (Fivetran custom report)

Running into an issue with the marketing API. I'm using Fivetran to pull custom reports, specifically performance at the ad level (spend, reach, imps, clicks, conversions, etc.) by adset and campaign. This is a picture of the customer report setup…
Twen
  • 11
  • 1
1
vote
3 answers

creating sequential workflows using and ETL tool (Fivetran/Hevo), dbt and a reverse ETL tool (Hightouch)

I'm working for a startup and am setting up our analytics tech stack from scratch. As a result of limited resource we're focussing on using 3rd party tools rather than building custom pipelines. Our stack is as follows: ELT tool: either Fivetran or…
Michael Osen
  • 11
  • 1
1
vote
0 answers

DBT Stripe Package, Schema Duplication in Snowflake

I am using the following DBT Package provided by Fivetran: https://hub.getdbt.com/fivetran/stripe/latest/ When the models are processed using dbt run we duplicate the schemas in snowflake: Stripe Stripe combined data stripe_combined is how we…
Solomon
  • 31
  • 3
1
vote
2 answers

Uploading a csv file to snowflake using fivetran

I want to upload csv files from google sheets to snowflake database. I would like to know if there is any option in fivetran such that only upserts(only modified rows) of these csv files are synced to snowflake table?
R0bert
  • 507
  • 6
  • 30
1
vote
1 answer

How to retain a SQL DateTimeOffset in Snowflake without converting to UTC

In SQL Server I store a datetime as a DateTimeOffset data type so the table values contain the UTC offset. For Example: 2020-05-24 14:20:18.0000000 -05:00 However, once I import into Snowflake (via Fivetran) the value is converted to UTC. For…
user9398163
  • 13
  • 6
0
votes
0 answers

Fivetran vs Stitch Jira connector

From reading online it seems like Stitch is a direct comptetor to Fivetran. However, for data replication it seems like Fivetran does a lot of transformation beforehand before injecting the data. For example, splitting json columns into individual…
AIViz
  • 82
  • 9
0
votes
0 answers

I've got CDC instead of SCD2. How can I correctly use it? Transform it?

I am using Fivetran for Facebook Ads and Google Ads connectors. In the case of Facebook Ads, the tables that record historical changes in the dimensions (ad_history, ad_set_history, campaign_history and account_history) have a single temporary…
Juan Ignacio Solerno
  • 1
  • 1
0
votes
0 answers

How can I replicate these segments from Google analytics UA in GA4?

I have a current Google Analytics data flow via FiveTran to Redshift I need to migrate to GA4. The current setup relies heavily on defining Segments in UA, layering them together into one overall "Valid Visitors" segment and then telling FiveTran to…
TetonSig
  • 2,189
  • 15
  • 21
0
votes
1 answer

software.amazon.awssdk.services.s3.model.S3Exception: null (Service: S3, Status Code: 400)?

Iam trying to add s3 data lake as a destination in Fivetran an ETL tool. For that i have created a role with s3 and glue access, accessed by another aws account user(fivetran). I can able to connect s3 without any issues from Fivetran, but getting…
rovoda
  • 13
  • 6
0
votes
1 answer

Snowflake Timezone account parameter changes and sync the same with Source apps like HVR, and DBT

We have one requirement/issue, the data is getting ingested from DB2, MSSQL with Fivetran/HVR and DBT to snowflake as a target. Some source applications has UTC timezone already, but target (snowflake) has pacific timezone due to source and target…
Vicky
  • 51
  • 6
0
votes
0 answers

Can Fivetran convert multiple CSV files to Parquet?

I have the following folder hierarchy in an S3 bucket: January/10 16b516c0-8f2a-eabd-770a-b8bbc83c5859.csv, 16b516c0-8f2a-eabd-770a-b8bbc83c5859.csv, … In other words, every folder represents a calendar day. I would like Fivetran to do the following…
Victor Sotnikov
  • 177
  • 1
  • 2
  • 15
0
votes
2 answers

dbt: how can I run ad_reporting model (only with google_ads source) from fivetran transformation?

I have a dbt project in BitBucket repo, which I connected to fivetran transformation. my deployment.yml file contains: jobs: - name: daily targetName: dev schedule: 0 12 * * * # Define when this job should run, using cron format.…
Riki
  • 1
1
2