dbt to snowflake connections fails via profiles.yml

Question

I'm trying to connect to snowflake via dbt but connections fail with the error below:

Using profiles.yml file at /home/myname/.dbt/profiles.yml
Using dbt_project.yml file at /mnt/c/Users/Public/learn_dbt/rks-learn-dbt/learn_dbt/dbt_project.yml
Configuration:
  profiles.yml file [ERROR invalid]
  dbt_project.yml file [OK found and valid]
Profile loading failed for the following reason:
Runtime Error
  Could not find profile named 'learn_dbt'
Required dependencies:
 - git [OK found]

Any advice please.

Note: I am learning to setup dbt connections looking at udemy videos.

Below is my profiles.yml file:

learn_dbt:
  target: dev
  outputs:
    dev:
      type: snowflake
      account: XXXXXX
      user: XXXX                
      password: XXXX                     
      role: transform_role
      database: analytics
      warehouse: transform_wh
      schema: dbt
      threads: 1
      client_session_keep_alive: False

score 7 · Answer 1 · answered Jul 04 '20 at 01:55

7

My first guess is that you have a profiles.yml file in your dbt project folder and dbt is not actually using the one in /home/myname/.dbt/.

Could you try running the following?

dbt debug --profiles-dir /home/myname/.dbt

The flag --profiles-dir works on most dbt cli commands and lets you use a custom profiles.yml that's outside your project. I use this flag all the time.

answered Jul 04 '20 at 01:55

Stephan

451
4
5

Thanks for response Stephen . But still there is no luck , i tried .dbt folder copied into ~./learn_dbt folder . Now getting this error "250003: Failed to get the response. Hanging? method: post, url: https://se15650.us-east-2 . When i tried to search in our stack over flow about this error, there was a response in this link https://stackoverflow.com/questions/59471242/operationalerror-250003-failed-to-get-the-response-hanging-method-post , but the response in this link i tried but that still didn't help. Any other thoughts. – Ravi Jul 04 '20 at 13:00
I think figured out the issue i,e it was account_id which should be in the format of 'xe12345.us.-east-1.aws' (which should be in single quotes) – Ravi Jul 05 '20 at 13:34

superjisan · Answer 2 · 2021-12-10T21:05:01.097

5

I had to run pip install dbt-snowflake and then it worked.

It seems dbt has seperated it's modules to dbt-core and it's adapters dbt-snowflake, dbt-postgres etc

edited Dec 10 '21 at 21:05

answered Nov 19 '21 at 19:36

superjisan

1,604
14
15

this worked for me!, thanks mate – Francisco Albert Nov 22 '21 at 23:41

score 2 · Answer 3 · answered Jul 09 '20 at 14:57

I think this is a similar issue to what i had when using the cloud environment.

If you are using a snowflake instance on the West coast the the account name looks like

If you are using a snowflake instance on the East coast the the account name looks like <xxx12345.us-east-1>

score 0 · Answer 4 · answered Nov 15 '21 at 10:26

Overall this error mean it is unable to connect to yead your environment template to get your snowflake account details.

'env.pd.template.bat' or 'env.pd.template.sh' is the base file which has your Snowfalke account settings, so you have run this command to connect to snowflake from your editor.

You can use '.bat', or .sh commands based on Powershell or CMD editor.

In my scenario I ran 'env.pd..private.bat', you need to run this command everytime to connect to snowflake account with your credentials. I ran this in cmd window. It fixed my error.

dbt to snowflake connections fails via profiles.yml

4 Answers4