5

If I need to publish two tables in two different databases in the metastore, do I need to create two different DLT pipeline? I am asking this because I saw that in the pipeline setting, i can only specify 1 target.

Alex Ott
  • 80,552
  • 8
  • 87
  • 132
Rajib Deb
  • 1,496
  • 11
  • 30

1 Answers1

2

Right now - yes, DLT only supports one target database. So if you need to push into different databases, then you may have two DLT pipelines.

Theoretically you can have one pipeline that will be publishing two tables into a single database, and then you can use create table ... using delta location '<dlt_storage>/tables/<table_name>' to refer to it, but it won't work well with the schema evolution, etc.

Alex Ott
  • 80,552
  • 8
  • 87
  • 132
  • 1
    Hi Alex, how will it impact schema evolution. Can you please help explain this. – Rajib Deb Oct 06 '22 at 05:54
  • 2
    Schema evolution will still work for Delta Live Tables, but the schema may not be reflected for a table in the 2nd database as it's not directly maintained by DLT – Alex Ott Oct 06 '22 at 06:29