I just started to experiment with the new datastream from CloudSQL (PostgreSQL) to Bigquery and I am having many errors when starting the stream. Mostly BIGQUERY_UNSUPPORTED_TYPE_FOR_PRIMARY_KEY
and BIGQUERY_TOO_MANY_PRIMARY_KEYS
. Some of the table are just being created when other do not even if they have the same primary key type (created by bigserial PRIMARY KEY)
Asked
Active
Viewed 528 times
5

Jonathan Chevalier
- 993
- 1
- 9
- 18
-
I have exactly the same issue for postgres table with 1 primary key (signle column) and 4 unique index (single column each). So I tried to remove all unique indexes and it works now, so, let's check if you don't have 4 unique index in your source table (primary key included) – Fryck Oct 07 '22 at 12:15
-
yes @Fryck I have one unique index. How did you proceed ? By updating your source database ? – Jonathan Chevalier Oct 07 '22 at 15:27
-
have you found another way other than to remove the unique indexes? – stuisme Oct 15 '22 at 07:37
-
Note that google is aware, issue tracked here https://issuetracker.google.com/issues/250938168?pli=1 – KayakinKoder Oct 20 '22 at 00:33