Questions tagged [bq-load]
7 questions
1
vote
1 answer
Push JSON file with special chars unicode to bigquery via command line
Im trying to push a json file to BQ via bqcmd which contains special chars such as ü but tis failing. Ive tried differnt encoding etc. nothing workign except removing the chars
{
"productName": "soft drüum",
"Category": "xxxxxxx",
…
davey
- 1,544
- 4
- 26
- 41
0
votes
1 answer
Ingesting json data into bigquery table using BQ load
Using
bq --project_id=ny_proj load --source_format=NEWLINE_DELIMITED_JSON my_data.table1 \
sample.json schema.conf
I can load the data into table.
However, i have been facing some limitations. In the json file, I have to ensure all the values are…
Saravana Kumar
- 37
- 6
0
votes
0 answers
BQ client.load_table_from_uri behaves different from python to with in Airflow
I am trying to load a CSV into BQ using a custom operator in Airflow.
My custom operator is using
load_job_config = bigquery.LoadJobConfig(
schema=self.schema_fields,
…
Shivakumar Gokaram
- 17
- 2
0
votes
1 answer
BQ load job failing when trying to create table from AVRO file
I am trying to create a BQ Table from AVRO file. I am getting this error when i run the BQ load job:
"Error while reading data, error message: The Apache Avro library
failed to parse the header with the following error: Unexpected type
for default…
defcon
- 123
- 7
0
votes
2 answers
Error detected while parsing row starting at position: 1830577. Error: Data between close double quote (") and field separator
Im trying to load a table from Teradata to BQ. My pipeline is first export the table data to a gcs location and then using bqload, loading the data from gs:// to the bq table.
My bqload looks like this
bq load --autodetect --source_format=CSV…
jahan
- 103
- 4
- 19
0
votes
1 answer
how to load data into BigQuery with caret(^) delimiter
I have went through documentation for all the supported file types in BQ.
But I came into this issue.
Consider, I have a sample compressed file .gz with format as -
filetype :
col1^col2^col3
d1^d2^d3
Command:
bq load --source_format=CSV…
Shivkumar kondi
- 6,458
- 9
- 31
- 58
-1
votes
1 answer
How can i load csv file data in BigQuery using bq load command?
I have created multiple tables into BigQuery dataset and also i have so many csv files stored into GCS and now i want to load csv files data into each tables. i have used below command to laod data from csv file into table. Table contains more 300+…
Anjali Rao
- 3
- 5