0

I am encountering problems in my AWS Glue as it is stated in the title (also attached the error) error.

Different jobs, return different error number code such as:

An error occurred while calling o176.pyWriteDynamicFrame. YEAR

and another returns

An error occurred while calling o116.pyWriteDynamicFrame. YEAR

and many more

An error occurred while calling o128.pyWriteDynamicFrame. YEAR

I am using Glue 3.0, and using AWS Data Catalog as the Source, SQL Query for Transform, and Redshift as the Target. IAM Role: AWSGlueETLRole Type: Spark Language: Python 3

I have these error in several jobs that were already existing in 2022 and there were no errors before 4 February 2023. The jobs running fine before that and there were no error also in the code if we run them in Metabase or Dbeaver (MySQL).

I have totally no clue what happened and how to fix this as I was just started to use AWS Glue. Can someone help me to explain what happening, how do I check the error logs, and how to fix this?

I have already tried to cast date columns as date to see if these caused by the date as the error contains YEAR, but that did not help.

And I haven't do anything as I afraid it will break the code or the ETL.

aya
  • 1
  • 1
  • Have you solved this? Otherwise can you provide some more information as the schema of the DynamicFrame and the code lines that create the error? – Gabriele Aug 22 '23 at 13:33

0 Answers0