Hoping someone else has encountered this problem. We have a build running a pretty simple transform with a few left joins one after the other, that is failing with the following exception:
: java.lang.ClassCastException: class org.apache.spark.sql.catalyst.plans.logical.Project cannot be cast to class org.apache.spark.sql.catalyst.plans.logical.Join (org.apache.spark.sql.catalyst.plans.logical.Project and org.apache.spark.sql.catalyst.plans.logical.Join are in unnamed module of loader 'app')
I've been searching around everywhere for some explanation of this, but have turned up empty. It seems like from the exception that there's some cast going on from a project to a join? (related to the logical plan?)
Happy to post the redacted code for the transform if that's helpful
Tried to run a build and it ended up failing with an ClassCastException, and the error message makes it difficult to understand what's actually going wrong.
