I was trying to run the below query in Azure data bricks.
query=s"""WITH pre_file_user AS(
SELECT id,
typeid,
CASE when dttm is null or dttm='' then cast('1900-01-01 00:00:00.000' as timestamp)
else cast(dttm as timestamp)
end as dttm
from dde_pre_file_user_supp
)"""
spark.sql(query)
then I was getting the following error
ParseException:no viable alternative at input 'with pre_file_users AS (\n select id, \n typid, in case\n when dttm is null or dttm = '' then cast('1900-01-01 00:00:00.000 as timestamp)\n end as dttm\n from dde_pre_file_user_supp\n )'
Can I use WITH clause in data bricks or is there any alternative?