Comparing timestamps in Spark Scala

Asked Jul 14 '22 at 23:42

Active Jul 14 '22 at 23:42

Viewed 123 times

I have two columns in my db, called start_date and end_date, which are both timestamps. I want to collect only the rows that meet the requirement: start_date <= current date and end_date > current date. Right now I have

.select("col1", "col2", "col3")
.where(col("start_date") <= current_date())
.where(col("end_date") > current_date() && col("end_date") =!= null)

but this returns nothing, which gives me a reason to believe I'm comparing timestamps incorrectly. Could anyone help with this? Thanks!

asked Jul 14 '22 at 23:42

Jericho Sims

possible duplicate: [scala-to-check-the-current-timstamp-is-greater-than-a-timestamp-column-in-my-da](https://stackoverflow.com/a/36976244/5275706) – Vikas Jul 15 '22 at 05:03
use `col("end_date").isNotNull` instead – blackbishop Jul 15 '22 at 07:58

Comparing timestamps in Spark Scala

0 Answers0