2

According to How do I detect if a Spark DataFrame has a column, there is a function like df.columns.contains("column-name-to-check") which can check whether a column exists. I searched around and didn't find similar function in Java Spark. Does anybody know whether there's a similar one in Java?

Danyal Sandeelo
  • 12,196
  • 10
  • 47
  • 78
Coding_Rabbit
  • 1,287
  • 3
  • 22
  • 44

2 Answers2

3

One of the options:

Arrays.asList(df.columns()).contains("column-name-to-check")

chlebek
  • 2,431
  • 1
  • 8
  • 20
1

In the Java API, columns returns String[]. Therefore, I guess you can use java.util.Arrays (since Java 8):

String yourColumn = "columnName";
String[] columns = df.columns();
boolean contains = Arrays.stream(columns).anyMatch(yourColumn::equals);