According to How do I detect if a Spark DataFrame has a column, there is a function like df.columns.contains("column-name-to-check")
which can check whether a column exists. I searched around and didn't find similar function in Java Spark. Does anybody know whether there's a similar one in Java?
Asked
Active
Viewed 3,331 times
2

Danyal Sandeelo
- 12,196
- 10
- 47
- 78

Coding_Rabbit
- 1,287
- 3
- 22
- 44
2 Answers
3
One of the options:
Arrays.asList(df.columns()).contains("column-name-to-check")

chlebek
- 2,431
- 1
- 8
- 20
1
In the Java API, columns
returns String[]
. Therefore, I guess you can use java.util.Arrays
(since Java 8):
String yourColumn = "columnName";
String[] columns = df.columns();
boolean contains = Arrays.stream(columns).anyMatch(yourColumn::equals);

Aziret Satybaldiev
- 430
- 3
- 7