Pass List[String] to function that takes f(args: String*) scala

Question

I need to read in specific parquet files with spark, I know this can be done like so:

sqlContext
    .read
    .parquet("s3://bucket/key", "s3://bucket/key")

Right now I have a List[String] object with all these s3 paths in it but I don't know how I can pass this programmatically to the parquet function in Scala? There are way to many files to do it manually, any ideas how to get the files into the parquet function programmatically?

You are looking for _splat operator_: `.parquet(listOfStrings:_*)` — Dima, Jul 08 '16 at 02:33

score 3 · Accepted Answer · edited May 23 '17 at 12:22

3

I've answer a similar question earlier concerning repeated parameters here.

As @Dima mentioned, you are looking for a splat operator because .parquet expected repeated arguments :

sqlContext.read.parquet(listOfStrings:_*)

More on repeated arguments in the Scala Language Specification seciton 4.6.2

Although it's the specs of scala 2.9, this part didn't change.

edited May 23 '17 at 12:22

Community

1
1

answered Jul 08 '16 at 08:39

eliasah

39,588
11
124
154

Pass List[String] to function that takes f(args: String*) scala

1 Answers1

Linked