1

When running spark cluster in AWS EMR, I save some parque file.

When saving the files, spark creates some empty files that contains the word $folder$ like these:

enter image description here

These files are saved in S3.

Does any configuration exist to avoid creation of these files?

Kos
  • 4,890
  • 9
  • 38
  • 42
Shadowtrooper
  • 1,372
  • 15
  • 28

0 Answers0