0

I'm curious if anyone has experience with updating partitions in S3 path...

Currently, we have files stored in S3 under the following path s3://bucket/table-name/year=/month=. Glue/Athena table detects this as a year and month partition.

At some point in the future, we believe business partner could request for daily files. This would mean we need to update s3 path to be s3://bucket/table-name/year=/month=/day=. This way we would have files stored down to day partition/grain.

Is this even possible or will we need to reprocess existing files stored under s3://bucket/table-name/year=/month= and force them into a day folder?

TechNewbie
  • 164
  • 2
  • 15
  • You would have to move the files.basically rename the filed https://stackoverflow.com/questions/21184720/how-to-rename-files-and-folder-in-amazon-s3 – Spiff Oct 26 '22 at 19:31

0 Answers0