Questions tagged [lakefs]

For more information, see the official lakeFS documentation, or our GitHub repo.

6 questions
15
votes
3 answers

AWS S3 Bucket giving 'policies must be valid JSON and the first byte must be '{'

{ "Id": "Policy1590051531320", "Version": "2012-10-17", "Statement": [ { "Sid": "Stmt1590051522178", "Action": [ "s3:GetObject", "s3:GetObjectVersion", "s3:PutObject", "s3:AbortMultipartUpload", "s3:ListMultipartUploadParts",…
Didi
  • 431
  • 1
  • 4
  • 13
13
votes
1 answer

lakeFS, Hudi, Delta Lake merge and merge conflicts

I'm reading documentation about lakeFS and right now don't clearly understand what is a merge or even merge conflict in terms of lakeFS. Let's say I use Apache Hudi for ACID support over a single table. I'd like to introduce multi-table ACID support…
alexanoid
  • 24,051
  • 54
  • 210
  • 410
4
votes
1 answer

Do I need garbage collector when I delete object from branch by API?

Do I need a garbage collector in LakeFS when I delete an object from a branch by API? Using appropriate method of course. Do I understand right that the garbage collector is used only for objects that are deleted by a commit. And this objects are…
awrow
  • 83
  • 6
2
votes
1 answer

lakeFS Docker build fails

I am trying to get started with a "local" data processing ecosystem which includes Presto, Spark, Hive. lakeFS and a few other. My docker-compose.yml looks like this: version: "3.5" services: lakefs: image: treeverse/lakefs:latest …
Eugene Goldberg
  • 14,286
  • 20
  • 94
  • 167
1
vote
1 answer

How to hard delete objects older than n-days in LakeFS?

How to find and hard delete objects older than n-days in LakeFS? Later it'll be a scheduled job.
awrow
  • 83
  • 6
0
votes
1 answer

How to run lakefs in goland?

I downloaded the source code of version 0.68.0 and imported it into goland. I found some functions are missing. E.g. I can't find the definition of function "HandlerFromMuxWithBaseURL" which is invoked at line 94 in pkg/api/serve.go. Can anyone help…
shenlang
  • 53
  • 1
  • 1
  • 6