Does a Kappa Architecture use a data lake or not?

Question

Kukreja in “Data Engineering with Apache Spark, Delta Lake, and Lakehouse” says that a Kappa architecture has no data lake. Microsoft in https://learn.microsoft.com/en-us/azure/architecture/data-guide/big-data (see picture) mentions a “long term store” without saying what it actually is. It uses that data to “re-compute”. For me this is a data lake.

thebluephantom · Accepted Answer · 2022-07-21T23:13:03.070

1

No, it does not.

But others have a more realistic perception. It states recompute... Imagine a mistake has been made, handy to be able to correct. From the long term store.

edited Jul 21 '22 at 23:13

answered Jul 21 '22 at 21:57

thebluephantom

16,458
8
40
83

The "From the long term store" is a datalake? – Micky Jul 22 '22 at 05:06
Interesting point. I think not in this context as you know schema. Confusing for sure. – thebluephantom Jul 22 '22 at 05:35
What means "as you know schema"? – Micky Jul 29 '22 at 12:29
As you know the data format. I n schema on read you just dump data and work it out later. – thebluephantom Jul 29 '22 at 12:53

Does a Kappa Architecture use a data lake or not?

1 Answers1