When to use Apache Helix and when to use Apache Mesos

Question

Apache Mesos is a cluster manager that provides efficient resource isolation and sharing across distributed applications, or frameworks. It can run Hadoop, MPI, Hypertable, Spark, and other frameworks on a dynamically shared pool of nodes.

Apache Helix is a generic cluster management framework used for the automatic management of partitioned, replicated and distributed resources hosted on a cluster of nodes. Helix automates reassignment of resources in the face of node failure and recovery, cluster expansion, and reconfiguration.

Both are cluster managers, which one to choose and why?

Sent this question to Apache mailing list. Maybe somebody involved in both of this projects explain the differences. — janisz, Mar 02 '17 at 15:03
[Here](https://engineering.linkedin.com/blog/2017/02/building-venice-with-apache-helix) is small overview of what is Hellix and how its used at LinkedIn — janisz, Mar 07 '17 at 12:38
WRT "abandoned"--last Helix update was in January: http://helix.apache.org/0.6.7-docs/releasenotes/release-0.6.7.html and the 0.71 beta is also out. (Full disclosure: LinkedIn employee, though I am not an engineer) — Stephen Lynch, Mar 07 '17 at 19:52

score 4 · Accepted Answer · edited May 23 '17 at 11:46

4

Here is what I wrote on Apache Helix vs YARN which is applicable to Mesos v/s Helix. YARN/Mesos and Helix are complementary to each other.

You use Helix to build your system and manage the internal state of your system. Once the system is built it can be either deployed independently or deployed using YARN/Mesos.

@janisz, Helix is widely used and actively developed.

edited May 23 '17 at 11:46

Community

1
1

answered Mar 09 '17 at 09:12

Kishore G

626
6
4

When to use Apache Helix and when to use Apache Mesos

1 Answers1