Stack Overflow
Stack Overflow

Questions tagged [mesosphere]

Mesosphere (now D2iq) was a company that productized Apache Mesos, the Marathon scheduler, and other applications to support Mesos applications and infrastructure inside their DCOS software.

Mesosphere (now D2iQ) provided the Datacenter Operating System (DCOS), a distributed OS with Apache Mesos as its kernel. DCOS allowed combining individual Linux machines into a single pool of shared resources running a variety of workloads, from batch (Chronos, MapReduce, etc.) over stream processing (Spark, Storm) to PaaS-level (Marathon). In addition, (distributed) storage services incl. HDFS, Cassandra, ArangoDB, Elasticsearch and Quobyte were applications supported on DCOS.

See the official website for more details.

445 questions
423
votes
7 answers

What's the difference between Apache's Mesos and Google's Kubernetes

What exactly is the difference between Apache's Mesos and Google's Kubernetes? I understand both are server cluster management software. Can anyone elaborate where the main differences are - when would which framework be preferred? Why would you…
binaryanomaly
  • 4,712
  • 4
  • 15
  • 22
159
votes
4 answers

Docker-Swarm, Kubernetes, Mesos & Core-OS Fleet

I am relatively new to all these, but I'm having troubles getting a clear picture among the listed technologies. Though, all of these try to solve different problems, but do have things in common too. I would like to understand what are the things…
B_B
  • 2,013
  • 3
  • 14
  • 13
49
votes
4 answers

Marathon vs Aurora and their purposes

Both Marathon and Aurora are built on Mesos and supposedly are engineered for running long running services. My questions are: What are their differences? I have struggled in finding any good explanations regarding their key differences Do these…
user1340582
  • 19,151
  • 35
  • 115
  • 171
35
votes
1 answer

Persistent storage for Apache Mesos

Recently I've discovered such a thing as a Apache Mesos. It all looks amazingly in all that demos and examples. I could easily imagine how one would run for stateless jobs - that fits to the whole idea naturally. Bot how to deal with long running…
Carlos Castellanos
  • 2,358
  • 4
  • 25
  • 43
24
votes
5 answers

What's difference between Apache Mesos, Mesosphere and DCOS?

Looks to me that Apache Mesos is a distributed systems kernel, and Mesosphere is something Linux distribution based on Apache Mesos. For example, its like Linux Kernel(Apache Mesos) and Ubuntu(Mesosphere). Am I right about this? and DCOS is a free…
Sato
  • 8,192
  • 17
  • 60
  • 115
22
votes
1 answer

What does Apache Mesos do that Kubernetes can't do and vice-versa?

What does Apache Mesos do that Kubernetes can't do or vice-versa? Mesos is a Two level scheduler. Sure it grabs resource information from every machine and gives it to the top level scheduler such that frameworks like kubernetes can use to schedule…
user1870400
  • 6,028
  • 13
  • 54
  • 115
17
votes
1 answer

Can Mesos 'master' and 'slave' nodes be deployed on the same machines?

Can Apache Mesos 'master' nodes be co-located on the same machine as Mesos 'slave' nodes? Similarly (for high-availability (HA) deploys), can the Apache Zookeeper nodes used in Mesos 'master' election be deployed on the same machines as Mesos…
Ethan
  • 9,558
  • 5
  • 27
  • 24
12
votes
2 answers

What is the difference between Docker Swarm and Kubernetes/Mesophere?

From what I understand, Kubernetes/Mesosphere is a cluster manager and Docker Swarm is an orchestration tool. I am trying to understand how they are different? Is Docker Swarm analogous to the POSIX API in the Docker world while…
Debnath Sinha
  • 1,087
  • 1
  • 12
  • 25
11
votes
1 answer

Spark shell connect to Mesos hangs: No credentials provided. Attempting to register without authentication

I installed Mesos in an OpenStack environment using these instructions from Mesosphere: https://open.mesosphere.com/getting-started/datacenter/install/. I ran the verification test as described and it was successful. UI for both Mesos and Marathon…
tww
  • 111
  • 1
  • 4
11
votes
1 answer

mesos-dns, best practice for working with ports

I am quite new to Service Discovery and clustered systems. I started experimenting with Mesos and Marathon for the deployment of Docker containers, the Marathon REST API and UI seem to do a good job. My problem is the actual discovery of deployed…
ummecasino
  • 347
  • 1
  • 11
10
votes
4 answers

How to pre-package external libraries when using Spark on a Mesos cluster

According to the Spark on Mesos docs one needs to set the spark.executor.uri pointing to a Spark distribution: val conf = new SparkConf() .setMaster("mesos://HOST:5050") .setAppName("My app") .set("spark.executor.uri", "
Tobi
  • 31,405
  • 8
  • 58
  • 90
10
votes
4 answers

How to use volumes-from in marathon

I'm working with mesos + marathon + docker quite a while but I got stuck at some point. At the moment I try to deal with persistent container and I tried to play around with the "volumes-from" parameter but I can't make it work because I have no…
hammi
  • 161
  • 1
  • 8
9
votes
5 answers

Accessing HDFS HA from spark job (UnknownHostException error)

I have Apache Mesos 0.22.1 cluster (3 masters & 5 slaves), running Cloudera HDFS (2.5.0-cdh5.3.1) in HA configuration and Spark 1.5.1 framework. When I try to spark-submit compiled HdfsTest.scala example app (from Spark 1.5.1 sources) - it fails…
kyarovoy
  • 163
  • 1
  • 1
  • 9
8
votes
2 answers

Mesos cluster fails to elect master when using replicated_log

Test environment: multi-node mesos 0.27.2 cluster on AWS (3 x masters, 2 x slaves, quorum=2). Tested persistence with zkCli.sh and it works fine. If i start the masters with --registry=in_memory, it works fine, master is elected, i can start tasks…
mitelone
  • 341
  • 1
  • 10
7
votes
2 answers

Setting up Mesos with Ansible on Ubuntu 14.04 on Digital Ocean

I have been following this tutorial How to configure a production ready Mesos cluster and have been creating an ansible playbook along the way which you can see here mesos ansible playbook Ansible runs successfully and I can visit my port 5050 on a…
Mark
  • 3,137
  • 4
  • 39
  • 76
1
2 3
…
29 30