Stack Overflow
Stack Overflow

Questions tagged [ceph]

Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability.

Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability. Ceph is an project primarily developed by Inktank (a spin-off of , now acquired by .

External Links:

605 questions
42
votes
4 answers

Distributed File Systems: GridFS vs. GlusterFS vs Ceph vs HekaFS Benchmarks

I am currently searching for a good distributed file system. It should: be open-source be horizontally scalable (replication and sharding) have no single point of failure have a relatively small footprint Here are the four most promising…
Alp
  • 29,274
  • 27
  • 120
  • 198
26
votes
2 answers

ImportError: module 'setuptools.dist' has no 'check_specifier' attribute

Ceph teuthology installation fails with following error on Ubuntu 14.04, kernel 4.4.0-51-generic: ImportError: has no 'check_specifier' attribute
Vishal K
  • 1,164
  • 1
  • 10
  • 21
14
votes
3 answers

How could WAL （write ahead log） have better performance than write directly to disk?

The WAL (Write-Ahead Log) technology has been used in many systems. The mechanism of a WAL is that when a client writes data, the system does two things: Write a log to disk and return to the client Write the data to disk, cache or memory…
Kramer Li
  • 2,284
  • 5
  • 27
  • 55
14
votes
5 answers

Removing pool 'mon_allow_pool_delete config option to true before you can destroy a pool1_U (500)

I'm running proxmox and I try to remove a pool which I created wrong. However it keeps giving this error: mon_command failed - pool deletion is disabled; you must first set the mon_allow_pool_delete config option to true before you can destroy a…
Florius
  • 367
  • 1
  • 5
  • 17
14
votes
2 answers

Ceph too many pgs per osd: all you need to know

I am getting both of these errors at the same time. I can't decrease the pg count and I can't add more storage. This is a new cluster, and I got these warning when I uploaded about 40GB to it. I guess because radosgw created a bunch of pools. How…
b0bu
  • 1,062
  • 1
  • 9
  • 24
12
votes
2 answers

Ceph: too many PGs per OSD

I configured Ceph with the recommended values (using a formula from the docs). I have 3 OSDs, and my config (which I've put on the monitor node and all 3 OSDs) includes this: osd pool default size = 2 osd pool default min size = 1 osd pool default…
Turtle V. Rabbit
  • 313
  • 1
  • 3
  • 8
8
votes
2 answers

Configure a cluster network with Cephadm?

I configured a simple Ceph cluster with cephadm, like this: cephadm bootstrap --mon-ip 192.168.0.4 ssh-copy-id -f -i /etc/ceph/ceph.pub root@host2 ssh-copy-id -f -i /etc/ceph/ceph.pub root@host3 ceph orch host add host2 ceph orch host add host3 ceph…
Ian Levesque
  • 315
  • 2
  • 10
8
votes
1 answer

Ceph Bluestore checksums: What's the word on bitrot?

I'm getting ready to setup my first Ceph cluster (Luminous on Fedora) for production use, and thus far I've gone through the process of running a single OSD per node on a large ZFS pool so I have checksum-on-read bitrot protection with automatic…
Mike Cronce
  • 345
  • 2
  • 10
7
votes
0 answers

pvc get stuck in pending waiting for a volume to be created, either by external provisioner "rook-ceph.rbd.csi.ceph.com" or manually

I use rook to build a ceph cluster.But my pvc get stuck in pending. When I used kubectl describe pvc, I found events from persistentvolume-controller: waiting for a volume to be created, either by external provisioner "rook-ceph.rbd.csi.ceph.com" or…
Jesse Stutler
  • 147
  • 2
  • 7
7
votes
2 answers

GlusterFS or Ceph as backend for Hadoop

Has anyone tried to use GlusterFS or Ceph as the backend for Hadoop? I am not talking about just use plugin to sew things up. Is the performance better than HDFS itself? whether it's ok for production usage. Also, Is it a really good idea to merge…
Shengjie
  • 12,336
  • 29
  • 98
  • 139
7
votes
1 answer

The optimum size of objects in Ceph Object Storage (RADOS)

It looks like that RADOS is best suited to be used as the storage backend for Ceph Block Storage and File System. But if i want to use the Object Storage itself: Is there an optimum object size which gives the best performance? Is there a problem…
Ali
  • 931
  • 10
  • 22
6
votes
1 answer

Ceph CSI (rbd.csi.ceph.com) vs Ceph RBD (kubernetes.io/rbd)

I'm using kubernetes v1.16.10 with a Ceph 13.2.2 Mimic cluster for dynamic volume provisioning through ceph-csi. But then I have found ceph-rbd Ceph RBD…
jisnardo
  • 111
  • 1
  • 3
6
votes
2 answers

Ceph: How to place a pool on specific OSD?

I have a Ceph cluster of 66 OSD with a data_pool and a metadata_pool. I would like to place the metadata_pool on 3 specific OSD which are having SSDs, since all other 63 OSD having older disks. How can I force Ceph to place the metadata_pool on…
Vincent H
  • 85
  • 1
  • 8
6
votes
1 answer

Kubernetes pod never gets ready

I am setting up a small Kubernetes cluster using a VM (master) and 3 bare metal servers (all running Ubuntu 14.04). I followed the Kubernetes install tutorial for Ubuntu. Each bare metal server also has 2T of disk space exported using Ceph 0.94.5.…
dilvan
  • 2,109
  • 2
  • 20
  • 32
5
votes
2 answers

Kubernetes dial tcp myIP:10250: connect: no route to host

I got Kubernetes Cluster with 1 master and 3 workers nodes. calico v3.7.3 kubernetes v1.16.0 installed via kubespray https://github.com/kubernetes-sigs/kubespray Before that, I normally deployed all the pods without any problems. I can't start a few…
cryptoparty
  • 345
  • 1
  • 5
  • 20
1
2 3
…
40 41