Questions tagged [durability]

Many databases implement durability by writing all transactions into a transaction log that can be played back to recreate the system state right before a failure. A transaction can only be deemed committed after it is safely in the log.

45 questions
24
votes
2 answers

99.99% durability. What does it mean?

Amazon S3 offers two plans: Storage (Designed for 99.999999999% Durability) and Reduced Redundancy Storage (Designed for 99.99% Durability) Designed to provide 99.999999999% durability and 99.99% availability of objects over a given…
The Surrican
  • 29,118
  • 24
  • 122
  • 168
14
votes
4 answers

On-premises replacement for Azure Blob Storage or Amazon S3 (flat file storage)?

What's a suitable durable storage replacement for Azure Blob Storage (and Amazon S3) for on-premise installations that are disconnected from the public internet? The development environment is C# - if it matters. Losing live geo-replication is fine…
DeepSpace101
  • 13,110
  • 9
  • 77
  • 127
11
votes
1 answer

Atomic counter - redis vs postgres or other?

I need an implementation of an Atomic Counter on cloud to produce a serial integer from concurrent connections. The business behind is a tracking server. Requirements by priority: (MUST) Durable - be sure that once a clients gets a number, no other…
naviram
  • 1,445
  • 1
  • 15
  • 26
10
votes
2 answers

What does it take to be durable on Linux?

I'm writing some software to deal with pretty critical data, and need to know what exactly I need to do to achieve durability. Everywhere I look is contradictory information, so I'd appreciate any insight. There are three ways I write to…
Max
  • 2,760
  • 1
  • 28
  • 47
9
votes
4 answers

REDIS Durability ? how to auto expire data?

I use REDIS to store data (string) . ex: key "s1" store value "hello world". key "s2" store value "bye bye". I want s1 auto expire (free memory) after 5 minutes but s2 never expire. I use C#, .net 4.0 >> how to code ?. thanks
skidrow406
  • 93
  • 1
  • 1
  • 5
9
votes
1 answer

How does MongoDB journaling work

Here is my view, and I am not sure if it is right or wrong: The journaling log is the "redo" log. It records the modification of the data files. For example, I want to change the field value of one record from 'a' to 'b', then the mongodb will find…
iammutex
  • 91
  • 1
  • 2
7
votes
4 answers

How to create the fastest possible database on a SQL Server 2012 cluster, sacrificing any durability

I have a test suite that runs against a database in a SQL Server 2012 cluster. I want this test suite to run as fast as possible. I'm willing to sacrifice every durability and availability guarantee for performance. The database is recreated during…
molf
  • 73,644
  • 13
  • 135
  • 118
6
votes
2 answers

How to avoid data loss on server failure with MongoDB on a single machine?

I have read that mongoDB don't write data to disk right away, it does this periodically. Any thoughts on how to deal with this?
HappyDeveloper
  • 12,480
  • 22
  • 82
  • 117
6
votes
2 answers

Cassandra is configured to lose 10 seconds of data by default?

As the data in the Commitlog is flushed to the disk periodically after every 10 seconds by default (controlled by commitlog_sync_period_in_ms), so if all replicas crash within 10 seconds, will I lose all that data? Does it mean that, theoretically,…
Aliaksandr Kazlou
  • 3,221
  • 6
  • 28
  • 34
4
votes
3 answers

Handling durability requirements failure in Couchbase

Recently I've started investigating Couchbase Server as a candidate for the project. A particular scenario I'm looking at right now is to how to make Couchbase acting as a "source of truth" which is why I'm digging into the durability aspect. So…
Kiryl
  • 1,416
  • 9
  • 21
4
votes
0 answers

Couchbase high durability

I want to design a banking system using couchbase , and I need high durability (like RDBMS) , How can I achieve 100% durability and not bit of data loss? I know I can use persist_to and replicate_to for durability bucket.insert(id, data, {…
WebMaster
  • 3,050
  • 4
  • 25
  • 77
3
votes
3 answers

What method offered to guarantee data durability in Redis?

I checked Redis and I am curious how the database (which stores all data in volatile memory) offer data durability on system crash situation.
eonil
  • 83,476
  • 81
  • 317
  • 516
2
votes
3 answers

Does a typical ACID RDBMS sync to disk every commit?

The 'D' in ACID means "Durability" which is defined by Wikipedia as: "every committed transaction is protected against power loss/crash/errors and cannot be lost by the system and can thus be guaranteed to be completed". However, this would mean…
Tim Cooper
  • 10,023
  • 5
  • 61
  • 77
2
votes
1 answer

Database durability vs performance

I have studied a lot how durability is achieved in databases and if I understand well it works like this (simplified): Clent's point of view: start transaction. insert into table values... commit transaction DB engine point of view: write…
Kamil_H
  • 21
  • 1
2
votes
1 answer

Durability Problem with ActiveMQ-cpp and stomp

I have a problem creating durable consumers and producers with ActiveMQ-CPP and stomp protocol. I am trying to connect to HornetQ using stomp, and capable of sending and receiving messages in non-durable state. I tried changing the producer to…
Sami
  • 1,369
  • 14
  • 35
1
2 3