Questions tagged [journaling]

66 questions
12
votes
2 answers

Cleanup of Mongo journal file

Is there a way to reset the journal file. Will it have any implications ? Right now i have a journal file of 2GB which is occupying lot of space in ec2.
Biscuit Coder
  • 477
  • 4
  • 12
10
votes
2 answers

Want to do an incremental backup for mongodb. Journaling? Oplog?

I want to daily backups for a single mongodb database, probably with mongodump. To not lose any data, I would like this to be incremental so if something goes wrong in the middle of the day, I need to be able to replay changes for that day up til…
Alex Lopatin
  • 965
  • 2
  • 7
  • 8
10
votes
1 answer

Accessing ext3 / ext4 journals

ext3 and ext4 file systems have journaling. Is there any chance there's some API to get details or events about files? Some kind of API that will allow a user space program to access journal entries for files. Or even journal events, like "file x…
Gaurav Mahajan
  • 103
  • 1
  • 5
9
votes
1 answer

function to check if SQLite is using journal_mode=WAL or journal_mode=DELETE

I was looking for function which would help me to see which journaling mode is enabled.. I looked here too list of function There was function to check database status sqlite3_db_status(....) but status parameter didn't have option for check…
Sumit Murari
  • 1,597
  • 3
  • 28
  • 43
9
votes
1 answer

How does MongoDB journaling work

Here is my view, and I am not sure if it is right or wrong: The journaling log is the "redo" log. It records the modification of the data files. For example, I want to change the field value of one record from 'a' to 'b', then the mongodb will find…
iammutex
  • 91
  • 1
  • 2
7
votes
1 answer

MySQL transaction journaling

I am working on a project for which we are required to use "transaction journaling" in our DBMS (MySQL). We have already switched to using InnoDB in order to use transactions for another requirement. I am trying to understand what transaction…
alfredough
  • 385
  • 2
  • 4
  • 10
6
votes
1 answer

Android filesystem journaling

ext3 has 3 journaling options: journal, ordered, and writeback. According to the wikipedia entry, these range from least risky to most risky for crash recovery. For some reason, Android's version of Linux only supports the latter two options, and…
Ravi
  • 3,718
  • 7
  • 39
  • 57
6
votes
1 answer

Mongo - What does WriteConcern j option do when journaling is turned off?

The documentation is not clear on what happens when the Write Concern j Option is set to true and mongod is running without a journal. Does this indicate that the write operation will return after it has been acknowledged to have been committed to…
Suraj
  • 35,905
  • 47
  • 139
  • 250
5
votes
1 answer

MongoDB Write and lock processes

I've been read a lot about MongoDB recently, but one topic I can't find any clear material on, is how data is written to the journal and oplog. So this is what I understand of the process so far, please correct me where I'm wrong A client connect…
user1678745
4
votes
0 answers

Which OS support an efficient file system write barrier?

Do file system or disk drivers support a concept of file system modification fence, like a memory fence in the CPU or shared memory system? A fence is an instruction that separate memory operations such that globally visible memory accesses after…
curiousguy
  • 8,038
  • 2
  • 40
  • 58
4
votes
1 answer

Process similar to filesystem journaling or fault-tolerant logging to manage tasks?

Developing a c# application that will be running a series of tasks based on files the user uploads; this can take from a few seconds to a few days. I plan to implement some kind of logging system to resume work if the process gets interrupted. What…
BurnsBA
  • 4,347
  • 27
  • 39
3
votes
0 answers

Journal/write-ahead-log technology for Java

We're building a Java based application that makes use of a journal/write-ahead-log (WAL). The idea is that every message that enters the system is first written into the journal before any processing. The journal acts as a single source of truth…
David Siro
  • 1,826
  • 14
  • 33
3
votes
1 answer

Understanding shadow paging and how it differs from journaling file systems

I am trying get a good grasp of shadow paging in unix-like file systems; something that you might see in ZFS or WAFL. It seems that in shadow paging, when one wants to make changes to a page, a different page or "shadow page" is written to. Upon…
peachykeen
  • 4,143
  • 4
  • 30
  • 49
3
votes
1 answer

Disabling journaling for read-only ext4 fs

If journaling is disabled for a read-only ext4 fs can there be any possible side effects? I see an opportunity of saving precious storage quota by doing so.
sob
  • 982
  • 11
  • 31
3
votes
1 answer

Can individual entry in NTFS USN Journal be deleted?

Lets say NTFS's journalling is enabled but I dont want some of my file's change records to be added in the journal. Is this possible? and if not, Is there any way that even if the change related to a particular file is added into the USN journal, I…
awatan
  • 1,182
  • 15
  • 33
1
2 3 4 5