Chronicle Queue is a persisted low-latency messaging framework for high performance and critical applications.
Resources
Questions tagged [chronicle-queue]
172 questions
4
votes
1 answer
Chronicle queue hard power failure recovery
When writing to Chronicle Queue, the default write doesn't flush to disk, so I believe anything that is in the linux kernel dirty page cache is lost. What's the best approach to get guaranteed recovery in the event of power failure? Would a…
R. Andrews
- 105
- 1
- 5
4
votes
1 answer
Chronicle V4 - is concurrent write on same Chronicle queue safe
I am planning to use chronicle 4 (SingleChronicleQueue) for IPC .
I was using chronicle 3 previous (IndexedQueue ) and it was not thread safe and I used to create multiple queues per thread but i was told by some one by using SingleChronicleQueue i…
user3887600
- 138
- 1
- 8
3
votes
1 answer
How to manage data consistency with Chronicle queue
We have been building a bunch of micro services using Apache Kafka as a messaging bus to communicate between them. Some micro services also interact with a database or a JMS message broker (IBMM MQ) or both.
We had lots of problems caused by the…
Julian
- 3,678
- 7
- 40
- 72
3
votes
1 answer
Queries for chronical queues when used as audit log
I am evaluating option of using chronicle-queues for storing the audit events and relaying events.
Application should have functionality to replay data from any random point with in a given file, and read relevant data and close he trailer…
RGoyal
- 165
- 3
- 16
3
votes
0 answers
Journal/write-ahead-log technology for Java
We're building a Java based application that makes use of a journal/write-ahead-log (WAL). The idea is that every message that enters the system is first written into the journal before any processing. The journal acts as a single source of truth…
David Siro
- 1,826
- 14
- 33
3
votes
1 answer
Chronicle Queue - Recieve last index of cycle
I am trying to use chronicle queue to determine the last index of the current cycle.
I will use the start index and the last index to do a final check before deleting the single cq4 for the cycle.
I would like to be able to find the last index of a…
InspectorNel
- 47
- 5
3
votes
2 answers
Chronicle queue size determination
If we need to limit total size of chronicle queue to let say 1GB or 10GB. What would be the best way to do it ?
We store buffers as bytes so I was trying to calculate total size just by summing buffer sizes but looks like there is no easy way to…
Chandra
- 43
- 4
3
votes
1 answer
Reading byte[] chronicle queue
I am trying to write a byte array that I know the size of to the array however I am not able to parse the resultant data.
I am using the following code:
okAppender.writeBytes(b -> b.write(byteData));
and
byte[] byteData = new…
user
- 158
- 6
- 19
3
votes
1 answer
Chronicle queue on maven central
I've found chronicle-queue version on maven central is quite old: 4.5.27, while 4.6.23 is most recent released on github. Does it mean 4.5.27 is a kind of "prod-ready", while all 4.5.27+ are experimental? Or you use other repositories for…
BegemoT
- 3,776
- 1
- 24
- 30
3
votes
1 answer
Does Chronicle queue ever delete files?
I am using Chronicle Queue 4.5.15 in one of my apps running on several Linux hosts. Each instance of the app had its own chronicle queue which usually stores several million strings.
Recently i have noticed queue files on each instance vanishing.…
sam
- 2,469
- 8
- 37
- 57
3
votes
1 answer
Chronicle Queue: blockSize, index count and size guidance
The ChronicleQueueBuilder interface (4.5) allows parameterisation of the queue file characteristics. By default I get 80mb files for daily rollover.
Is there any guidance how one should use these values?
What are the trade-offs? Can I optimize it…
vasquez
- 583
- 5
- 18
3
votes
1 answer
Chronicle queue events listener
1) In chronicle queue v4 most test patterns show some form of DocumentContext.isPresent() busy state checking, when ExcerptTailer is positioned at the end of the queue and code is waiting for new entries to arrive from ExcerptAppender.
2) Is there a…
Andrei Pozolotin
- 897
- 3
- 14
- 21
2
votes
1 answer
Chronicle Queue: Client id file not present
I'm experimenting with running chronicle queue inside docker containers. Why do I get the following error only when running in a container, and not when running directly on host?
What is this .chronicle.analytics.client.id file used for?
Client id…
ccnlui
- 91
- 5
2
votes
1 answer
Chronicle Queue: How to read excepts/documents with different WireKey?
Assume a chronicle queue, and a producer that writes 2 types of messages into the queue.
Each type of message is written with a different "WireKey".
// Writes: {key1: TestMessage}
appender.writeDocument(w -> w.write("key1").text("TestMessage"));
//…
ccnlui
- 91
- 5
2
votes
1 answer
Can you read/write a Chronicle Queue from C#?
Is there any reasonable way to read or write to a Chronicle Queue from a C# application? It runs on Mono on Linux if that matters.
Andrew
- 1,031
- 10
- 24