Questions tagged [syslog-ng]

The syslog-ng application is a flexible and highly scalable system logging application that is ideal for creating centralized and trusted logging solutions.

The syslog-ng application is a flexible and highly scalable system logging application that is ideal for creating centralized and trusted logging solutions. The main features of syslog-ng are summarized below.

  • Reliable log transfer: The syslog-ng application enables you to send the log messages of your hosts to remote servers using the latest protocol standards. The logs of different servers can be collected and stored centrally on dedicated log servers. Transferring log messages using the TCP protocol ensures that no messages are lost.
  • Secure logging using TLS: Log messages may contain sensitive information that should not be accessed by third parties. Therefore, syslog-ng supports the Transport Layer Security (TLS) protocol to encrypt the communication. TLS also allows the mutual authentication of the host and the server using X.509 certificates.
  • Direct database access: Storing your log messages in a database allows you to easily search and query the messages and interoperate with log analyzing applications. The syslog-ng application supports the following databases: MSSQL, MySQL, Oracle, PostgreSQL, and SQLite.
  • Heterogeneous environments: The syslog-ng application is the ideal choice to collect logs in massively heterogeneous environments using several different operating systems and hardware platforms, including Linux, Unix, BSD, Sun Solaris, HP-UX, Tru64, and AIX.
  • Filter and classify: The syslog-ng application can sort the incoming log messages based on their content and various parameters like the source host, application, and priority. Directories, files, and database tables can be created dynamically using macros. Complex filtering using regular expressions and boolean operators offers almost unlimited flexibility to forward only the important log messages to the selected destinations.
  • Parse and rewrite: The syslog-ng application can segment log messages to named fields or columns, and also modify the values of these fields.
  • IPv4 and IPv6 support: The syslog-ng application can operate in both IPv4 and IPv6 network environments; it can receive and send messages to both types of networks.
275 questions
34
votes
1 answer

Python logging.DEBUG level doesn't logging

I have a problem with python's logging lib. With the code below I create a "logger": logger = logging.getLogger() def logger_init(level): try: syslog = SysLogHandler(address=LOG_DESTINATION) except Exception, ex: return …
0xmtn
  • 2,625
  • 5
  • 27
  • 53
23
votes
2 answers

Confused with syslog message format

I am a bit confused about syslog message format. I have to write a program that parses syslog messages. When I read what I get in my syslog-ng instance I get messages like this: Jan 12 06:30:00 1.2.3.4 apache_server: 1.2.3.4 - -…
qwix
  • 251
  • 1
  • 2
  • 3
8
votes
4 answers

How to let syslog workable in docker?

My application will send out syslog local0 messages. When I move my application into docker, I found it is difficult to show the syslog. I've tried to run docker as --log-dirver as syslog or journald, both works strange, the /var/log/local0.log show…
Daniel YC Lin
  • 15,050
  • 18
  • 63
  • 96
6
votes
1 answer

Severity level on docker logging to syslog

I have a syslog-ng container that collects logs from other containers running on the same application, and normal logging works as intended: every container send its logs and syslog-ng saves them on separate files, as defined in syslog-ng.conf. I'm…
6
votes
1 answer

How to set source host address in Python Logging?

There is a script, written in Python, which parse sensors data and events from number of servers by IPMI. Then it sends graph data to one server and error logs to the other. Logging server is Syslog-ng+Mysql So the task is to store logs by owner,…
Bulkin
  • 1,020
  • 12
  • 27
5
votes
1 answer

Using Apache Kafka for log aggregation

I am learning Apache Kafka from their quickstart tutorial: http://kafka.apache.org/documentation.html#quickstart. Upto now, I have done the setup as follows. A producer node, where a web server is running at port 8888. A Kafka server(broker),…
5
votes
2 answers

Syslog-ng connecting to mysql

I would like to log files from a switch to a mysql database. I am using syslog-ng and in the configuration file, i have done the following amendments filter f_no_debug { not level(debug); }; destination d_mysql…
sosytee
  • 1,257
  • 2
  • 11
  • 14
5
votes
1 answer

Syslog-ng log template \\011 character

I have a problem with syslog-ng. I want to make syslog-ng to format the logs like below: template("$YEAR-$MONTH-$DAY\\011$HOUR:$MIN:$SEC\\011$HOST\\011$MSGHDR$MSGONLY\n") But it logs without the "\". Just "011". Example: Expected: …
0xmtn
  • 2,625
  • 5
  • 27
  • 53
4
votes
2 answers

syslog-ng multiple destinations

We are using syslog-ng to send access-log file to remote servers via tcp. And I already know that multiple destination can be configured to do this job, just like: source s_xxx { file("/xxx/access.log"); }; destination d_one {tcp("1.2.3.4",…
CobbLiu
  • 447
  • 1
  • 7
  • 10
4
votes
1 answer

Bind9 logging to named pipe

The Goal I'm wanting to configure bind9 on Ubuntu 12.04 to log out to a named pipe. The purpose is to redirect logging to the syslog-ng service. The Problem My problem is that when I direct the logging channel to the named pipe file, the bind…
jiwanrai
  • 411
  • 4
  • 5
3
votes
1 answer

logging with syslog-ng and systemd

I have spent lot of time to figure this one out, but no success. I'm fairly new to Linux application management and logging. Problem: Not able to log data to /var/log/messages when starting syslog-ng using systemd. But when syslog-ng is started from…
hteejus
  • 51
  • 2
  • 5
3
votes
0 answers

syslog-ng wrong date with tls

I have configured my syslog-ng server to receive logs in udp, tcp and tls. No problems for plain udp and tcp but with tls I get a wrong date in the syslog header. I created a self signed certificate with an unprotected private key (as stated here)…
Miso Mijatovic
  • 357
  • 3
  • 7
3
votes
4 answers

nginx logs to redis to logstash

I want send nginx log files(on one server) to redis(on 2nd server) in order to process it later using logstash(on 3rd server), but I am kinda lost I am using redis as buffer not to lose any data in case logstash server gone down for maintenance or…
3
votes
1 answer

Python logging: disable output to stdout

I'm trying to make a program use only the SysLogHandler instance for logging and no other handlers. I expect it to not log to any files or stdout. self.logger = logging.getLogger(self.name) syslog_handler = logging.handlers.SysLogHandler( …
Igor
  • 2,834
  • 2
  • 26
  • 44
3
votes
1 answer

how to increase log message size to more than 8K in syslog-ng

Syslog-ng seems to only allow up to 8192 bytes of log_msg_size and after which it splits up the log message into multiple log messages. Setting this up in the global options or on the source option to use more than 8192 does not seem to work. I was…
EDJ
  • 475
  • 1
  • 7
  • 16
1
2 3
18 19