Stack Overflow
Stack Overflow

Questions tagged [log-analysis]

Log-analysis is the process of parsing log file, created from any logging service or application.

126 questions
53
votes
6 answers

Is writing server log files to a database a good idea?

After reading an article about the subject from O'Reilly, I wanted to ask Stack Overflow for their thoughts on the matter.
Thomas Owens
  • 114,398
  • 98
  • 311
  • 431
23
votes
4 answers

nginx log analysis with goaccess

I want to parse and analyze the nginx logs with goaccess and take a report from the analyzed logs. But, when I run the zcat -f access.log.*.gz | goaccess -a -c command, it gives me the following error : GoAccess - version 0.5 - Jun 26 2012…
husnu
  • 303
  • 1
  • 4
  • 9
15
votes
2 answers

Which is best Postfix Log analyzer?

Which is best Postfix Log analyzer? We are looking for good log analyzer for postfix. We need to analyze the following How many mails queued ? How many mails not delivered ? Why mails are not delivered ? And is it possible to view the subject for…
Anto Binish Kaspar
  • 1,322
  • 1
  • 14
  • 20
10
votes
2 answers

Plot negative values in logarithmic scale with ggplot 2

I need to plot with ggplot2 package in R a graph with some negative values using an x logarithmic scale. For example I want to plot these points using an x logarithmic scale x <- c(-1,-10,-100) y <- c(1,2,3) I know that the logarithm of a negative…
Dalmo1991
  • 125
  • 1
  • 1
  • 9
8
votes
2 answers

How to display azure app service's web server log on Azure log Analytics?

I have an api application hosted on azure App services. For the web server log (iis logs) I've turned on web server logging from Azure portal. Look at the screenshot below. For storing web server logging Server Logs are allowed to be stored on the…
user1814131
  • 259
  • 4
  • 16
6
votes
3 answers

log analyze: finding lines by time difference

I have a long log file generated with log4j, 10 threads writing to log. I am looking for log analyzer tool that could find lines where user waited for a long time (i.e where the difference between log entries for the same thread is more than a…
lili
  • 1,866
  • 8
  • 29
  • 50
5
votes
1 answer

Does a Tool for the analyzation of JBoss log files exist?

I have a JBoss 6 Server running which generates a big log file. Does a tool exist, which allows me to analyse the log file (How often did a specific error occur? When did it occur? How many INFO / WARNING / ERROR messages are there, ...)? I've…
Martin Thoma
  • 124,992
  • 159
  • 614
  • 958
5
votes
3 answers

Glassfish log files analysis

Can I get some recommendations for good log analysis software for Glassfish log files? Since it will not vary from application server to application server dramatically, I guess that there is a common solution for all servers. Thanks
Cem
  • 51
  • 1
  • 2
4
votes
1 answer

Importing apache logs into piwik

I am in the process of switching my site analytics from GA to Piwik and would like to incorporate all the historic data that I can. I have already concatenated the full trail of apache log files I have in my possession. However, what I do next is…
DroidOS
  • 8,530
  • 16
  • 99
  • 171
4
votes
4 answers

How to do HTTP request logging as a means of troubleshooting login errors

I develop and maintain a paywalled publication with 2000+ users. The most common support request relates to log in. Most times these can be solved with a couple of support emails. Every once in a while though, there's that odd user that just can't…
oivvio
  • 3,026
  • 1
  • 34
  • 41
4
votes
4 answers

How to gather IP and User Agent info from web log with AWK?

I have a log file, containing text like: 66.249.74.18 - - [21/Apr/2013:05:55:33 +0000] 200 "GET /1.jpg HTTP/1.1" 7691 "-" "Googlebot-Image/1.0" "-" 220.181.108.96 - - [21/Apr/2013:05:55:33 +0000] 200 "GET /1.html HTTP/1.1" 17722 "-" "Mozilla/5.0…
yang
  • 508
  • 7
  • 17
3
votes
1 answer

How can I get awstats to read this log format?

I have a site with several subdomains, all subdomains are logged to the same access_log file. Since the file can be so huge, I have a script that greps out each subdomain into its own file. I have a custom log file format in Apache like…
RubyRedGrapefruit
  • 12,066
  • 16
  • 92
  • 193
3
votes
2 answers

How to analyse MySQL Slow Query Log or MySQL General Query Log?

Analysing logs is a major problem. If you have a legacy code and hundreds and thousands of queries running, you are bound to be confused by what to improve and where to improve and how much to improve because there is always a tradeoff between how…
MontyPython
  • 2,906
  • 11
  • 37
  • 58
3
votes
1 answer

Automatic log analysis and alert generation

I would like some design advice for a centralized logging project I am considering. I have a number of components producing logs on various servers. Apache Flume looks like the sensible choice for streaming to a central log server, most likely into…
MarkNS
  • 3,811
  • 2
  • 43
  • 60
3
votes
1 answer

Web Log analysis in Java

How to read a web server log file in Java. This file is getting updated all the time. If I open a new FileInputStream, will it read the log real time? Regards
vphomealone
  • 153
  • 1
  • 4
  • 7
1
2 3
…
8 9