Ticket #727 (new defect)

Opened 2 years ago

Last modified 2 years ago

Another syslog newline issue.

Reported by: mpulczynski Assigned to: jan
Priority: high Milestone:
Component: mod_accesslog Version: 1.4.x-svn
Severity: trivial Keywords: syslog newline
Cc: Blocking:
Need Feedback:

Description

What

When writing logs to syslog under high load (constantly 200req/s) its very often that log lines aren't split (are send as one). If I dont use syslog, everthing works fine.

Fixing tries

Maybe its something related to antother newline bugs? Or its a kind of buffer-flushing bug? Applying/hacking around #481 doesn't help.

Versions, environment

  • 1.4.8
  • 1.4.x-svn versions
  • max-worker=16 setting (number of lighttpd processes).

Example

Here is an example line (yes, its one line, first date is by syslog-ng, next dates are sent by lighttpd, additional two minuses signs, are our X-LIGHTTPD headers, omitting it doesnt help) 

Jun 27 23:59:59 s_dgram@nw12.EXAMPLE.COM lighttpd[3570]: 192.168.2.108 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /sfs0/194/183/gallery-1292973-500x500.jpg HTTP/1.1" 200 33932 "http://w8.EXAMPLE.COM/gallery/10978/6/" "Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4" - - 192.168.1.113 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /sfs75/119/70/gallery-3784431-150x150.jpg HTTP/1.0" 200 4902 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; pl-PL; rv:1.7.8) Gecko/20050511 Firefox/1.0.4" - - 192.168.1.107 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /sfs75/146/40/gallery-3960380-150x150.jpg HTTP/1.0" 304 0 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 2.0.50727)" - - 192.168.1.107 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /sfs75/60/244/gallery-4013040-150x150.jpg HTTP/1.0" 200 8862 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)" - - 192.168.1.105 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /sfs75/190/71/gallery-3742604-150x150.jpg HTTP/1.0" 304 0 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)" - - 192.168.1.106 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /sfs75/126/76/gallery-3731602-150x150.jpg HTTP/1.0" 200 4485 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)" - - 192.168.1.113 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /sfs75/138/130/gallery-3865250-150x150.jpg HTTP/1.0" 200 4860 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; Neostrada Plus 5.6)" - - 192.168.1.106 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /sfs75/80/100/avatar-86414.gif HTTP/1.0" 304 0 "http://w8.EXAMPLE.COM/comm/fl/" "Mozilla/4.0 (compatible; MSIE 5.0; Windows 98; DigExt; cw-mep2000-retail)" - - 192.168.1.113 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /sfs75/190/140/gallery-3584630-150x150.jpg HTTP/1.0" 200 5987 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)" - - 192.168.1.111 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /sfs75/229/180/gallery-3556190-150x150.jpg HTTP/1.0" 304 0 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1; .NET CLR 1.1.4322)" - - 192.168.1.113 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /sfs75/15/156/gallery-3357247-150x150.jpg HTTP/1.0" 200 7701 "-" "Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4" - - 192.168.1.108 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /s/ico/arr.gif HTTP/1.1" 200 363 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; pl) Opera 8.50" - - 192.168.1.113 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /sfs75/221/158/avatar-1415340.gif HTTP/1.0" 200 2524 "http://w8.EXAMPLE.COM/comm/fl/435360/3/0/2006-02-11%2019:57:54.013311/1/" "Mozilla/5.0 (Windows; U; Windows NT 5.1; pl; rv:1.8.0.4) Gecko/20060508 Firefox/1.5.0.4" - - 192.168.1.108 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /sfs75/53/135/avatar-3939843.gif HTTP/1.1" 200 2984 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; pl) Opera 8.50" - - 192.168.1.108 w8.EXAMPLE.COM - [27/Jun/2006:23:59:59 +0200] "GET /s/js/ac/builder.js HTTP/1.1" 200 3361 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; SV1)" - -

Attachments

Change History

06/28/2006 02:00:54 PM changed by mpulczynski

Funniest thing is I am filtering logs using regexes to not include statics, eg 

accesslog.use-syslog = "disable"
$HTTP["url"] !~ "\.(jpg|gif|png|jpeg|css|swf)$" {
   accesslog.use-syslog = "enable"
}

which works fine when I am not using syslog, but, as seen in an example in ticket, doesnt work for syslog.

Add/Change #727 (Another syslog newline issue.)




Change Properties