Advanced
Mailing List Archive

Mailing List Archive

  1. Home >
  2. Analog>
  3. Help
Problem configuring Analog to read an AOLSERVER logfile that has had an additional field added.
ricky.hamilton at btopenworld
May 17, 2008, 5:22 PM
Post #1 of 5 (2676 views)
Permalink
Please can anyone explain to me what I am doing wrong here? Many Thanks.
Richard

Sample Logfile Lines

C: 83.128.227.45 - - [17/May/2006:08:36:22 +0100] "GET /favicon.ico
HTTP/1.1" 404 533 "" "Mozilla/5.0 (Windows; U; Windows NT 5.0; en-GB;
rv:1.7.12) Gecko/20050919 Firefox/1.0.7" -
C: 83.128.227.45 - - [17/May/2006:08:36:22 +0100] "GET /favicon.ico
HTTP/1.1" 404 533 "" "Mozilla/5.0 (Windows; U; Windows NT 5.0; en-GB;
rv:1.7.12) Gecko/20050919 Firefox/1.0.7" "user_id=01832"


Sample Logformats - All have been tried

LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r%wHTTP%j" %c %b "%f" "%B"
"%u")
LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r%wHTTP%j" %c %b "%f" "%B"
"%j")
LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r%wHTTP%j" %c %b "%f" "%B" %j)
LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r%wHTTP%j" %c %b "%f" "%B"
"user_id=%j")

LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r" %c %b "%f" "%B" "%u")
LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r" %c %b "%f" "%B" "%j")
LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r" %c %b "%f" "%B" %j)
LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r" %c %b "%f" "%B"
"user_id=%j")

LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%r" %c %b "%f" "%B" "%u")
LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%r" %c %b "%f" "%B" "%j")
LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%r" %c %b "%f" "%B" %j)
LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%r" %c %b "%f" "%B" "user_id=%j")


SAMPLE DEBUG RESULTS - The wrapping has spoiled this but it chokes on
the "user_id=x" field.

C: 81.178.217.75 - - [17/May/2006:08:36:22 +0100] "GET /favicon.ico
HTTP/1.1" 404 533 "" "Mozilla/5.0 (Windows; U; Windows NT 5.0; en-GB;
rv:1.7.12) Gecko/20050919 Firefox/1.0.7"
C:
*



+------------------------------------------------------------------------
| TO UNSUBSCRIBE from this list:
| http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs/mailing.html#listarchives
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+------------------------------------------------------------------------
Re: Problem configuring Analog to read an AOLSERVER logfile that has had an additional field added. [ In reply to ]
analog-author at lists
May 17, 2008, 9:46 PM
Post #2 of 5 (2575 views)
Permalink
I think the problem is that the line it's complaining about doesn't
have the user field. Maybe you have some lines with and some without
in your logfile?

--
Stephen Turner



2008/5/17 Richard Hamilton <ricky.hamilton@btopenworld.com>:
> Please can anyone explain to me what I am doing wrong here? Many Thanks.
> Richard
>
> Sample Logfile Lines
>
> C: 83.128.227.45 - - [17/May/2006:08:36:22 +0100] "GET /favicon.ico
> HTTP/1.1" 404 533 "" "Mozilla/5.0 (Windows; U; Windows NT 5.0; en-GB;
> rv:1.7.12) Gecko/20050919 Firefox/1.0.7" -
> C: 83.128.227.45 - - [17/May/2006:08:36:22 +0100] "GET /favicon.ico
> HTTP/1.1" 404 533 "" "Mozilla/5.0 (Windows; U; Windows NT 5.0; en-GB;
> rv:1.7.12) Gecko/20050919 Firefox/1.0.7" "user_id=01832"
>
>
> Sample Logformats - All have been tried
>
> LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r%wHTTP%j" %c %b "%f" "%B"
> "%u")
> LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r%wHTTP%j" %c %b "%f" "%B"
> "%j")
> LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r%wHTTP%j" %c %b "%f" "%B" %j)
> LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r%wHTTP%j" %c %b "%f" "%B"
> "user_id=%j")
>
> LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r" %c %b "%f" "%B" "%u")
> LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r" %c %b "%f" "%B" "%j")
> LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r" %c %b "%f" "%B" %j)
> LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%j%w%r" %c %b "%f" "%B"
> "user_id=%j")
>
> LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%r" %c %b "%f" "%B" "%u")
> LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%r" %c %b "%f" "%B" "%j")
> LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%r" %c %b "%f" "%B" %j)
> LOGFORMAT (%S %j %j [%d/%M/%Y:%h:%n:%j] "%r" %c %b "%f" "%B" "user_id=%j")
>
>
> SAMPLE DEBUG RESULTS - The wrapping has spoiled this but it chokes on the
> "user_id=x" field.
>
> C: 81.178.217.75 - - [17/May/2006:08:36:22 +0100] "GET /favicon.ico
> HTTP/1.1" 404 533 "" "Mozilla/5.0 (Windows; U; Windows NT 5.0; en-GB;
> rv:1.7.12) Gecko/20050919 Firefox/1.0.7"
> C:
>
> *
>
>
>
> +------------------------------------------------------------------------
> | TO UNSUBSCRIBE from this list:
> | http://lists.meer.net/mailman/listinfo/analog-help
> |
> | Analog Documentation: http://analog.cx/docs/Readme.html
> | List archives: http://www.analog.cx/docs/mailing.html#listarchives
> | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
> +------------------------------------------------------------------------
>
+------------------------------------------------------------------------
| TO UNSUBSCRIBE from this list:
| http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs/mailing.html#listarchives
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+------------------------------------------------------------------------
Re: Problem configuring Analog to read an AOLSERVER logfile that has had an additional field added. [ In reply to ]
ricky.hamilton at btopenworld
May 17, 2008, 11:33 PM
Post #3 of 5 (2560 views)
Permalink
Stephen,

Thank you for the reply.

How would I specify an optional argument?

I assumed that the LOGFILE COMMON directive that follows my custom
formats would scoop up the lines without the user_id in them.

Regards
Richard


Stephen Turner wrote:
> I think the problem is that the line it's complaining about doesn't
> have the user field. Maybe you have some lines with and some without
> in your logfile?
>
>

+------------------------------------------------------------------------
| TO UNSUBSCRIBE from this list:
| http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs/mailing.html#listarchives
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+------------------------------------------------------------------------
Re: Problem configuring Analog to read an AOLSERVER logfile that has had an additional field added. [ In reply to ]
ricky.hamilton at btopenworld
May 17, 2008, 11:36 PM
Post #4 of 5 (2564 views)
Permalink
.................the presence of which (of course!) I hadn't indicated
in my posting.

Richard


Stephen Turner wrote:
> I think the problem is that the line it's complaining about doesn't
> have the user field. Maybe you have some lines with and some without
> in your logfile?
>
>

+------------------------------------------------------------------------
| TO UNSUBSCRIBE from this list:
| http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs/mailing.html#listarchives
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+------------------------------------------------------------------------
Re: Problem configuring Analog to read an AOLSERVER logfile that has had an additional field added. [ In reply to ]
ricky.hamilton at btopenworld
May 17, 2008, 11:53 PM
Post #5 of 5 (2566 views)
Permalink
Stephen,

Thank you so much for the help. I commented out the LOGFILE COMMON
directive and added a specific format for a line with all but the last
field and BINGO!!

This has now revealed some corrupt lines for which I have also now been
able to write a line.

Many thanks
Richard

Stephen Turner wrote:
> I think the problem is that the line it's complaining about doesn't
> have the user field. Maybe you have some lines with and some without
> in your logfile?
>
>

+------------------------------------------------------------------------
| TO UNSUBSCRIBE from this list:
| http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs/mailing.html#listarchives
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+------------------------------------------------------------------------

©2024 GT.net. A Gossamer Threads company.
5th Floor, 455 Granville St., Vancouver, BC V6C 1T1, Canada | Legal