Mailing List Archive: [Bug 3085] Allow UTF-8 for log output

[Bug 3085] Allow UTF-8 for log output

Mar 31, 2024, 1:38 PM

Post #1 of 4 (40 views)

https://bugs.exim.org/show_bug.cgi?id=3085

Jeremy Harris <jgh146exb@wizmail.org> changed:

What |Removed |Added
----------------------------------------------------------------------------
Status|NEW |RESOLVED
Resolution|--- |WONTFIX

--- Comment #1 from Jeremy Harris <jgh146exb@wizmail.org> ---
You didn't show the actual log line (only fail2ban's take on it), but
your problem seems to be associated with the "display name" portion of a From:
header line, something that Exim does not log by default. You could consider
removing the part of your config that is doing so.

However, the underlying issue is that Exim's log are not intended or deigned
for
machine-consumption ("log-scraping") - which is what fail2ban is presumably
doing,
since it cannot handle this log line.

You could
- cease using a log-scraper
- wait for maching-readable (eg. bug 2610) logging
- configure Exim to trigger whatever fail2ban does directly, to cut out the
log-writing and log-scraping stages

--
You are receiving this mail because:
You are on the CC list for the bug.

--
## subscription configuration (requires account):
## https://lists.exim.org/mailman3/postorius/lists/exim-dev.lists.exim.org/
## unsubscribe (doesn't require an account):
## exim-dev-unsubscribe@lists.exim.org
## Exim details at http://www.exim.org/
## Please use the Wiki with this list - http://wiki.exim.org/

[Bug 3085] Allow UTF-8 for log output [ In reply to ]

exim-dev at lists

Mar 31, 2024, 7:27 PM

Post #2 of 4 (40 views)

Permalink

https://bugs.exim.org/show_bug.cgi?id=3085

--- Comment #2 from Forza <forza@tnonline.net> ---
The issue seems to be that Exim didn't escape characters that are outside of
the us-ascii/7-bit. As far as I know, Exim mostly does that in the logs (I see
plenty of lines with escaped characters like \360\237\216\211).

Here we see malformed double quotes:
2024-03-17T19:23:33.698+00:00 notice exim[5673]: [12\21] F From: "?"
<msoony@gmail.com>
2024-03-17T19:23:33.698+00:00 notice exim[5673]: [13\21] R Reply-To: "?"
<msoony@gmail.com>

The subject line has strange characters:
2024-03-17T19:23:33.698+00:00 notice exim[5673]: [15\21] Subject: 2030 ? ? ? ??
?!

Having json output would be OK, but overkill. In the fail2ban case I need to
have either plain text or UTF-8/Unicode, and not mixed mode. The same applies
to syslog.

--
You are receiving this mail because:
You are on the CC list for the bug.

--
## subscription configuration (requires account):
## https://lists.exim.org/mailman3/postorius/lists/exim-dev.lists.exim.org/
## unsubscribe (doesn't require an account):
## exim-dev-unsubscribe@lists.exim.org
## Exim details at http://www.exim.org/
## Please use the Wiki with this list - http://wiki.exim.org/

[Bug 3085] Allow UTF-8 for log output [ In reply to ]

exim-dev at lists

Mar 31, 2024, 7:30 PM

Post #3 of 4 (40 views)

Permalink

https://bugs.exim.org/show_bug.cgi?id=3085

--- Comment #3 from Forza <forza@tnonline.net> ---
Created attachment 1477
--> https://bugs.exim.org/attachment.cgi?id=1477&action=edit
Exim log gile

Exim log file with the problematic characters.

--
You are receiving this mail because:
You are on the CC list for the bug.

--
## subscription configuration (requires account):
## https://lists.exim.org/mailman3/postorius/lists/exim-dev.lists.exim.org/
## unsubscribe (doesn't require an account):
## exim-dev-unsubscribe@lists.exim.org
## Exim details at http://www.exim.org/
## Please use the Wiki with this list - http://wiki.exim.org/

[Bug 3085] Allow UTF-8 for log output [ In reply to ]

exim-dev at lists

Apr 1, 2024, 12:58 PM

Post #4 of 4 (39 views)

Permalink

https://bugs.exim.org/show_bug.cgi?id=3085

--- Comment #4 from Simon Arlott <bugzilla.exim.simon@arlott.org> ---
Exim's log files do not have to be "machine readable" for them to be in a
consistent known character set. Exim escapes non-ASCII characters in other
places in the logs, e.g. when it receives invalid input over SMTP:

2024-04-01T20:57:30.952+01:00 SMTP syntax error in
"\360\237\231\202\360\237\231\202\360\237\231\202"

--
You are receiving this mail because:
You are on the CC list for the bug.

--
## subscription configuration (requires account):
## https://lists.exim.org/mailman3/postorius/lists/exim-dev.lists.exim.org/
## unsubscribe (doesn't require an account):
## exim-dev-unsubscribe@lists.exim.org
## Exim details at http://www.exim.org/
## Please use the Wiki with this list - http://wiki.exim.org/