Mailing List Archive

On 30.12.20 13:53, Emanuel Gonzalez wrote:
>Dec 30 09:56:57 eternia6 spamd[15993]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>Dec 30 09:56:57 eternia6 spamd[15915]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>Dec 30 09:56:58 eternia6 spamd[16002]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>Dec 30 09:56:59 eternia6 spamd[15960]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>Dec 30 09:57:00 eternia6 spamd[15847]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>Dec 30 09:57:01 eternia6 spamd[15909]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>
>is possible be an error of permission?

aparently no. That's apparently problem of a process having the database
locked while other process tries to write to it.

>drwsr-sr-x 3 spamd spamd 20 dic 18 10:26 /var/spamassassin
>drwxr-xr-x 2 spamd spamd 60 dic 30 10:03 /var/spamassassin/bayesdb/
>
>-rw------- 1 spamd spamd 66960 dic 30 10:03 bayes_journal
>-rwxr-xr-x 1 spamd spamd 172032 dic 18 10:52 bayes_seen
>-rwxr-xr-x 1 spamd spamd 5132288 dic 30 10:03 bayes_toks
>
>##### Bayes config
>
>use_bayes yes
>bayes_path /var/spamassassin/bayesdb/bayes
>bayes_auto_learn 0
>bayes_auto_expire 0
>
>##### SpamAssassin Deamon config
>
>SPAMDOPTIONS="-u spamd --round-robin --min-children=30 --max-children=180 --min-spare=25 --max-spare=80 --timeout-child=60 --max-conn-per-child=150
>-i -A 172.17.0.0/16,10.0.0.0/8,200.58.96.0/19,179.43.112.0/20,168.197.48.0/22,168.181.184.0/22,138.219.40.0/22,138.36.236.0/22,66.97.32.0/20"
>
>I read various publications for this error but i don't know how resolve it.
>
>Any ideas, recommendations?

bayes_learn_to_journal 1


--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
On the other hand, you have different fingers.

Emanuel Gonzalez wrote:

> ##### SpamAssassin Deamon config
>
> SPAMDOPTIONS="-u spamd --round-robin --min-children=30
> --max-children=180 --min-spare=25 --max-spare=80 --timeout-child=60
> --max-conn-per-child=150
> -i -A
> 172.17.0.0/16,10.0.0.0/8,200.58.96.0/19,179.43.112.0/20,168.197.48.0/22,168.181.184.0/22,138.219.40.0/22,138.36.236.0/22,66.97.32.0/20"

Putting aside your Bayes error (which I'm pretty sure Matus answered),
this seems like an awful lot of individual systems allowed to connect to
a single spamd instance - it's not generally an end-user-accessible
service. Do you really need to access this spamd instance from ~20,000
public IPs?

-kgd

Hello everyone, i'm back from my vacations, i try solved this problem but i could not.

I still see in the spamsassin error logs the mentioned error:

bayes_learn_to_journal 1
use_bayes yes
bayes_path /var/spamassassin/bayesdb/bayes
bayes_auto_learn 0
bayes_auto_expire 0

#

- rw------- 1 spamd spamd 48984 ene 20 08:06 /var/spamassassin/bayesdb/bayes_journal
-rwxr-xr-x 1 spamd spamd 172032 dic 18 10:52 /var/spamassassin/bayesdb/bayes_seen
-rwxr-xr-x 1 spamd spamd 5132288 ene 20 08:05 /var/spamassassin/bayesdb/bayes_toks

Jan 20 07:25:27 eternia6 spamd[22817]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
Jan 20 07:25:27 eternia6 spamd[22916]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
Jan 20 07:25:27 eternia6 spamd[22843]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists


Any ideas? i don't know how resolve this error.

Regards, Emanuel.

On 20.01.21 11:07, Emanuel Gonzalez wrote:
>Date: Wed, 20 Jan 2021 11:07:59 +0000
>From: Emanuel Gonzalez <emanuel_gonzalez@live.com.ar>
>To: SA Mailing list <users@spamassassin.apache.org>
>Subject: Re: Error "cannot open bayes databases" lock failed: File exists
>
>Hello everyone, i'm back from my vacations, i try solved this problem but i could not.
>
>I still see in the spamsassin error logs the mentioned error:
>
>bayes_learn_to_journal 1
>use_bayes yes
>bayes_path /var/spamassassin/bayesdb/bayes
>bayes_auto_learn 0
>bayes_auto_expire 0
>

try:

ls -la /var/spamassassin/bayesdb/bayes
lsof /var/spamassassin/bayesdb/bayes_journal /var/spamassassin/bayesdb/bayes_seen /var/spamassassin/bayesdb/bayes_toks

> - rw------- 1 spamd spamd 48984 ene 20 08:06 /var/spamassassin/bayesdb/bayes_journal
>-rwxr-xr-x 1 spamd spamd 172032 dic 18 10:52 /var/spamassassin/bayesdb/bayes_seen
>-rwxr-xr-x 1 spamd spamd 5132288 ene 20 08:05 /var/spamassassin/bayesdb/bayes_toks
>
>Jan 20 07:25:27 eternia6 spamd[22817]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>Jan 20 07:25:27 eternia6 spamd[22916]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>Jan 20 07:25:27 eternia6 spamd[22843]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>
>
>Any ideas? i don't know how resolve this error.


--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
Atheism is a non-prophet organization.

Hello Matus, thanks for your reply.

# ls -la /var/spamassassin/bayesdb/bayes

ls: no se puede acceder a /var/spamassassin/bayesdb/bayes: No existe el fichero o el directorio

I see an error of inexistent file.

# lsof /var/spamassassin/bayesdb/bayes_journal /var/spamassassin/bayesdb/bayes_seen /var/spamassassin/bayesdb/bayes_toks

COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
spamd 25467 spamd 12r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25467 spamd 13r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25470 spamd 15r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25470 spamd 16r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25491 spamd 36r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25491 spamd 37r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25494 spamd 39r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25494 spamd 40r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25502 spamd 47r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25502 spamd 48r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25503 spamd 48r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25503 spamd 49r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25504 spamd 51r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25504 spamd 52r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25506 spamd 51r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25506 spamd 52r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25514 spamd 59r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25514 spamd 60r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25515 spamd 60r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25515 spamd 70r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25520 spamd 68r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25520 spamd 69r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25536 spamd 81r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25536 spamd 82r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25537 spamd 84r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25537 spamd 85r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25542 spamd 87r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25542 spamd 88r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25544 spamd 90r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25544 spamd 91r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25546 spamd 91r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25546 spamd 92r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25552 spamd 97r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25552 spamd 98r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25561 spamd 106r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25561 spamd 107r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25568 spamd 113r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25568 spamd 114r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25573 spamd 118r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25573 spamd 119r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25574 spamd 119r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25574 spamd 120r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25586 spamd 131r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25586 spamd 132r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25588 spamd 133r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25588 spamd 134r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25592 spamd 137r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25592 spamd 138r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25595 spamd 140r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25595 spamd 141r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25598 spamd 143r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25598 spamd 144r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25599 spamd 144r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25599 spamd 147r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25600 spamd 145r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25600 spamd 146r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25605 spamd 150r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25605 spamd 151r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25619 spamd 164r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25619 spamd 165r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25624 spamd 169r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25624 spamd 170r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25625 spamd 170r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25625 spamd 171r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 25645 spamd 190r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 25645 spamd 191r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 29795 spamd 191r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 29795 spamd 192r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 29850 spamd 105r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 29850 spamd 111r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 29856 spamd 169r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 29856 spamd 189r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 29857 spamd 189r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 29857 spamd 190r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 29872 spamd 191r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 29872 spamd 192r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 29875 spamd 191r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 29875 spamd 192r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen
spamd 29921 spamd 192r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
spamd 29921 spamd 193r REG 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen

Regards, Emanuel.
________________________________
De: Matus UHLAR - fantomas <uhlar@fantomas.sk>
Enviado: mi?rcoles, 20 de enero de 2021 9:09
Para: users@spamassassin.apache.org <users@spamassassin.apache.org>
Asunto: Re: Error "cannot open bayes databases" lock failed: File exists

On 20.01.21 11:07, Emanuel Gonzalez wrote:
>Date: Wed, 20 Jan 2021 11:07:59 +0000
>From: Emanuel Gonzalez <emanuel_gonzalez@live.com.ar>
>To: SA Mailing list <users@spamassassin.apache.org>
>Subject: Re: Error "cannot open bayes databases" lock failed: File exists
>
>Hello everyone, i'm back from my vacations, i try solved this problem but i could not.
>
>I still see in the spamsassin error logs the mentioned error:
>
>bayes_learn_to_journal 1
>use_bayes yes
>bayes_path /var/spamassassin/bayesdb/bayes
>bayes_auto_learn 0
>bayes_auto_expire 0
>

try:

ls -la /var/spamassassin/bayesdb/bayes
lsof /var/spamassassin/bayesdb/bayes_journal /var/spamassassin/bayesdb/bayes_seen /var/spamassassin/bayesdb/bayes_toks

> - rw------- 1 spamd spamd 48984 ene 20 08:06 /var/spamassassin/bayesdb/bayes_journal
>-rwxr-xr-x 1 spamd spamd 172032 dic 18 10:52 /var/spamassassin/bayesdb/bayes_seen
>-rwxr-xr-x 1 spamd spamd 5132288 ene 20 08:05 /var/spamassassin/bayesdb/bayes_toks
>
>Jan 20 07:25:27 eternia6 spamd[22817]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>Jan 20 07:25:27 eternia6 spamd[22916]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>Jan 20 07:25:27 eternia6 spamd[22843]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>
>
>Any ideas? i don't know how resolve this error.


--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
Atheism is a non-prophet organization.

On Wed, 20 Jan 2021, Matus UHLAR - fantomas wrote:

> On 20.01.21 11:07, Emanuel Gonzalez wrote:
>> Date: Wed, 20 Jan 2021 11:07:59 +0000
>> From: Emanuel Gonzalez <emanuel_gonzalez@live.com.ar>
>> To: SA Mailing list <users@spamassassin.apache.org>
>> Subject: Re: Error "cannot open bayes databases" lock failed: File exists
>>
>> Hello everyone, i'm back from my vacations, i try solved this problem but i
>> could not.
>>
>> I still see in the spamsassin error logs the mentioned error:
>>
>> bayes_learn_to_journal 1
>> use_bayes yes
>> bayes_path /var/spamassassin/bayesdb/bayes
>> bayes_auto_learn 0
>> bayes_auto_expire 0
>>
>
> try:
>
> ls -la /var/spamassassin/bayesdb/bayes
> lsof /var/spamassassin/bayesdb/bayes_journal
> /var/spamassassin/bayesdb/bayes_seen /var/spamassassin/bayesdb/bayes_toks

Umm, the command:
ls -la /var/spamassassin/bayesdb/bayes

should get you the error:

ls: cannot access /var/spamassassin/bayesdb/bayes : No such file or directory

On the otherhand:

ls -la /var/spamassassin/bayesdb/bayes*
(taken from the bayes_path parameter) should get you what you want.

even better:

ls -la /var/spamassassin/bayesdb/
(to see if there's any leftover lock files in that directory)


--
Dave Funk University of Iowa
<dbfunk (at) engineering.uiowa.edu> College of Engineering
319/335-5751 FAX: 319/384-0549 1256 Seamans Center, 103 S Capitol St.
Sys_admin/Postmaster/cell_admin Iowa City, IA 52242-1527
#include <std_disclaimer.h>
Better is not better, 'standard' is better. B{

Hello,

-rw------- 1 spamd spamd 224 ene 20 13:45 bayes.lock
-rw------- 1 spamd spamd 84 ene 2 01:31 bayes.lock.eternia6.dattaweb.com.11016
-rw------- 1 spamd spamd 224 ene 2 01:31 bayes.lock.eternia6.dattaweb.com.11251
-rw------- 1 spamd spamd 84 ene 2 01:31 bayes.lock.eternia6.dattaweb.com.14855
-rw------- 1 spamd spamd 224 ene 2 01:31 bayes.lock.eternia6.dattaweb.com.16779
-rw------- 1 spamd spamd 224 ene 5 01:37 bayes.lock.eternia6.dattaweb.com.25210
-rw------- 1 spamd spamd 168 ene 20 11:29 bayes.lock.eternia6.dattaweb.com.25620
-rw------- 1 spamd spamd 28 ene 5 01:37 bayes.lock.eternia6.dattaweb.com.25694
-rw------- 1 spamd spamd 28 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.29848
-rw------- 1 spamd spamd 112 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.29852
-rw------- 1 spamd spamd 28 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.29868
-rw------- 1 spamd spamd 224 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.29873
-rw------- 1 spamd spamd 54 ene 15 17:47 bayes.lock.eternia6.dattaweb.com.3018
-rw------- 1 spamd spamd 252 ene 19 11:22 bayes.lock.eternia6.dattaweb.com.30473
-rw------- 1 spamd spamd 252 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.31005
-rw------- 1 spamd spamd 252 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.31007
-rw------- 1 spamd spamd 224 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.31009
-rw------- 1 spamd spamd 112 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.31092
-rw------- 1 spamd spamd 112 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.31095
-rw------- 1 spamd spamd 196 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.31101
-rw------- 1 spamd spamd 196 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.31149
-rw------- 1 spamd spamd 112 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.31160
-rw------- 1 spamd spamd 252 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.31274
-rw------- 1 spamd spamd 140 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.31687
-rw------- 1 spamd spamd 168 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.31733
-rw------- 1 spamd spamd 56 ene 20 13:54 bayes.lock.eternia6.dattaweb.com.31836
-rw------- 1 spamd spamd 270 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5412
-rw------- 1 spamd spamd 54 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5429
-rw------- 1 spamd spamd 216 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5436
-rw------- 1 spamd spamd 108 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5443
-rw------- 1 spamd spamd 270 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5455
-rw------- 1 spamd spamd 243 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5493
-rw------- 1 spamd spamd 135 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5496
-rw------- 1 spamd spamd 270 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5524
-rw------- 1 spamd spamd 189 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5527
-rw------- 1 spamd spamd 108 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5529
-rw------- 1 spamd spamd 81 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5540
-rw------- 1 spamd spamd 243 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5549
-rw------- 1 spamd spamd 270 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5557
-rw------- 1 spamd spamd 162 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5574
-rw------- 1 spamd spamd 81 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5579
-rw------- 1 spamd spamd 108 ene 18 10:11 bayes.lock.eternia6.dattaweb.com.5582
-rw------- 1 spamd spamd 216 ene 2 01:31 bayes.lock.eternia6.dattaweb.com.9227
-rw------- 1 spamd spamd 720192 ene 20 13:54 bayes_journal
-rwxr-xr-x 1 spamd spamd 172032 dic 18 10:52 bayes_seen
-rwxr-xr-x 1 spamd spamd 5132288 ene 20 13:45 bayes_toks


________________________________
De: Dave Funk <dbfunk@engineering.uiowa.edu>
Enviado: mi?rcoles, 20 de enero de 2021 13:39
Para: users@spamassassin.apache.org <users@spamassassin.apache.org>
Asunto: Re: Error "cannot open bayes databases" lock failed: File exists

On Wed, 20 Jan 2021, Matus UHLAR - fantomas wrote:

> On 20.01.21 11:07, Emanuel Gonzalez wrote:
>> Date: Wed, 20 Jan 2021 11:07:59 +0000
>> From: Emanuel Gonzalez <emanuel_gonzalez@live.com.ar>
>> To: SA Mailing list <users@spamassassin.apache.org>
>> Subject: Re: Error "cannot open bayes databases" lock failed: File exists
>>
>> Hello everyone, i'm back from my vacations, i try solved this problem but i
>> could not.
>>
>> I still see in the spamsassin error logs the mentioned error:
>>
>> bayes_learn_to_journal 1
>> use_bayes yes
>> bayes_path /var/spamassassin/bayesdb/bayes
>> bayes_auto_learn 0
>> bayes_auto_expire 0
>>
>
> try:
>
> ls -la /var/spamassassin/bayesdb/bayes
> lsof /var/spamassassin/bayesdb/bayes_journal
> /var/spamassassin/bayesdb/bayes_seen /var/spamassassin/bayesdb/bayes_toks

Umm, the command:
ls -la /var/spamassassin/bayesdb/bayes

should get you the error:

ls: cannot access /var/spamassassin/bayesdb/bayes : No such file or directory

On the otherhand:

ls -la /var/spamassassin/bayesdb/bayes*
(taken from the bayes_path parameter) should get you what you want.

even better:

ls -la /var/spamassassin/bayesdb/
(to see if there's any leftover lock files in that directory)


--
Dave Funk University of Iowa
<dbfunk (at) engineering.uiowa.edu> College of Engineering
319/335-5751 FAX: 319/384-0549 1256 Seamans Center, 103 S Capitol St.
Sys_admin/Postmaster/cell_admin Iowa City, IA 52242-1527
#include <std_disclaimer.h>
Better is not better, 'standard' is better. B{

On Wed, 20 Jan 2021 14:50:53 +0000
Emanuel Gonzalez wrote:


> # lsof /var/spamassassin/bayesdb/bayes_journal
> /var/spamassassin/bayesdb/bayes_seen
> /var/spamassassin/bayesdb/bayes_toks
>
> COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME
> spamd 25467 spamd 12r REG 8,1 5132288 402667308
> /var/spamassassin/bayesdb/bayes_toks spamd 25467 spamd 13r REG
> 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen spamd
> 25470 spamd 15r REG 8,1 5132288 402667308
> /var/spamassassin/bayesdb/bayes_toks spamd 25470 spamd 16r REG
> 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen spamd
...
> 29921 spamd 192r REG 8,1 5132288 402667308
> /var/spamassassin/bayesdb/bayes_toks spamd 29921 spamd 193r REG
> 8,1 172032 402828743 /var/spamassassin/bayesdb/bayes_seen

Do you actually need so many child processes? You have 40 in Bayes
alone and in a previous post you had "--round-robin" with
"--max-children=180", i.e. a fixed number of 180 in total.

On 20.01.21 14:50, Emanuel Gonzalez wrote:
>Hello Matus, thanks for your reply.
>
># ls -la /var/spamassassin/bayesdb/bayes
>
>ls: no se puede acceder a /var/spamassassin/bayesdb/bayes: No existe el fichero o el directorio

>I see an error of inexistent file.

sorry, that was supposed to be:

ls -la /var/spamassassin/bayesdb/

so we can see hidden files too.

/var/spamassassin/bayesdb/bayes* does NOT show hidden filesa.

...however you showed us many lock files, which should explain.


># lsof /var/spamassassin/bayesdb/bayes_journal /var/spamassassin/bayesdb/bayes_seen /var/spamassassin/bayesdb/bayes_toks
>
>COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME

>spamd 25467 spamd 12r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25470 spamd 15r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25491 spamd 36r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25494 spamd 39r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25502 spamd 47r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
[...]

ohh! too many processes. I don't recommend more spamd processes than e.g.
2x number of CPUs. maybe even less.
It does not make sense to run too many processes in parallel.

If you process too much mail, you could store bayes database in SQL or
redis. However, first lower amount of processes.


--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
They that can give up essential liberty to obtain a little temporary
safety deserve neither liberty nor safety. -- Benjamin Franklin, 1759

The problem can be generated by the number of processes?

# Server CPU

cpu family : 6
model : 60
model name : Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz

# SpamAssassin

SPAMDOPTIONS="-u spamd --min-children=30 --max-children=80 --min-spare=25 --max-spare=80 --timeout-child=60 --max-conn-per-child=150

what change i need to apply?

Regards, Emanuel.
________________________________
De: Matus UHLAR - fantomas <uhlar@fantomas.sk>
Enviado: mi?rcoles, 20 de enero de 2021 15:28
Para: users@spamassassin.apache.org <users@spamassassin.apache.org>
Asunto: Re: Error "cannot open bayes databases" lock failed: File exists

On 20.01.21 14:50, Emanuel Gonzalez wrote:
>Hello Matus, thanks for your reply.
>
># ls -la /var/spamassassin/bayesdb/bayes
>
>ls: no se puede acceder a /var/spamassassin/bayesdb/bayes: No existe el fichero o el directorio

>I see an error of inexistent file.

sorry, that was supposed to be:

ls -la /var/spamassassin/bayesdb/

so we can see hidden files too.

/var/spamassassin/bayesdb/bayes* does NOT show hidden filesa.

...however you showed us many lock files, which should explain.


># lsof /var/spamassassin/bayesdb/bayes_journal /var/spamassassin/bayesdb/bayes_seen /var/spamassassin/bayesdb/bayes_toks
>
>COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME

>spamd 25467 spamd 12r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25470 spamd 15r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25491 spamd 36r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25494 spamd 39r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25502 spamd 47r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
[...]

ohh! too many processes. I don't recommend more spamd processes than e.g.
2x number of CPUs. maybe even less.
It does not make sense to run too many processes in parallel.

If you process too much mail, you could store bayes database in SQL or
redis. However, first lower amount of processes.


--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
They that can give up essential liberty to obtain a little temporary
safety deserve neither liberty nor safety. -- Benjamin Franklin, 1759

On 20.01.21 18:31, Emanuel Gonzalez wrote:
>The problem can be generated by the number of processes?

number of concurrent processes trying to write to the bayes DB at the same
time.

journalling may help a bit, but it makes no sense to parse more mail within
one CPU at the same time.


># Server CPU
>
>cpu family : 6
>model : 60
>model name : Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz

4 cores, 8 threads. provided you only have one CPU.

I'd set max-children to 4 and not set min-children,min-spare and max-spare
at all.

... on some systems I disable HT CPUs by disabling in /etc/sysfs.conf:

devices/system/cpu/cpu4/online = 0
devices/system/cpu/cpu5/online = 0
devices/system/cpu/cpu6/online = 0
devices/system/cpu/cpu7/online = 0

I think since spectre/meltdown it's a good idea, and some systems reported
high dummy CPU usage when those were enabled.

># SpamAssassin
>
>SPAMDOPTIONS="-u spamd --min-children=30 --max-children=80 --min-spare=25 --max-spare=80 --timeout-child=60 --max-conn-per-child=150

>ohh! too many processes. I don't recommend more spamd processes than e.g.
>2x number of CPUs. maybe even less.
>It does not make sense to run too many processes in parallel.
>
>If you process too much mail, you could store bayes database in SQL or
>redis. However, first lower amount of processes.

--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
10 GOTO 10 : REM (C) Bill Gates 1998, All Rights Reserved!

I'm testing right now. I have lowered the parameters but in the logs I see an error or warning:

prefork: adjust: 3 idle children more than 2 maximum idle children. Decreasing spamd children: 28057 killed.

That message can cause slow analysis of emails?

In my infrastructure I have about 10 physical servers with spamassassin, using the keepalived service the requests are balanced between them.

Regards, Emanuel.


________________________________
De: Emanuel Gonzalez <emanuel_gonzalez@live.com.ar>
Enviado: mi?rcoles, 20 de enero de 2021 15:31
Para: Matus UHLAR - fantomas <uhlar@fantomas.sk>; users@spamassassin.apache.org <users@spamassassin.apache.org>
Asunto: RE: Error "cannot open bayes databases" lock failed: File exists

The problem can be generated by the number of processes?

# Server CPU

cpu family : 6
model : 60
model name : Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz

# SpamAssassin

SPAMDOPTIONS="-u spamd --min-children=30 --max-children=80 --min-spare=25 --max-spare=80 --timeout-child=60 --max-conn-per-child=150

what change i need to apply?

Regards, Emanuel.
________________________________
De: Matus UHLAR - fantomas <uhlar@fantomas.sk>
Enviado: mi?rcoles, 20 de enero de 2021 15:28
Para: users@spamassassin.apache.org <users@spamassassin.apache.org>
Asunto: Re: Error "cannot open bayes databases" lock failed: File exists

On 20.01.21 14:50, Emanuel Gonzalez wrote:
>Hello Matus, thanks for your reply.
>
># ls -la /var/spamassassin/bayesdb/bayes
>
>ls: no se puede acceder a /var/spamassassin/bayesdb/bayes: No existe el fichero o el directorio

>I see an error of inexistent file.

sorry, that was supposed to be:

ls -la /var/spamassassin/bayesdb/

so we can see hidden files too.

/var/spamassassin/bayesdb/bayes* does NOT show hidden filesa.

...however you showed us many lock files, which should explain.


># lsof /var/spamassassin/bayesdb/bayes_journal /var/spamassassin/bayesdb/bayes_seen /var/spamassassin/bayesdb/bayes_toks
>
>COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME

>spamd 25467 spamd 12r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25470 spamd 15r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25491 spamd 36r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25494 spamd 39r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25502 spamd 47r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
[...]

ohh! too many processes. I don't recommend more spamd processes than e.g.
2x number of CPUs. maybe even less.
It does not make sense to run too many processes in parallel.

If you process too much mail, you could store bayes database in SQL or
redis. However, first lower amount of processes.


--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
They that can give up essential liberty to obtain a little temporary
safety deserve neither liberty nor safety. -- Benjamin Franklin, 1759

anyway, the error is still represented even with low configuration values.

Jan 21 10:39:43 eternia6 spamd[28053]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
Jan 21 10:39:43 eternia6 spamd[28299]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
Jan 21 10:39:43 eternia6 spamd[28273]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists

Anyone know any way to fix it??

Regards Emanuel.
________________________________
De: Emanuel Gonzalez <emanuel_gonzalez@live.com.ar>
Enviado: jueves, 21 de enero de 2021 10:35
Para: Matus UHLAR - fantomas <uhlar@fantomas.sk>; users@spamassassin.apache.org <users@spamassassin.apache.org>
Asunto: RE: Error "cannot open bayes databases" lock failed: File exists

I'm testing right now. I have lowered the parameters but in the logs I see an error or warning:

prefork: adjust: 3 idle children more than 2 maximum idle children. Decreasing spamd children: 28057 killed.

That message can cause slow analysis of emails?

In my infrastructure I have about 10 physical servers with spamassassin, using the keepalived service the requests are balanced between them.

Regards, Emanuel.


________________________________
De: Emanuel Gonzalez <emanuel_gonzalez@live.com.ar>
Enviado: mi?rcoles, 20 de enero de 2021 15:31
Para: Matus UHLAR - fantomas <uhlar@fantomas.sk>; users@spamassassin.apache.org <users@spamassassin.apache.org>
Asunto: RE: Error "cannot open bayes databases" lock failed: File exists

The problem can be generated by the number of processes?

# Server CPU

cpu family : 6
model : 60
model name : Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz

# SpamAssassin

SPAMDOPTIONS="-u spamd --min-children=30 --max-children=80 --min-spare=25 --max-spare=80 --timeout-child=60 --max-conn-per-child=150

what change i need to apply?

Regards, Emanuel.
________________________________
De: Matus UHLAR - fantomas <uhlar@fantomas.sk>
Enviado: mi?rcoles, 20 de enero de 2021 15:28
Para: users@spamassassin.apache.org <users@spamassassin.apache.org>
Asunto: Re: Error "cannot open bayes databases" lock failed: File exists

On 20.01.21 14:50, Emanuel Gonzalez wrote:
>Hello Matus, thanks for your reply.
>
># ls -la /var/spamassassin/bayesdb/bayes
>
>ls: no se puede acceder a /var/spamassassin/bayesdb/bayes: No existe el fichero o el directorio

>I see an error of inexistent file.

sorry, that was supposed to be:

ls -la /var/spamassassin/bayesdb/

so we can see hidden files too.

/var/spamassassin/bayesdb/bayes* does NOT show hidden filesa.

...however you showed us many lock files, which should explain.


># lsof /var/spamassassin/bayesdb/bayes_journal /var/spamassassin/bayesdb/bayes_seen /var/spamassassin/bayesdb/bayes_toks
>
>COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME

>spamd 25467 spamd 12r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25470 spamd 15r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25491 spamd 36r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25494 spamd 39r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
>spamd 25502 spamd 47r REG 8,1 5132288 402667308 /var/spamassassin/bayesdb/bayes_toks
[...]

ohh! too many processes. I don't recommend more spamd processes than e.g.
2x number of CPUs. maybe even less.
It does not make sense to run too many processes in parallel.

If you process too much mail, you could store bayes database in SQL or
redis. However, first lower amount of processes.


--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
They that can give up essential liberty to obtain a little temporary
safety deserve neither liberty nor safety. -- Benjamin Franklin, 1759

On Thu, 21 Jan 2021 14:08:59 +0100
Matus UHLAR - fantomas wrote:


> journalling may help a bit, but it makes no sense to parse more mail
> within one CPU at the same time.

That's true provided that everything remains completely CPU limited.

The problem is that if you run any network tests and something becomes
slow or unreliable, child processes can spend most of their time
blocked. If you have multiple processes per core, the throughput can be
more reliable.

I'd start with 5 processes per core and see how it goes.


> >model name : Intel(R) Core(TM) i7-4790 CPU @ 3.60GHz
>
> 4 cores, 8 threads. provided you only have one CPU.
>
> I'd set max-children to 4 and not set min-children,min-spare and
> max-spare at all.

If you do that you implicitly set them to 2,1 and 2 respectively.

If you want a fixed number you can set the min and max values equal.

On 21.01.21 13:41, Emanuel Gonzalez wrote:
>anyway, the error is still represented even with low configuration values.
>
>Jan 21 10:39:43 eternia6 spamd[28053]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>Jan 21 10:39:43 eternia6 spamd[28299]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>Jan 21 10:39:43 eternia6 spamd[28273]: bayes: cannot open bayes databases /var/spamassassin/bayesdb/bayes_* R/W: lock failed: File exists
>
>Anyone know any way to fix it??

I have mentioned that before, citing from message you quoted:

>If you process too much mail, you could store bayes database in SQL or
>redis. However, first lower amount of processes.


--
Matus UHLAR - fantomas, uhlar@fantomas.sk ; http://www.fantomas.sk/
Warning: I wish NOT to receive e-mail advertising to this address.
Varovanie: na tuto adresu chcem NEDOSTAVAT akukolvek reklamnu postu.
Support bacteria - they're the only culture some people have.