Mailing List Archive

N Sj wrote:
> In our dbmail environment dbmail_headervalue
> table has become very large and DBA is recommending running optimize table. Then I ran into a thread in dbmail archives that if the table dbmail_headervalue is dropped and recreated then it will get re-populated by running "dbmail-util -by", if that is possible then should we run OPTIMIZE TABLE or just drop and recreate the table.

Dropping, re-creating and re-populating the table is a valid procedure.
However, you will end up with the same sized table.

I've blogged about a better approach on blog.dbmail.eu.


>
> Also we run "dbmail-util- a -y -vv" every night.
>
> Thank you for your input.
>
>
>
>
> _______________________________________________
> DBmail mailing list
> DBmail@dbmail.org
> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
>


--
________________________________________________________________
Paul Stevens paul at nfg.nl
NET FACILITIES GROUP GPG/PGP: 1024D/11F8CD31
The Netherlands________________________________http://www.nfg.nl
_______________________________________________
DBmail mailing list
DBmail@dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

Paul J Stevens wrote:
> N Sj wrote:
>
>> In our dbmail environment dbmail_headervalue
>> table has become very large and DBA is recommending running optimize table. Then I ran into a thread in dbmail archives that if the table dbmail_headervalue is dropped and recreated then it will get re-populated by running "dbmail-util -by", if that is possible then should we run OPTIMIZE TABLE or just drop and recreate the table.
>>
>
> Dropping, re-creating and re-populating the table is a valid procedure.
> However, you will end up with the same sized table.
>
> I've blogged about a better approach on blog.dbmail.eu.
>
>
>
I admit to not having read the post on blog.dbmail.eu yet, but the idea
he's aiming for is something faster than OPTIMIZE TABLE dbmail_headervalue;

For which the obvious intent is to use less disc-space. I'm not sure
this will be relevant, but it is his desire. To shrink the size of the
database file itself. And yes, I know that if you delete from the table,
the leftover spots in the file will get re-used.

He may also want to run ANALYZE TABLE, if he hasn't already.

Running both what you recommend (removing the unnecessary cached fields)
and the OPTIMIZE will produce even _better_ results than either by itself.
>> Also we run "dbmail-util- a -y -vv" every night.
>>
>> Thank you for your input.
>>
>>
>>
>>
>> _______________________________________________
>> DBmail mailing list
>> DBmail@dbmail.org
>> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
>>
>>
>
>
>

Thanks, Its a great blog

Did you use "received" header just as an example in the blog, or is it really safe to delete it from the cache, received header has the biggest number in the table, besides that I see a lots of x- headers in the table which I think are safe to remove.





----- Original Message ----
From: Paul J Stevens <paul@nfg.nl>
To: DBMail mailinglist <dbmail@dbmail.org>
Sent: Sat, February 13, 2010 2:20:45 AM
Subject: Re: [Dbmail] dbmail_headervalue

N Sj wrote:
> In our dbmail environment dbmail_headervalue
> table has become very large and DBA is recommending running optimize table. Then I ran into a thread in dbmail archives that if the table dbmail_headervalue is dropped and recreated then it will get re-populated by running "dbmail-util -by", if that is possible then should we run OPTIMIZE TABLE or just drop and recreate the table.

Dropping, re-creating and re-populating the table is a valid procedure.
However, you will end up with the same sized table.

I've blogged about a better approach on blog.dbmail.eu.


>
> Also we run "dbmail-util- a -y -vv" every night.
>
> Thank you for your input.
>
>
>
>
> _______________________________________________
> DBmail mailing list
> DBmail@dbmail.org
> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail
>


--
________________________________________________________________
Paul Stevens paul at nfg.nl
NET FACILITIES GROUP GPG/PGP: 1024D/11F8CD31
The Netherlands________________________________http://www.nfg.nl
_______________________________________________
DBmail mailing list
DBmail@dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail




_______________________________________________
DBmail mailing list
DBmail@dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

On Samstag, 13. Februar 2010 Paul J Stevens wrote:
> I've blogged about a better approach on blog.dbmail.eu.

There's an error, at least for postgresql 8.4:

CREATE VIEW header_count AS
SELECT count(1) AS count, n.id, n.headername
FROM dbmail_headervalue v
LEFT JOIN dbmail_headername n ON v.headername_id=n.id
GROUP BY n.id;

ERROR: column "n.headername" must appear in the GROUP BY clause or be
used in an aggregate function

just change the last line to
GROUP BY n.id, n.headername;
and it works.

Also, this delete finds zero records:
DELETE FROM dbmail_headername WHERE headername = 'Received';
but this one works (again postgresql 8.4):
DELETE FROM dbmail_headername WHERE headername = 'received';

To make it a simple copy, here are the most often appearing entries
which probably won't be IMAP SEARCHed:

DELETE FROM dbmail_headername WHERE headername = 'received' or
headername = 'x-virus-scanned' or headername like 'x-spam%';

This deleted more than half of our headervalue entries. Afterwards,
running CLUSTER, REINDEX and VACUUM ANALYZE on the two tables is a good
way to gain performance immediately.
For CLUSTER to work, you'd need to have applied the CLUSTER commands
once that I described on http://dbmail.org/dokuwiki/doku.php/performance

I've also put the information from Paul on that page, to keep the
"performance" tips on one page.

--
mit freundlichen Grüssen,
Michael Monnerie, Ing. BSc

it-management Internet Services
http://proteger.at [gesprochen: Prot-e-schee]
Tel: 0660 / 415 65 31

// Wir haben im Moment zwei Häuser zu verkaufen:
// http://zmi.at/langegg/
// http://zmi.at/haus2009/

Reindl,

Tell me, i'm curious to know which headername do you have, can you share?

I'm curious.

> -----Original Message-----
> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
> Behalf Of Jorge Bastos
> Sent: domingo, 14 de Dezembro de 2014 18:23
> To: 'DBMail mailinglist'
> Subject: Re: [Dbmail] dbmail_headervalue
>
> Hum,
>
> Fact is I have garbage in headername table also, i have things that ARE
> NOT headers, but they are there (garbage!):
>
> +--------------------------------------------------+
> | headername |
> +--------------------------------------------------+
> | "x-copyrighted-material |
> | #content-transfer-encoding |
> | #content-type |
> | /m |
> | 0 |
> | 0/x-total-score |
> | 1 |
> | 2 |
> | 2/x-brightmail-tracker |
> | 2/x-total-score |
>
> So yes, the header_cache_readonly = yes will help on this.
> I'm going to delete the garbage headername's like this one's and leave
> only the "x-......" and a few extra one's that I know that are needed,
> and then apply the header_cache_readonly = yes, and after, truncate the
> headervalue's and dbmail-util -by it.
>
> > -----Original Message-----
> > From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
> > Behalf Of Reindl Harald
> > Sent: domingo, 14 de Dezembro de 2014 17:21
> > To: dbmail@dbmail.org
> > Subject: Re: [Dbmail] dbmail_headervalue
> >
> > correct
> >
> > keep in mind that "header_cache_readonly = yes" will prevent from
> > adding any headers again - i removed all, inserted the needed
> manually
> > in headernames and than rebuilt
> >
> > got rid millions of records forever that way
> >
> > Am 14.12.2014 um 18:10 schrieb Jorge Bastos:
> > > So,
> > >
> > > Truncate dbmail_headername;
> > > Truncate dbmail_headervalue;
> > > Dbmail-util -by
> > >
> > > During this time only IMAP will compaint since it won't have
> headers
> > > to show, but there's no problem to have IMAP users connecting
> during
> > > this time, when the re-fill is finish, everything will look normal
> > > on imap clients, right?
> > >
> > >> -----Original Message-----
> > >> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org]
> > On
> > >> Behalf Of Reindl Harald
> > >> Sent: domingo, 14 de Dezembro de 2014 17:03
> > >> To: dbmail@dbmail.org
> > >> Subject: Re: [Dbmail] dbmail_headervalue
> > >>
> > >>
> > >>
> > >> Am 14.12.2014 um 17:59 schrieb Jorge Bastos:
> > >>> I have allot, I mean, millions of lost records in the
> > >>> dbmail_headervalue table.
> > >>>
> > >>> About 72 million lost records, with dbmail-util it cannot handle
> > >>> it
> > >> in
> > >>> a workable time.
> > >>>
> > >>> Is it safe to truncate the table, and dbmail-util -by it?
> > >>
> > >> yes and you should consider "header_cache_readonly = yes" and
> > cleanup
> > >> "dbmail_headername" too - maybe that alone will be enough to get
> > >> rid of 90%
> > >>
> > >> MariaDB [dbmail]> select * from dbmail_headername;
> > >> +--------+-------------------+
> > >> | id | headername |
> > >> +--------+-------------------+
> > >> | 183 | cc |
> > >> | 8 | content-type |
> > >> | 1 | date |
> > >> | 2 | from |
> > >> | 62 | importance |
> > >> | 44 | in-reply-to |
> > >> | 3 | message-id |
> > >> | 9 | mime-version |
> > >> | 111813 | newsgroups |
> > >> | 380 | priority |
> > >> | 47 | references |
> > >> | 38 | reply-to |
> > >> | 68 | status |
> > >> | 6 | subject |
> > >> | 69 | thread-index |
> > >> | 179 | thread-topic |
> > >> | 7 | to |
> > >> | 109464 | x-msmail-priority |
> > >> | 111823 | x-msoesrec |
> > >> | 109408 | x-priority |
> > >> | 111825 | x-ref |
> > >> +--------+-------------------+
> > >> 21 rows in set (0.00 sec)
>
>
> _______________________________________________
> DBmail mailing list
> DBmail@dbmail.org
> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

_______________________________________________
DBmail mailing list
DBmail@dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

Just read what you quoted - the sql result is part of it. :-)


-------- Ursprüngliche Nachricht --------
Von: Jorge Bastos <mysql.jorge@decimal.pt>
Gesendet: 20. Dezember 2014 00:22:13 MEZ
An: 'DBMail mailinglist' <dbmail@dbmail.org>
Betreff: Re: [Dbmail] dbmail_headervalue

Reindl,

Tell me, i'm curious to know which headername do you have, can you share?

I'm curious.

> -----Original Message-----
> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
> Behalf Of Jorge Bastos
> Sent: domingo, 14 de Dezembro de 2014 18:23
> To: 'DBMail mailinglist'
> Subject: Re: [Dbmail] dbmail_headervalue
>
> Hum,
>
> Fact is I have garbage in headername table also, i have things that ARE
> NOT headers, but they are there (garbage!):
>
> +--------------------------------------------------+
> | headername |
> +--------------------------------------------------+
> | "x-copyrighted-material |
> | #content-transfer-encoding |
> | #content-type |
> | /m |
> | 0 |
> | 0/x-total-score |
> | 1 |
> | 2 |
> | 2/x-brightmail-tracker |
> | 2/x-total-score |
>
> So yes, the header_cache_readonly = yes will help on this.
> I'm going to delete the garbage headername's like this one's and leave
> only the "x-......" and a few extra one's that I know that are needed,
> and then apply the header_cache_readonly = yes, and after, truncate the
> headervalue's and dbmail-util -by it.
>
> > -----Original Message-----
> > From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
> > Behalf Of Reindl Harald
> > Sent: domingo, 14 de Dezembro de 2014 17:21
> > To: dbmail@dbmail.org
> > Subject: Re: [Dbmail] dbmail_headervalue
> >
> > correct
> >
> > keep in mind that "header_cache_readonly = yes" will prevent from
> > adding any headers again - i removed all, inserted the needed
> manually
> > in headernames and than rebuilt
> >
> > got rid millions of records forever that way
> >
> > Am 14.12.2014 um 18:10 schrieb Jorge Bastos:
> > > So,
> > >
> > > Truncate dbmail_headername;
> > > Truncate dbmail_headervalue;
> > > Dbmail-util -by
> > >
> > > During this time only IMAP will compaint since it won't have
> headers
> > > to show, but there's no problem to have IMAP users connecting
> during
> > > this time, when the re-fill is finish, everything will look normal
> > > on imap clients, right?
> > >
> > >> -----Original Message-----
> > >> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org]
> > On
> > >> Behalf Of Reindl Harald
> > >> Sent: domingo, 14 de Dezembro de 2014 17:03
> > >> To: dbmail@dbmail.org
> > >> Subject: Re: [Dbmail] dbmail_headervalue
> > >>
> > >>
> > >>
> > >> Am 14.12.2014 um 17:59 schrieb Jorge Bastos:
> > >>> I have allot, I mean, millions of lost records in the
> > >>> dbmail_headervalue table.
> > >>>
> > >>> About 72 million lost records, with dbmail-util it cannot handle
> > >>> it
> > >> in
> > >>> a workable time.
> > >>>
> > >>> Is it safe to truncate the table, and dbmail-util -by it?
> > >>
> > >> yes and you should consider "header_cache_readonly = yes" and
> > cleanup
> > >> "dbmail_headername" too - maybe that alone will be enough to get
> > >> rid of 90%
> > >>
> > >> MariaDB [dbmail]> select * from dbmail_headername;
> > >> +--------+-------------------+
> > >> | id | headername |
> > >> +--------+-------------------+
> > >> | 183 | cc |
> > >> | 8 | content-type |
> > >> | 1 | date |
> > >> | 2 | from |
> > >> | 62 | importance |
> > >> | 44 | in-reply-to |
> > >> | 3 | message-id |
> > >> | 9 | mime-version |
> > >> | 111813 | newsgroups |
> > >> | 380 | priority |
> > >> | 47 | references |
> > >> | 38 | reply-to |
> > >> | 68 | status |
> > >> | 6 | subject |
> > >> | 69 | thread-index |
> > >> | 179 | thread-topic |
> > >> | 7 | to |
> > >> | 109464 | x-msmail-priority |
> > >> | 111823 | x-msoesrec |
> > >> | 109408 | x-priority |
> > >> | 111825 | x-ref |
> > >> +--------+-------------------+
> > >> 21 rows in set (0.00 sec)
>
>
> _______________________________________________
> DBmail mailing list
> DBmail@dbmail.org
> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

_______________________________________________
DBmail mailing list
DBmail@dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail


--

Reindl Harald (mobile)
the lounge interactive design GmbH
A-1060 Vienna, Hofmühlgasse 17
CTO / CISO / Software-Development
+43 (676) 40 221 40
http://www.thelounge.net
_______________________________________________
DBmail mailing list
DBmail@dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

Oh hum :)

Do you have:

Date
Subject
From
To
Sent


Question is, the ones that end up with null in the sort column i think are garbage also, am i right? :)"Reindl Harald (mobile)" <h.reindl@thelounge.net> wrote:Just read what you quoted - the sql result is part of it. :-)


-------- Ursprüngliche Nachricht --------
Von: Jorge Bastos <mysql.jorge@decimal.pt>
Gesendet: 20. Dezember 2014 00:22:13 MEZ
An: 'DBMail mailinglist' <dbmail@dbmail.org>
Betreff: Re: [Dbmail] dbmail_headervalue

Reindl,

Tell me, i'm curious to know which headername do you have, can you share?

I'm curious.

> -----Original Message-----
> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
> Behalf Of Jorge Bastos
> Sent: domingo, 14 de Dezembro de 2014 18:23
> To: 'DBMail mailinglist'
> Subject: Re: [Dbmail] dbmail_headervalue
>
> Hum,
>
> Fact is I have garbage in headername table also, i have things that ARE
> NOT headers, but they are there (garbage!):
>
> +--------------------------------------------------+
> | headername                                       |
> +--------------------------------------------------+
> | "x-copyrighted-material                          |
> | #content-transfer-encoding                       |
> | #content-type                                    |
> | /m                                               |
> | 0                                                |
> | 0/x-total-score                                  |
> | 1                                                |
> | 2                                                |
> | 2/x-brightmail-tracker                           |
> | 2/x-total-score                                  |
>
> So yes, the header_cache_readonly = yes will help on this.
> I'm going to delete the garbage headername's like this one's and leave
> only the "x-......" and a few extra one's that I know that are needed,
> and then apply the header_cache_readonly = yes, and after, truncate the
> headervalue's and dbmail-util -by it.
>
> > -----Original Message-----
> > From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
> > Behalf Of Reindl Harald
> > Sent: domingo, 14 de Dezembro de 2014 17:21
> > To: dbmail@dbmail.org
> > Subject: Re: [Dbmail] dbmail_headervalue
> >
> > correct
> >
> > keep in mind that "header_cache_readonly = yes" will prevent from
> > adding any headers again - i removed all, inserted the needed
> manually
> > in headernames and than rebuilt
> >
> > got rid millions of records forever that way
> >
> > Am 14.12.2014 um 18:10 schrieb Jorge Bastos:
> > > So,
> > >
> > > Truncate dbmail_headername;
> > > Truncate dbmail_headervalue;
> > > Dbmail-util -by
> > >
> > > During this time only IMAP will compaint since it won't have
> headers
> > > to show, but there's no problem to have IMAP users connecting
> during
> > > this time, when the re-fill is finish, everything will look normal
> > > on imap clients, right?
> > >
> > >> -----Original Message-----
> > >> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org]
> > On
> > >> Behalf Of Reindl Harald
> > >> Sent: domingo, 14 de Dezembro de 2014 17:03
> > >> To: dbmail@dbmail.org
> > >> Subject: Re: [Dbmail] dbmail_headervalue
> > >>
> > >>
> > >>
> > >> Am 14.12.2014 um 17:59 schrieb Jorge Bastos:
> > >>> I have allot, I mean, millions of lost records in the
> > >>> dbmail_headervalue table.
> > >>>
> > >>> About 72 million lost records, with dbmail-util it cannot handle
> > >>> it
> > >> in
> > >>> a workable time.
> > >>>
> > >>> Is it safe to truncate the table, and dbmail-util -by it?
> > >>
> > >> yes and you should consider "header_cache_readonly = yes" and
> > cleanup
> > >> "dbmail_headername" too - maybe that alone will be enough to get
> > >> rid of 90%
> > >>
> > >> MariaDB [dbmail]> select * from dbmail_headername;
> > >> +--------+-------------------+
> > >> | id     | headername        |
> > >> +--------+-------------------+
> > >> |    183 | cc                |
> > >> |      8 | content-type      |
> > >> |      1 | date              |
> > >> |      2 | from              |
> > >> |     62 | importance        |
> > >> |     44 | in-reply-to       |
> > >> |      3 | message-id        |
> > >> |      9 | mime-version      |
> > >> | 111813 | newsgroups        |
> > >> |    380 | priority          |
> > >> |     47 | references        |
> > >> |     38 | reply-to          |
> > >> |     68 | status            |
> > >> |      6 | subject           |
> > >> |     69 | thread-index      |
> > >> |    179 | thread-topic      |
> > >> |      7 | to                |
> > >> | 109464 | x-msmail-priority |
> > >> | 111823 | x-msoesrec        |
> > >> | 109408 | x-priority        |
> > >> | 111825 | x-ref             |
> > >> +--------+-------------------+
> > >> 21 rows in set (0.00 sec)
>
>
> _______________________________________________
> DBmail mailing list
> DBmail@dbmail.org
> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

_______________________________________________
DBmail mailing list
DBmail@dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail


--

Reindl Harald (mobile)
the lounge interactive design GmbH
A-1060 Vienna, Hofmühlgasse 17
CTO / CISO / Software-Development
+43 (676) 40 221 40
http://www.thelounge.net
_______________________________________________
DBmail mailing list
DBmail@dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

Am 20.12.2014 um 10:33 schrieb Jorge Bastos:
> Oh hum :)
>
> Do you have:
>
> Date
> Subject
> From
> To
> Sent

uhm i posted what i have and it's in every quote of that thread

> > >> MariaDB [dbmail]> select * from dbmail_headername;
> > >> +--------+-------------------+
> > >> | id | headername |
> > >> +--------+-------------------+
> > >> | 183 | cc |
> > >> | 8 | content-type |
> > >> | 1 | date |
> > >> | 2 | from |
> > >> | 62 | importance |
> > >> | 44 | in-reply-to |
> > >> | 3 | message-id |
> > >> | 9 | mime-version |
> > >> | 111813 | newsgroups |
> > >> | 380 | priority |
> > >> | 47 | references |
> > >> | 38 | reply-to |
> > >> | 68 | status |
> > >> | 6 | subject |
> > >> | 69 | thread-index |
> > >> | 179 | thread-topic |
> > >> | 7 | to |
> > >> | 109464 | x-msmail-priority |
> > >> | 111823 | x-msoesrec |
> > >> | 109408 | x-priority |
> > >> | 111825 | x-ref |
> > >> +--------+-------------------+
> > >> 21 rows in set (0.00 sec)

> Question is, the ones that end up with null in the sort column i think
> are garbage also, am i right? :)

the only relevant question is if mail cliets are using a header for
sorting, display, threading and so on in the list view

> "Reindl Harald (mobile)" <h.reindl@thelounge.net> wrote:
> Just read what you quoted - the sql result is part of it. :-)
>
>
> -------- Ursprüngliche Nachricht --------
> Von: Jorge Bastos <mysql.jorge@decimal.pt>
> Gesendet: 20. Dezember 2014 00:22:13 MEZ
> An: 'DBMail mailinglist' <dbmail@dbmail.org>
> Betreff: Re: [Dbmail] dbmail_headervalue
>
> Reindl,
>
> Tell me, i'm curious to know which headername do you have, can you share?
>
> I'm curious.
>
> > -----Original Message-----
> > From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
> > Behalf Of Jorge Bastos
> > Sent: domingo, 14 de Dezembro de 2014 18:23
> > To: 'DBMail mailinglist'
> > Subject: Re: [Dbmail] dbmail_headervalue
> >
> > Hum,
> >
> > Fact is I have garbage in headername table also, i have things that ARE
> > NOT headers, but they are there (garbage!):
> >
> > +--------------------------------------------------+
> > | headername |
> > +--------------------------------------------------+
> > | "x-copyrighted-material |
> > | #content-transfer-encoding |
> > | #content-type |
> > | /m |
> > | 0 |
> > | 0/x-total-score |
> > | 1 |
> > | 2 |
> > | 2/x-brightmail-tracker |
> > | 2/x-total-score |
> >
> > So yes, the header_cache_readonly = yes will help on this.
> > I'm going to delete the garbage headername's like this one's and leave
> > only the "x-......" and a few extra one's that I know that are needed,
> > and then apply the header_cache_readonly = yes, and after, truncate the
> > headervalue's and dbmail-util -by it.
> >
> > > -----Original Message-----
> > > From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
> > > Behalf Of Reindl Harald
> > > Sent: domingo, 14 de Dezembro de 2014 17:21
> > > To: dbmail@dbmail.org
> > > Subject: Re: [Dbmail] dbmail_headervalue
> > >
> > > correct
> > >
> > > keep in mind that "header_cache_readonly = yes" will prevent from
> > > adding any headers again - i removed all, inserted the needed
> > manually
> > > in headernames and than rebuilt
> > >
> > > got rid millions of records forever that way
> > >
> > > Am 14.12.2014 um 18:10 schrieb Jorge Bastos:
> > > > So,
> > > >
> > > > Truncate dbmail_headername;
> > > > Truncate dbmail_headervalue;
> > > > Dbmail-util -by
> > > >
> > > > During this time only IMAP will compaint since it won't have
> > headers
> > > > to show, but there's no problem to have IMAP users connecting
> > during
> > > > this time, when the re-fill is finish, everything will look normal
> > > > on imap clients, right?
> > > >
> > > >> -----Original Message-----
> > > >> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org]
> > > On
> > > >> Behalf Of Reindl Harald
> > > >> Sent: domingo, 14 de Dezembro de 2014 17:03
> > > >> To: dbmail@dbmail.org
> > > >> Subject: Re: [Dbmail] dbmail_headervalue
> > > >>
> > > >>
> > > >> Am 14.12.2014 um 17:59 schrieb Jorge Bastos:
> > > >>> I have allot, I mean, millions of lost records in the
> > > >>> dbmail_headervalue table.
> > > >>>
> > > >>> About 72 million lost records, with dbmail-util it cannot handle
> > > >>> it
> > > >> in
> > > >>> a workable time.
> > > >>>
> > > >>> Is it safe to truncate the table, and dbmail-util -by it?
> > > >>
> > > >> yes and you should consider "header_cache_readonly = yes" and
> > > cleanup
> > > >> "dbmail_headername" too - maybe that alone will be enough to get
> > > >> rid of 90%
> > > >>
> > > >> MariaDB [dbmail]> select * from dbmail_headername;
> > > >> +--------+-------------------+
> > > >> | id | headername |
> > > >> +--------+-------------------+
> > > >> | 183 | cc |
> > > >> | 8 | content-type |
> > > >> | 1 | date |
> > > >> | 2 | from |
> > > >> | 62 | importance |
> > > >> | 44 | in-reply-to |
> > > >> | 3 | message-id |
> > > >> | 9 | mime-version |
> > > >> | 111813 | newsgroups |
> > > >> | 380 | priority |
> > > >> | 47 | references |
> > > >> | 38 | reply-to |
> > > >> | 68 | status |
> > > >> | 6 | subject |
> > > >> | 69 | thread-index |
> > > >> | 179 | thread-topic |
> > > >> | 7 | to |
> > > >> | 109464 | x-msmail-priority |
> > > >> | 111823 | x-msoesrec |
> > > >> | 109408 | x-priority |
> > > >> | 111825 | x-ref |
> > > >> +--------+-------------------+
> > > >> 21 rows in set (0.00 sec)

Reindl,

Thanks, i just wanna to have a more consistant ideia of the headers to use.

> -----Original Message-----
> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
> Behalf Of Reindl Harald
> Sent: sábado, 20 de Dezembro de 2014 12:36
> To: dbmail@dbmail.org
> Subject: Re: [Dbmail] dbmail_headervalue
>
>
> Am 20.12.2014 um 10:33 schrieb Jorge Bastos:
> > Oh hum :)
> >
> > Do you have:
> >
> > Date
> > Subject
> > From
> > To
> > Sent
>
> uhm i posted what i have and it's in every quote of that thread
>
> -----+-------------------+
>
> > Question is, the ones that end up with null in the sort column i
> think
> > are garbage also, am i right? :)
>
> the only relevant question is if mail cliets are using a header for
> sorting, display, threading and so on in the list view
>
> > "Reindl Harald (mobile)" <h.reindl@thelounge.net> wrote:
> > Just read what you quoted - the sql result is part of it. :-)
> >
> >
> > -------- Ursprüngliche Nachricht --------
> > Von: Jorge Bastos <mysql.jorge@decimal.pt>
> > Gesendet: 20. Dezember 2014 00:22:13 MEZ
> > An: 'DBMail mailinglist' <dbmail@dbmail.org>
> > Betreff: Re: [Dbmail] dbmail_headervalue
> >
> > Reindl,
> >
> > Tell me, i'm curious to know which headername do you have, can you
> share?
> >
> > I'm curious.
> >
> > > -----Original Message-----
> > > From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org]
> > On > Behalf Of Jorge Bastos > Sent: domingo, 14 de Dezembro de 2014
> > 18:23 > To: 'DBMail mailinglist'
> > > Subject: Re: [Dbmail] dbmail_headervalue > > Hum, > > Fact is
> I
> > have garbage in headername table also, i have things that ARE > NOT
> > headers, but they are there (garbage!):
> > >
> > > +--------------------------------------------------+
> > > | headername |
> > > +--------------------------------------------------+
> > > | "x-copyrighted-material |
> > > | #content-transfer-encoding |
> > > | #content-type |
> > > | /m |
> > > | 0 |
> > > | 0/x-total-score |
> > > | 1 |
> > > | 2 |
> > > | 2/x-brightmail-tracker |
> > > | 2/x-total-score |
> > >
> > > So yes, the header_cache_readonly = yes will help on this.
> > > I'm going to delete the garbage headername's like this one's and
> > leave > only the "x-......" and a few extra one's that I know that
> > are needed, > and then apply the header_cache_readonly = yes, and
> > after, truncate the > headervalue's and dbmail-util -by it.
> > >
> > > > -----Original Message-----
> > > > From: dbmail-bounces@dbmail.org
> > [mailto:dbmail-bounces@dbmail.org] On > > Behalf Of Reindl Harald >
> > > Sent: domingo, 14 de Dezembro de 2014 17:21 > > To:
> > dbmail@dbmail.org > > Subject: Re: [Dbmail] dbmail_headervalue > >
> > > > correct > > > > keep in mind that "header_cache_readonly = yes"
> > will prevent from > > adding any headers again - i removed all,
> > inserted the needed > manually > > in headernames and than rebuilt
> > > > > > got rid millions of records forever that way > > > > Am
> > 14.12.2014 um 18:10 schrieb Jorge Bastos:
> > > > > So,
> > > > >
> > > > > Truncate dbmail_headername;
> > > > > Truncate dbmail_headervalue;
> > > > > Dbmail-util -by
> > > > >
> > > > > During this time only IMAP will compaint since it won't have
> >
> > headers > > > to show, but there's no problem to have IMAP users
> > connecting > during > > > this time, when the re-fill is finish,
> > everything will look normal > > > on imap clients, right?
> > > > >
> > > > >> -----Original Message-----
> > > > >> From: dbmail-bounces@dbmail.org
> > [mailto:dbmail-bounces@dbmail.org]
> > > > On
> > > > >> Behalf Of Reindl Harald
> > > > >> Sent: domingo, 14 de Dezembro de 2014 17:03 > > >> To:
> > dbmail@dbmail.org > > >> Subject: Re: [Dbmail] dbmail_headervalue >
> > > >> > > >> > > >> Am 14.12.2014 um 17:59 schrieb Jorge Bastos:
> > >>> dbmail_headervalue table.
> > > > >>>
> > > > >>> About 72 million lost records, with dbmail-util it cannot
> > handle > > >>> it > > >> in > > >>> a workable time.
> > > > >>>
> > > > >>> Is it safe to truncate the table, and dbmail-util -by it?
> > > > >>
> > > > >> yes and you should consider "header_cache_readonly = yes" and
> > > > cleanup > > >> "dbmail_headername" too - maybe that alone will
> be
> > enough to get > > >> rid of 90% > > >> > > >> MariaDB [dbmail]>
> > select * from dbmail_headername; > > >>
> > +--------+-------------------+
> > > > >> | id | headername |
> > > > >> +--------+-------------------+
> > > > >> | 183 | cc |
> > > > >> | 8 | content-type |
> > > > >> | 1 | date |
> > > > >> | 2 | from |
> > > > >> | 62 | importance |
> > > > >> | 44 | in-reply-to |
> > > > >> | 3 | message-id |
> > > > >> | 9 | mime-version |
> > > > >> | 111813 | newsgroups |
> > > > >> | 380 | priority |
> > > > >> | 47 | references |
> > > > >> | 38 | reply-to |
> > > > >> | 68 | status |
> > > > >> | 6 | subject |
> > > > >> | 69 | thread-index |
> > > > >> | 179 | thread-topic |
> > > > >> | 7 | to |
> > > > >> | 109464 | x-msmail-priority |
> > > > >> | 111823 | x-msoesrec |
> > > > >> | 109408 | x-priority |
> > > > >> | 111825 | x-ref |
> > > > >> +--------+-------------------+ > > >> 21 rows in set (0.00
> > sec)


_______________________________________________
DBmail mailing list
DBmail@dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

Reidnl,

With:

header_cache_readonly = yes

I keep having new headername's being inserted in dbmail_headername.

Maybe a bug?

I'm on 3.1.17


> -----Original Message-----
> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
> Behalf Of Jorge Bastos
> Sent: domingo, 21 de Dezembro de 2014 22:05
> To: 'DBMail mailinglist'
> Subject: Re: [Dbmail] dbmail_headervalue
>
> Reindl,
>
> Thanks, i just wanna to have a more consistant ideia of the headers to
> use.
>
> > -----Original Message-----
> > From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
> > Behalf Of Reindl Harald
> > Sent: sábado, 20 de Dezembro de 2014 12:36
> > To: dbmail@dbmail.org
> > Subject: Re: [Dbmail] dbmail_headervalue
> >
> >
> > Am 20.12.2014 um 10:33 schrieb Jorge Bastos:
> > > Oh hum :)
> > >
> > > Do you have:
> > >
> > > Date
> > > Subject
> > > From
> > > To
> > > Sent
> >
> > uhm i posted what i have and it's in every quote of that thread
> >
> > +---
> > -----+-------------------+
> > sec)
> >
> > > Question is, the ones that end up with null in the sort column i
> > think
> > > are garbage also, am i right? :)
> >
> > the only relevant question is if mail cliets are using a header for
> > sorting, display, threading and so on in the list view
> >
> > > "Reindl Harald (mobile)" <h.reindl@thelounge.net> wrote:
> > > Just read what you quoted - the sql result is part of it. :-)
> > >
> > >
> > > -------- Ursprüngliche Nachricht --------
> > > Von: Jorge Bastos <mysql.jorge@decimal.pt>
> > > Gesendet: 20. Dezember 2014 00:22:13 MEZ
> > > An: 'DBMail mailinglist' <dbmail@dbmail.org>
> > > Betreff: Re: [Dbmail] dbmail_headervalue
> > >
> > > Reindl,
> > >
> > > Tell me, i'm curious to know which headername do you have, can you
> > share?
> > >
> > > I'm curious.
> > >
> > > > -----Original Message-----
> > > > From: dbmail-bounces@dbmail.org
> > > [mailto:dbmail-bounces@dbmail.org]
> > > On > Behalf Of Jorge Bastos > Sent: domingo, 14 de Dezembro de
> > > 2014
> > > 18:23 > To: 'DBMail mailinglist'
> > > > Subject: Re: [Dbmail] dbmail_headervalue > > Hum, > > Fact
> is
> > I
> > > have garbage in headername table also, i have things that ARE >
> NOT
> > > headers, but they are there (garbage!):
> > > >
> > > > +--------------------------------------------------+
> > > > | headername |
> > > > +--------------------------------------------------+
> > > > | "x-copyrighted-material |
> > > > | #content-transfer-encoding |
> > > > | #content-type |
> > > > | /m |
> > > > | 0 |
> > > > | 0/x-total-score |
> > > > | 1 |
> > > > | 2 |
> > > > | 2/x-brightmail-tracker |
> > > > | 2/x-total-score |
> > > >
> > > > So yes, the header_cache_readonly = yes will help on this.
> > > > I'm going to delete the garbage headername's like this one's and
> > > leave > only the "x-......" and a few extra one's that I know that
> > > are needed, > and then apply the header_cache_readonly = yes, and
> > > after, truncate the > headervalue's and dbmail-util -by it.
> > > >
> > > > > -----Original Message-----
> > > > > From: dbmail-bounces@dbmail.org
> > > [mailto:dbmail-bounces@dbmail.org] On > > Behalf Of Reindl Harald
> > > >
> > > > Sent: domingo, 14 de Dezembro de 2014 17:21 > > To:
> > > dbmail@dbmail.org > > Subject: Re: [Dbmail] dbmail_headervalue >
> >
> > > > > correct > > > > keep in mind that "header_cache_readonly =
> yes"
> > > will prevent from > > adding any headers again - i removed all,
> > > inserted the needed > manually > > in headernames and than
> rebuilt
> > > > > > > got rid millions of records forever that way > > > > Am
> > > 14.12.2014 um 18:10 schrieb Jorge Bastos:
> > > > > > So,
> > > > > >
> > > > > > Truncate dbmail_headername;
> > > > > > Truncate dbmail_headervalue;
> > > > > > Dbmail-util -by
> > > > > >
> > > > > > During this time only IMAP will compaint since it won't have
> > >
> > > headers > > > to show, but there's no problem to have IMAP users
> > > connecting > during > > > this time, when the re-fill is finish,
> > > everything will look normal > > > on imap clients, right?
> > > > > >
> > > > > >> -----Original Message-----
> > > > > >> From: dbmail-bounces@dbmail.org
> > > [mailto:dbmail-bounces@dbmail.org]
> > > > > On
> > > > > >> Behalf Of Reindl Harald
> > > > > >> Sent: domingo, 14 de Dezembro de 2014 17:03 > > >> To:
> > > dbmail@dbmail.org > > >> Subject: Re: [Dbmail] dbmail_headervalue
> > > >
> > > > >> > > >> > > >> Am 14.12.2014 um 17:59 schrieb Jorge Bastos:
> > > > > >>> I have allot, I mean, millions of lost records in the > >
> > > >>> dbmail_headervalue table.
> > > > > >>>
> > > > > >>> About 72 million lost records, with dbmail-util it cannot
> > > handle > > >>> it > > >> in > > >>> a workable time.
> > > > > >>>
> > > > > >>> Is it safe to truncate the table, and dbmail-util -by it?
> > > > > >>
> > > > > >> yes and you should consider "header_cache_readonly = yes"
> > > and
> > > > > cleanup > > >> "dbmail_headername" too - maybe that alone will
> > be
> > > enough to get > > >> rid of 90% > > >> > > >> MariaDB [dbmail]>
> > > select * from dbmail_headername; > > >>
> > > +--------+-------------------+
> > > > > >> | id | headername |
> > > > > >> +--------+-------------------+
> > > > > >> | 183 | cc |
> > > > > >> | 8 | content-type |
> > > > > >> | 1 | date |
> > > > > >> | 2 | from |
> > > > > >> | 62 | importance |
> > > > > >> | 44 | in-reply-to |
> > > > > >> | 3 | message-id |
> > > > > >> | 9 | mime-version |
> > > > > >> | 111813 | newsgroups |
> > > > > >> | 380 | priority |
> > > > > >> | 47 | references |
> > > > > >> | 38 | reply-to |
> > > > > >> | 68 | status |
> > > > > >> | 6 | subject |
> > > > > >> | 69 | thread-index |
> > > > > >> | 179 | thread-topic |
> > > > > >> | 7 | to |
> > > > > >> | 109464 | x-msmail-priority |
> > > > > >> | 111823 | x-msoesrec |
> > > > > >> | 109408 | x-priority |
> > > > > >> | 111825 | x-ref |
> > > > > >> +--------+-------------------+ > > >> 21 rows in set (0.00
> > > sec)
>
>
> _______________________________________________
> DBmail mailing list
> DBmail@dbmail.org
> http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

_______________________________________________
DBmail mailing list
DBmail@dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail

it's statically here - did you

a) restart all services
b) made sure using the correct dbmail.conf

3.1.17 here too over months
it belongs in the [DBMAIL] main-section

Am 22.12.2014 um 19:22 schrieb Jorge Bastos:
> Reidnl,
>
> With:
>
> header_cache_readonly = yes
>
> I keep having new headername's being inserted in dbmail_headername.
>
> Maybe a bug?
>
> I'm on 3.1.17
>
>> -----Original Message-----
>> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
>> Behalf Of Jorge Bastos
>> Sent: domingo, 21 de Dezembro de 2014 22:05
>> To: 'DBMail mailinglist'
>> Subject: Re: [Dbmail] dbmail_headervalue
>>
>> Reindl,
>>
>> Thanks, i just wanna to have a more consistant ideia of the headers to
>> use.
>>
>>> -----Original Message-----
>>> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
>>> Behalf Of Reindl Harald
>>> Sent: sábado, 20 de Dezembro de 2014 12:36
>>> To: dbmail@dbmail.org
>>> Subject: Re: [Dbmail] dbmail_headervalue
>>>
>>>
>>> Am 20.12.2014 um 10:33 schrieb Jorge Bastos:
>>>> Oh hum :)
>>>>
>>>> Do you have:
>>>>
>>>> Date
>>>> Subject
>>>> From
>>>> To
>>>> Sent
>>>
>>> uhm i posted what i have and it's in every quote of that thread
>>>
>>> > > >> MariaDB [dbmail]> select * from dbmail_headername; > > >>
>>> +---
>>> -----+-------------------+
>>> > > >> | id | headername |
>>> > > >> +--------+-------------------+
>>> > > >> | 183 | cc |
>>> > > >> | 8 | content-type |
>>> > > >> | 1 | date |
>>> > > >> | 2 | from |
>>> > > >> | 62 | importance |
>>> > > >> | 44 | in-reply-to |
>>> > > >> | 3 | message-id |
>>> > > >> | 9 | mime-version |
>>> > > >> | 111813 | newsgroups |
>>> > > >> | 380 | priority |
>>> > > >> | 47 | references |
>>> > > >> | 38 | reply-to |
>>> > > >> | 68 | status |
>>> > > >> | 6 | subject |
>>> > > >> | 69 | thread-index |
>>> > > >> | 179 | thread-topic |
>>> > > >> | 7 | to |
>>> > > >> | 109464 | x-msmail-priority |
>>> > > >> | 111823 | x-msoesrec |
>>> > > >> | 109408 | x-priority |
>>> > > >> | 111825 | x-ref |
>>> > > >> +--------+-------------------+ > > >> 21 rows in set (0.00
>>> sec)
>>>
>>>> Question is, the ones that end up with null in the sort column i
>>> think
>>>> are garbage also, am i right? :)
>>>
>>> the only relevant question is if mail cliets are using a header for
>>> sorting, display, threading and so on in the list view
>>>
>>>> "Reindl Harald (mobile)" <h.reindl@thelounge.net> wrote:
>>>> Just read what you quoted - the sql result is part of it. :-)
>>>>
>>>>
>>>> -------- Ursprüngliche Nachricht --------
>>>> Von: Jorge Bastos <mysql.jorge@decimal.pt>
>>>> Gesendet: 20. Dezember 2014 00:22:13 MEZ
>>>> An: 'DBMail mailinglist' <dbmail@dbmail.org>
>>>> Betreff: Re: [Dbmail] dbmail_headervalue
>>>>
>>>> Reindl,
>>>>
>>>> Tell me, i'm curious to know which headername do you have, can you
>>> share?
>>>>
>>>> I'm curious.
>>>>
>>>> > -----Original Message-----
>>>> > From: dbmail-bounces@dbmail.org
>>>> [mailto:dbmail-bounces@dbmail.org]
>>>> On > Behalf Of Jorge Bastos > Sent: domingo, 14 de Dezembro de
>>>> 2014
>>>> 18:23 > To: 'DBMail mailinglist'
>>>> > Subject: Re: [Dbmail] dbmail_headervalue > > Hum, > > Fact
>> is
>>> I
>>>> have garbage in headername table also, i have things that ARE >
>> NOT
>>>> headers, but they are there (garbage!):
>>>> >
>>>> > +--------------------------------------------------+
>>>> > | headername |
>>>> > +--------------------------------------------------+
>>>> > | "x-copyrighted-material |
>>>> > | #content-transfer-encoding |
>>>> > | #content-type |
>>>> > | /m |
>>>> > | 0 |
>>>> > | 0/x-total-score |
>>>> > | 1 |
>>>> > | 2 |
>>>> > | 2/x-brightmail-tracker |
>>>> > | 2/x-total-score |
>>>> >
>>>> > So yes, the header_cache_readonly = yes will help on this.
>>>> > I'm going to delete the garbage headername's like this one's and
>>>> leave > only the "x-......" and a few extra one's that I know that
>>>> are needed, > and then apply the header_cache_readonly = yes, and
>>>> after, truncate the > headervalue's and dbmail-util -by it.
>>>> >
>>>> > > -----Original Message-----
>>>> > > From: dbmail-bounces@dbmail.org
>>>> [mailto:dbmail-bounces@dbmail.org] On > > Behalf Of Reindl Harald
>>>>>
>>>>> Sent: domingo, 14 de Dezembro de 2014 17:21 > > To:
>>>> dbmail@dbmail.org > > Subject: Re: [Dbmail] dbmail_headervalue >
>>>
>>>>>> correct > > > > keep in mind that "header_cache_readonly =
>> yes"
>>>> will prevent from > > adding any headers again - i removed all,
>>>> inserted the needed > manually > > in headernames and than
>> rebuilt
>>>>>> > > got rid millions of records forever that way > > > > Am
>>>> 14.12.2014 um 18:10 schrieb Jorge Bastos:
>>>> > > > So,
>>>> > > >
>>>> > > > Truncate dbmail_headername;
>>>> > > > Truncate dbmail_headervalue;
>>>> > > > Dbmail-util -by
>>>> > > >
>>>> > > > During this time only IMAP will compaint since it won't have
>>>>
>>>> headers > > > to show, but there's no problem to have IMAP users
>>>> connecting > during > > > this time, when the re-fill is finish,
>>>> everything will look normal > > > on imap clients, right?
>>>> > > >
>>>> > > >> -----Original Message-----
>>>> > > >> From: dbmail-bounces@dbmail.org
>>>> [mailto:dbmail-bounces@dbmail.org]
>>>> > > On
>>>> > > >> Behalf Of Reindl Harald
>>>> > > >> Sent: domingo, 14 de Dezembro de 2014 17:03 > > >> To:
>>>> dbmail@dbmail.org > > >> Subject: Re: [Dbmail] dbmail_headervalue
>>>>>
>>>>>>> > > >> > > >> Am 14.12.2014 um 17:59 schrieb Jorge Bastos:
>>>> > > >>> I have allot, I mean, millions of lost records in the > >
>>>>>>> dbmail_headervalue table.
>>>> > > >>>
>>>> > > >>> About 72 million lost records, with dbmail-util it cannot
>>>> handle > > >>> it > > >> in > > >>> a workable time.
>>>> > > >>>
>>>> > > >>> Is it safe to truncate the table, and dbmail-util -by it?
>>>> > > >>
>>>> > > >> yes and you should consider "header_cache_readonly = yes"
>>>> and
>>>>>> cleanup > > >> "dbmail_headername" too - maybe that alone will
>>> be
>>>> enough to get > > >> rid of 90% > > >> > > >> MariaDB [dbmail]>
>>>> select * from dbmail_headername; > > >>
>>>> +--------+-------------------+
>>>> > > >> | id | headername |
>>>> > > >> +--------+-------------------+
>>>> > > >> | 183 | cc |
>>>> > > >> | 8 | content-type |
>>>> > > >> | 1 | date |
>>>> > > >> | 2 | from |
>>>> > > >> | 62 | importance |
>>>> > > >> | 44 | in-reply-to |
>>>> > > >> | 3 | message-id |
>>>> > > >> | 9 | mime-version |
>>>> > > >> | 111813 | newsgroups |
>>>> > > >> | 380 | priority |
>>>> > > >> | 47 | references |
>>>> > > >> | 38 | reply-to |
>>>> > > >> | 68 | status |
>>>> > > >> | 6 | subject |
>>>> > > >> | 69 | thread-index |
>>>> > > >> | 179 | thread-topic |
>>>> > > >> | 7 | to |
>>>> > > >> | 109464 | x-msmail-priority |
>>>> > > >> | 111823 | x-msoesrec |
>>>> > > >> | 109408 | x-priority |
>>>> > > >> | 111825 | x-ref |
>>>> > > >> +--------+-------------------+ > > >> 21 rows in set (0.00
>>>> sec)

Yes, it's under [DBMAIL].

Well, yesterday I restarted the machine due to other situation, so that’s
not that.

Sure, only /etc/dbmail.conf, no doubt about it.

Ideas? :(

> -----Original Message-----
> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org] On
> Behalf Of Reindl Harald
> Sent: segunda-feira, 22 de Dezembro de 2014 18:26
> To: dbmail@dbmail.org
> Subject: Re: [Dbmail] dbmail_headervalue
>
> it's statically here - did you
>
> a) restart all services
> b) made sure using the correct dbmail.conf
>
> 3.1.17 here too over months
> it belongs in the [DBMAIL] main-section
>
> Am 22.12.2014 um 19:22 schrieb Jorge Bastos:
> > Reidnl,
> >
> > With:
> >
> > header_cache_readonly = yes
> >
> > I keep having new headername's being inserted in dbmail_headername.
> >
> > Maybe a bug?
> >
> > I'm on 3.1.17
> >
> >> -----Original Message-----
> >> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org]
> On
> >> Behalf Of Jorge Bastos
> >> Sent: domingo, 21 de Dezembro de 2014 22:05
> >> To: 'DBMail mailinglist'
> >> Subject: Re: [Dbmail] dbmail_headervalue
> >>
> >> Reindl,
> >>
> >> Thanks, i just wanna to have a more consistant ideia of the headers
> >> to use.
> >>
> >>> -----Original Message-----
> >>> From: dbmail-bounces@dbmail.org [mailto:dbmail-bounces@dbmail.org]
> >>> On Behalf Of Reindl Harald
> >>> Sent: sábado, 20 de Dezembro de 2014 12:36
> >>> To: dbmail@dbmail.org
> >>> Subject: Re: [Dbmail] dbmail_headervalue
> >>>
> >>>
> >>> Am 20.12.2014 um 10:33 schrieb Jorge Bastos:
> >>>> Oh hum :)
> >>>>
> >>>> Do you have:
> >>>>
> >>>> Date
> >>>> Subject
> >>>> From
> >>>> To
> >>>> Sent
> >>>
> >>> uhm i posted what i have and it's in every quote of that thread
> >>>
> >>> > > >> MariaDB [dbmail]> select * from dbmail_headername; > > >>
> >>> +---
> >>> -----+-------------------+
> >>> > > >> | id | headername |
> >>> > > >> +--------+-------------------+
> >>> > > >> | 183 | cc |
> >>> > > >> | 8 | content-type |
> >>> > > >> | 1 | date |
> >>> > > >> | 2 | from |
> >>> > > >> | 62 | importance |
> >>> > > >> | 44 | in-reply-to |
> >>> > > >> | 3 | message-id |
> >>> > > >> | 9 | mime-version |
> >>> > > >> | 111813 | newsgroups |
> >>> > > >> | 380 | priority |
> >>> > > >> | 47 | references |
> >>> > > >> | 38 | reply-to |
> >>> > > >> | 68 | status |
> >>> > > >> | 6 | subject |
> >>> > > >> | 69 | thread-index |
> >>> > > >> | 179 | thread-topic |
> >>> > > >> | 7 | to |
> >>> > > >> | 109464 | x-msmail-priority |
> >>> > > >> | 111823 | x-msoesrec |
> >>> > > >> | 109408 | x-priority |
> >>> > > >> | 111825 | x-ref |
> >>> > > >> +--------+-------------------+ > > >> 21 rows in set
> (0.00
> >>> sec)
> >>>
> >>>> Question is, the ones that end up with null in the sort column i
> >>> think
> >>>> are garbage also, am i right? :)
> >>>
> >>> the only relevant question is if mail cliets are using a header for
> >>> sorting, display, threading and so on in the list view
> >>>
> >>>> "Reindl Harald (mobile)" <h.reindl@thelounge.net> wrote:
> >>>> Just read what you quoted - the sql result is part of it. :-)
> >>>>
> >>>>
> >>>> -------- Ursprüngliche Nachricht --------
> >>>> Von: Jorge Bastos <mysql.jorge@decimal.pt>
> >>>> Gesendet: 20. Dezember 2014 00:22:13 MEZ
> >>>> An: 'DBMail mailinglist' <dbmail@dbmail.org>
> >>>> Betreff: Re: [Dbmail] dbmail_headervalue
> >>>>
> >>>> Reindl,
> >>>>
> >>>> Tell me, i'm curious to know which headername do you have, can you
> >>> share?
> >>>>
> >>>> I'm curious.
> >>>>
> >>>> > -----Original Message-----
> >>>> > From: dbmail-bounces@dbmail.org
> >>>> [mailto:dbmail-bounces@dbmail.org]
> >>>> On > Behalf Of Jorge Bastos > Sent: domingo, 14 de Dezembro de
> >>>> 2014
> >>>> 18:23 > To: 'DBMail mailinglist'
> >>>> > Subject: Re: [Dbmail] dbmail_headervalue > > Hum, > > Fact
> >> is
> >>> I
> >>>> have garbage in headername table also, i have things that ARE >
> >> NOT
> >>>> headers, but they are there (garbage!):
> >>>> >
> >>>> > +--------------------------------------------------+
> >>>> > | headername |
> >>>> > +--------------------------------------------------+
> >>>> > | "x-copyrighted-material |
> >>>> > | #content-transfer-encoding |
> >>>> > | #content-type |
> >>>> > | /m |
> >>>> > | 0 |
> >>>> > | 0/x-total-score |
> >>>> > | 1 |
> >>>> > | 2 |
> >>>> > | 2/x-brightmail-tracker |
> >>>> > | 2/x-total-score |
> >>>> >
> >>>> > So yes, the header_cache_readonly = yes will help on this.
> >>>> > I'm going to delete the garbage headername's like this one's
> >>>> and leave > only the "x-......" and a few extra one's that I know
> >>>> that are needed, > and then apply the header_cache_readonly =
> yes,
> >>>> and after, truncate the > headervalue's and dbmail-util -by it.
> >>>> >
> >>>> > > -----Original Message-----
> >>>> > > From: dbmail-bounces@dbmail.org
> >>>> [mailto:dbmail-bounces@dbmail.org] On > > Behalf Of Reindl Harald
> >>>>>
> >>>>> Sent: domingo, 14 de Dezembro de 2014 17:21 > > To:
> >>>> dbmail@dbmail.org > > Subject: Re: [Dbmail] dbmail_headervalue >
> >>>
> >>>>>> correct > > > > keep in mind that "header_cache_readonly =
> >> yes"
> >>>> will prevent from > > adding any headers again - i removed all,
> >>>> inserted the needed > manually > > in headernames and than
> >> rebuilt
> >>>>>> > > got rid millions of records forever that way > > > > Am
> >>>> 14.12.2014 um 18:10 schrieb Jorge Bastos:
> >>>> > > > So,
> >>>> > > >
> >>>> > > > Truncate dbmail_headername;
> >>>> > > > Truncate dbmail_headervalue;
> >>>> > > > Dbmail-util -by
> >>>> > > >
> >>>> > > > During this time only IMAP will compaint since it won't
> >>>> have
> >>>>
> >>>> headers > > > to show, but there's no problem to have IMAP users
> >>>> connecting > during > > > this time, when the re-fill is finish,
> >>>> everything will look normal > > > on imap clients, right?
> >>>> > > >
> >>>> > > >> -----Original Message-----
> >>>> > > >> From: dbmail-bounces@dbmail.org
> >>>> [mailto:dbmail-bounces@dbmail.org]
> >>>> > > On
> >>>> > > >> Behalf Of Reindl Harald
> >>>> > > >> Sent: domingo, 14 de Dezembro de 2014 17:03 > > >> To:
> >>>> dbmail@dbmail.org > > >> Subject: Re: [Dbmail] dbmail_headervalue
> >>>>>
> >>>>>>> > > >> > > >> Am 14.12.2014 um 17:59 schrieb Jorge Bastos:
> >>>> > > >>> I have allot, I mean, millions of lost records in the >
> >>>> >
> >>>>>>> dbmail_headervalue table.
> >>>> > > >>>
> >>>> > > >>> About 72 million lost records, with dbmail-util it
> cannot
> >>>> handle > > >>> it > > >> in > > >>> a workable time.
> >>>> > > >>>
> >>>> > > >>> Is it safe to truncate the table, and dbmail-util -by
> it?
> >>>> > > >>
> >>>> > > >> yes and you should consider "header_cache_readonly = yes"
> >>>> and
> >>>>>> cleanup > > >> "dbmail_headername" too - maybe that alone will
> >>> be
> >>>> enough to get > > >> rid of 90% > > >> > > >> MariaDB [dbmail]>
> >>>> select * from dbmail_headername; > > >>
> >>>> +--------+-------------------+
> >>>> > > >> | id | headername |
> >>>> > > >> +--------+-------------------+
> >>>> > > >> | 183 | cc |
> >>>> > > >> | 8 | content-type |
> >>>> > > >> | 1 | date |
> >>>> > > >> | 2 | from |
> >>>> > > >> | 62 | importance |
> >>>> > > >> | 44 | in-reply-to |
> >>>> > > >> | 3 | message-id |
> >>>> > > >> | 9 | mime-version |
> >>>> > > >> | 111813 | newsgroups |
> >>>> > > >> | 380 | priority |
> >>>> > > >> | 47 | references |
> >>>> > > >> | 38 | reply-to |
> >>>> > > >> | 68 | status |
> >>>> > > >> | 6 | subject |
> >>>> > > >> | 69 | thread-index |
> >>>> > > >> | 179 | thread-topic |
> >>>> > > >> | 7 | to |
> >>>> > > >> | 109464 | x-msmail-priority |
> >>>> > > >> | 111823 | x-msoesrec |
> >>>> > > >> | 109408 | x-priority |
> >>>> > > >> | 111825 | x-ref |
> >>>> > > >> +--------+-------------------+ > > >> 21 rows in set
> >>>> (0.00
> >>>> sec)


_______________________________________________
DBmail mailing list
DBmail@dbmail.org
http://mailman.fastxs.nl/cgi-bin/mailman/listinfo/dbmail