Mailing List Archive

Stanges trouble with deadlock on postgres 8.4.3 & davical 0.9.9 ( also with 0.9.8.4 )
On 05/13/2010 11:44 AM, Bruno Friedmann wrote:
> Hi all,
>
> I'm in the process of upgrading my caldav-test server (http://caldav-test.ioda.net)
>
> I've cleared all events from all collections. and now I'm trying to re-import the 13 schedules.
> (Done with sunbird 1.0pre2 beta : build on 05122010 )
>
> I see a lots of this type of errors
>
> [13-May-2010 11:36:52] davical: LOG: caldav.php/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics: Query: QF: SQL error "40P01"
> - ERROR: deadlock detected D?TAIL : Process 8168 waits for ShareLock on transaction 33498; blocked by process 8166. Process 8166
> waits for ExclusiveLock on tuple (0,20) of relation 18660 of database 18145; blocked by proce
>
> [13-May-2010 11:36:52] davical: LOG: caldav.php/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics: Query: QF: ss 8168. ASTUCE :
> See server log for query details. CONTEXTE : SQL statement "UPDATE collection SET modified = current_timestamp, dav_etag = md5(
> $1 ) WHERE collection_id = $2 " PL/pgSQL function "caldav_data_modified" line 15 at SQL statem
>
> [13-May-2010 11:36:52] davical: LOG: caldav.php/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics: Query: QF: ent"
>
> [13-May-2010 11:36:52] davical: LOG: caldav.php/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics: Query: QF: INSERT INTO
> caldav_data ( user_no, dav_name, dav_etag, caldav_data, caldav_type, logged_user, created, modified, collection_id, weak_etag )
> VALUES( :user_no, :dav_name, :etag, :dav_data, :caldav_type, :session_user, current_timestamp, curre
>
> [13-May-2010 11:36:52] davical: LOG: caldav.php/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics: Query: QF: nt_timestamp,
> :collection_id, :weak_etag )
> [13-May-2010 11:36:52] davical: LOG: caldav.php/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics: Query: QF: ":dav_name"
> => "/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics"
>
> [13-May-2010 11:36:52] davical: LOG: caldav.php/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics: Query: QF: ":user_no" =>
> "1003"
> [13-May-2010 11:36:52] davical: LOG: caldav.php/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics: Query: QF: ":etag" =>
> "ac61cb65c58c071a408633ffd9743238"
> [13-May-2010 11:36:52] davical: LOG: caldav.php/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics: Query: QF: ":dav_data"
> => "BEGIN:VCALENDAR
> PRODID:-//Mozilla.org/NONSGML Mozilla Calendar V1.1//EN
>
> VERSION:2.0
>
> BEGIN:VEVENT
>
> CREATED:20100310T094649Z
>
> LAST-MODIFIED:20100310T094733Z
>
> DTSTAMP:20100310T094733Z
>
> UID:1380875d-e929-42f3-b64a-24275ffad9d3
>
> SUMMARY:DRzLR zrnst 14Q00 JLS
>
> DTSTART;VALUE=DATE:20100316
>
> DTEND;VALUE=DATE:20100317
>
> TRANSP:TRANSPARENT
>
> END:VEVENT
>
> END:VCALENDAR
>
> "
>
> [13-May-2010 11:36:52] davical: LOG: caldav.php/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics: Query: QF:
> ":caldav_type" => "VEVENT"
> [13-May-2010 11:36:52] davical: LOG: caldav.php/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics: Query: QF:
> ":session_user" => "1012"
> [13-May-2010 11:36:52] davical: LOG: caldav.php/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics: Query: QF: ":weak_etag"
> => ""
> [13-May-2010 11:36:52] davical: LOG: caldav.php/blue/home/1380875d-e929-42f3-b64a-24275ffad9d3.ics: Query: QF:
> ":collection_id" => "1600"
>
>
>
> And in postgresql log this
>
> 2010-05-13 11:37:51 CEST caldav_test davical_app HINT: See server log for query details.
>
> 2010-05-13 11:37:51 CEST caldav_test davical_app CONTEXT: SQL statement "UPDATE collection SET modified = current_timestamp,
> dav_etag = md5( $1 ) WHERE collection_id = $2 "
>
> PL/pgSQL function "caldav_data_modified" line 15 at SQL statement
>
> 2010-05-13 11:37:51 CEST caldav_test davical_app STATEMENT: INSERT INTO caldav_data ( user_no, dav_name, dav_etag, caldav_data,
> caldav_type, logged_user, created, modified, collection_id, weak_etag )
>
> VALUES( 1003, '/blue/home/157cb89e-6dcb-48e7-8e90-bb2b313e7486.ics', '71bdd18bfef212031bb54de49d29d240',
> 'BEGIN:VCALENDAR
> PRODID:-//Mozilla.org/NONSGML Mozilla Calendar V1.1//EN
>
> VERSION:2.0
>
> BEGIN:VEVENT
>
> CREATED:20100222T071408Z
>
> LAST-MODIFIED:20100222T071454Z
>
> DTSTAMP:20100222T071454Z
>
> UID:157cb89e-6dcb-48e7-8e90-bb2b313e7486
>
> SUMMARY:Kzllzr wttw 13:30 Szrzngzn / SD-LR
>
> DTSTART;VALUE=DATE:20100222
>
> DTEND;VALUE=DATE:20100223
>
> TRANSP:TRANSPARENT
>
> END:VEVENT
>
> END:VCALENDAR
>
> ', 'VEVENT', 1012, current_timestamp, current_timestamp, 1600, NULL )
>
> 2010-05-13 11:37:53 CEST caldav_test davical_app ERROR: deadlock detected
>
> 2010-05-13 11:37:53 CEST caldav_test davical_app DETAIL: Process 8429 waits for ShareLock on transaction 33733; blocked by
> process 8426.
> Process 8426 waits for ExclusiveLock on tuple (1,26) of relation 18660 of database 18145; blocked by process 8429.
>
> Process 8429: INSERT INTO caldav_data ( user_no, dav_name, dav_etag, caldav_data, caldav_type, logged_user, created,
> modified, collection_id, weak_etag )
> VALUES( 1003, '/blue/home/af7bf555-8c09-4b47-ac69-3e7494aecce3.ics', 'eb2e105e05ca03234850a8a603fef409',
> 'BEGIN:VCALENDAR
> PRODID:-//Mozilla.org/NONSGML Mozilla Calendar V1.1//EN
>
> VERSION:2.0
>
> BEGIN:VEVENT
>
> CREATED:20100225T094145Z
> LAST-MODIFIED:20100225T094207Z
> DTSTAMP:20100225T094207Z
> UID:af7bf555-8c09-4b47-ac69-3e7494aecce3
> SUMMARY:WzRss QzRnrRxQ JLS
> DTSTART;VALUE=DATE:20100226
> DTEND;VALUE=DATE:20100227
> TRANSP:TRANSPARENT
> END:VEVENT
> END:VCALENDAR
> ', 'VEVENT', 1012, current_timestamp, current_timestamp, 1600, NULL )
> Process 8426: INSERT INTO caldav_data ( user_no, dav_name, dav_etag, caldav_data, caldav_type, logged_user, created,
> modified, collection_id, weak_etag )
> VALUES( 1003, '/blue/home/e8cd55e9-8736-4550-a91c-42425eaf6841.ics', 'f6e3fdf42d44fcf0b7638cd6e1b49b53',
> 'BEGIN:VCALENDAR
> PRODID:-//Mozilla.org/NONSGML Mozilla Calendar V1.1//EN
> VERSION:2.0
> BEGIN:VEVENT
> CREATED:20100224T124428Z
> LAST-MODIFIED:20100224T124457Z
> DTSTAMP:20100224T124457Z
> UID:e8cd55e9-8736-4550-a91c-42425eaf6841
> SUMMARY:Qwrst Rwsz xl
> DTSTART;VALUE=DATE:20100226
> DTEND;VALUE=DATE:20100227
> TRANSP:TRANSPARENT
> END:VEVENT
> END:VCALENDAR
> ', 'VEVENT', 1012, current_timestamp, current_timestamp, 1600, NULL )
> 2
>
> Did someone have a clue about this ?
> My database have been migrated from a 8.1 pg server to the new one + update davical dabase script ok.
>
> Any help or advise are welcomed ..
>
>

As I've too much glitches with the 0.9.9 version in the admin interface, i've erased all things, (php,lib&db)
and put the previous version.

but when I try to reimport the .ics file it just bugs on deadlocks ?

Before (<0.9.6) I was using the admin frontal which allow us to import .ics file directly without any troubles.

So I don't know what to thing : bad features when triggers are on ? bad pg conf (I've a doubt about that one)

Any feedback ?

--

Bruno Friedmann



_______________________________________________
rscds-general mailing list
rscds-general at lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rscds-general
Stanges trouble with deadlock on postgres 8.4.3 & davical 0.9.9 ( also with 0.9.8.4 ) [ In reply to ]
To update the situation : using the import ics ressource webpage, every collection goes without error.

but with http://caldav-test.ioda.net/info.php configuration I can't import a big collection (archives with ~8500 events)
wihout finishing on a blank page ( no php error logged )

I can give this ics file to every body interested.



--

Bruno Friedmann

Ioda-Net S?rl
2830 Vellerat - Switzerland

T?l : ++41 32 435 7171
Fax : ++41 32 435 7172
gsm : ++41 78 802 6760
www.ioda-net.ch

Centre de Formation et de Coaching En Ligne
www.cfcel.com


_______________________________________________
rscds-general mailing list
rscds-general at lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rscds-general
Stanges trouble with deadlock on postgres 8.4.3 & davical 0.9.9 ( also with 0.9.8.4 ) [ In reply to ]
On Thu, 2010-05-13 at 18:11 +0200, Bruno Friedmann wrote:
> To update the situation : using the import ics ressource webpage,
> every collection goes without error.
>
> but with http://caldav-test.ioda.net/info.php configuration I can't
> import a big collection (archives with ~8500 events)
> wihout finishing on a blank page ( no php error logged )
>
> I can give this ics file to every body interested.

You'll be pleased to know that both import processes run exactly the
same code, although I guess the memory requirements might vary a little,
so increasing the memory allowed to PHP might help.

I think I may have seen some deadlock issues in the past with an older
version of PostgreSQL, too, but not with 8.4.

I'm happy if you want to send me the .ics and I'll try and find some
time to look at it.

Cheers,
Andrew.

--
------------------------------------------------------------------------
andrew (AT) morphoss (DOT) com +64(272)DEBIAN
Never be led astray onto the path of virtue.
------------------------------------------------------------------------

-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 198 bytes
Desc: This is a digitally signed message part
URL: <http://lists.morphoss.com/pipermail/davical-users/attachments/20100514/95f0a2e7/attachment.pgp>
-------------- next part --------------

-------------- next part --------------
_______________________________________________
rscds-general mailing list
rscds-general at lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/rscds-general