Mailing List Archive

Re: [Davical-general] 0.9.9.5 regressions
On Mon, 2011-09-19 at 21:02 +0200, Philip Achenbach wrote:
> Hello Andrew, hello list,
>
> I have updated my installation of DAViCal to 0.9.9.5 a few days ago
> and have since encountered a few regressions. My setup is based on
> Debian 5 (Lenny) and uses an Active Directory via LDAP as the user
> provider. The users mainly use Apple devices (iOS 4.3, Mac OS X 10.6 +
> 10.7), one uses Evoultion.
>
> Since the update, some of the user-records in the database have been
> updated to become invalid: The fields "active" and "email" in the
> table "usr" has been set to NULL (Should the "active" field really be
> NULLable?). Additionally, the fields "displayname" and
> "default_privileges" of the "principal"-table have been set to NULL.
> Afterwards, those users did neither appear under active nor under
> inactive users in the administration interface. A synchronization of
> the LDAP tree with DAViCal (via the administration interface) did not
> help here. So i modified the "active"-field manually to restore the
> users. I have not yet found out which action triggered this update.
> In a short test, the LDAP-related fix from git (Bug #3409180) did not
> help here, and the problems don't sound exactly related, but if you
> think this fixes the problem I might test it once again.

Hi Philip,

It looks like my LDAP crue let me down here :-)

Unfortunately I don't have an LDAP server myself and nobody has asked me
to provide support for any LDAP-based installations. I've had a few
post-release fixes for LDAP things which were broken in 0.9.9.5 and was
planning to release a 0.9.9.6 with the fixes that have been sent to me
so far, but what you're saying here suggests that there might still be a
few regressions nobody has told me about.

From one problem that was discussed on IRC earlier today it seems like
the 'active/email/???' issue you see might occur in relation to changing
details on the LDAP server, which suggests to me that the
sync-during-logon might be at fault here. It would be good to get
confirmation of that.


> An other major problem I have is that the synchronization with the
> iPhone does not work properly anymore: Changes made to existing events
> are synchronized properly, but new events created with Apple iCal are
> not synchronized to an iPhone. Another instance of iCal does receive
> these new events, though. Events added with an iPhone are synchronized
> to the server and appear on instances of iCal, but disappear from the
> iPhone with the next synchronization. Any help appreciated!

Do you have the iPhone set to "Sync All Events"? That seems to be the
current working setting, which is changed from what once used to work
best.

I was recently contacted by an Apple developer and have fixed a bug
(post 0.9.9.5) which he advised me of. That fix will be included in
0.9.9.6 that I was hoping to release this week, but it would also be
good to receive some fixes to the LDAP bugs you're talking about here.

I know a couple of people have been looking at the LDAP plugin recently,
thinking of rewriting it, which would be nice.


> During my testing, the following errors appeared in the error-log
> (don't know if they are related):
> > davical: ***: ERROR:Could not recognize timezone "GMT +0100
> (Standard) / GMT +0200 (Daylight)" - will use floating time
> This error appeared quite often. I think it only appeared since the
> update.

This is more of a warning than an error. DAViCal doesn't really care
about the timezone of an event, passing the event unmodified to the
client. It's more to point out that you have something somewhere
creating odd timezones.

I expect timezone handling to be assisted greatly over the next few
versions by the timezone server implementation which will land in
0.9.9.6 (mostly done now) as we will have a full timezone definitions in
place at that time, including database mechanisms for aliasing and
localisation of timezones.

The next version also adds a simple configuration setting which will let
you manually alias an odd timezone like the one above to a more standard
name like "Europe/Berlin" or something, but I'll try and make that
better in future versions by moving it to a database, and (perhaps) even
providing a centralised point where we can maintain aliases / localised
zone names for everyone.

Cheers,
Andrew.

--
------------------------------------------------------------------------
andrew (AT) morphoss (DOT) com +64(272)DEBIAN
Men still remember the first kiss after women have forgotten the last.
------------------------------------------------------------------------
Re: [Davical-general] 0.9.9.5 regressions [ In reply to ]
Hello Andrew,

Am 20.09.2011 um 12:22 schrieb Andrew McMillan:
> On Mon, 2011-09-19 at 21:02 +0200, Philip Achenbach wrote:
>>
>> I have updated my installation of DAViCal to 0.9.9.5 a few days ago
>> and have since encountered a few regressions. My setup is based on
>> Debian 5 (Lenny) and uses an Active Directory via LDAP as the user
>> provider. The users mainly use Apple devices (iOS 4.3, Mac OS X 10.6 +
>> 10.7), one uses Evoultion.
>>
>> Since the update, some of the user-records in the database have been
>> updated to become invalid: The fields "active" and "email" in the
>> table "usr" has been set to NULL (Should the "active" field really be
>> NULLable?). Additionally, the fields "displayname" and
>> "default_privileges" of the "principal"-table have been set to NULL.
>> Afterwards, those users did neither appear under active nor under
>> inactive users in the administration interface. A synchronization of
>> the LDAP tree with DAViCal (via the administration interface) did not
>> help here. So i modified the "active"-field manually to restore the
>> users. I have not yet found out which action triggered this update.
>> In a short test, the LDAP-related fix from git (Bug #3409180) did not
>> help here, and the problems don't sound exactly related, but if you
>> think this fixes the problem I might test it once again.
> [...]
> Unfortunately I don't have an LDAP server myself and nobody has asked me
> to provide support for any LDAP-based installations. I've had a few
> post-release fixes for LDAP things which were broken in 0.9.9.5 and was
> planning to release a 0.9.9.6 with the fixes that have been sent to me
> so far, but what you're saying here suggests that there might still be a
> few regressions nobody has told me about.

Possibly a first step could be to change the field "usr.active" to not allow NULL values. Then, there should at least be an error indicating when exactly this field is updated like this. This is just a guess, as I did not have a look at the code, yet.


> From one problem that was discussed on IRC earlier today it seems like
> the 'active/email/???' issue you see might occur in relation to changing
> details on the LDAP server, which suggests to me that the
> sync-during-logon might be at fault here. It would be good to get
> confirmation of that.

Sorry, but I did not change something on the LDAP server in the last few days. It also only appeared twice since the update (once affecting two users, once affecting only one), so I really don't have any idea what triggers this.


>> An other major problem I have is that the synchronization with the
>> iPhone does not work properly anymore: Changes made to existing events
>> are synchronized properly, but new events created with Apple iCal are
>> not synchronized to an iPhone. Another instance of iCal does receive
>> these new events, though. Events added with an iPhone are synchronized
>> to the server and appear on instances of iCal, but disappear from the
>> iPhone with the next synchronization. Any help appreciated!
>
> Do you have the iPhone set to "Sync All Events"? That seems to be the
> current working setting, which is changed from what once used to work
> best.

Thank you! That did the trick. Is there anything one can do to help you locating the problem with the other settings?


> I was recently contacted by an Apple developer and have fixed a bug
> (post 0.9.9.5) which he advised me of. That fix will be included in
> 0.9.9.6 that I was hoping to release this week, but it would also be
> good to receive some fixes to the LDAP bugs you're talking about here.

Maybe you could release 0.9.9.6 with the small database changes I pointed out above. If the problem would reoccur one would at least have an error message.


>> During my testing, the following errors appeared in the error-log
>> (don't know if they are related):
>>> davical: ***: ERROR:Could not recognize timezone "GMT +0100
>> (Standard) / GMT +0200 (Daylight)" - will use floating time
>> This error appeared quite often. I think it only appeared since the
>> update.
>
> This is more of a warning than an error. DAViCal doesn't really care
> about the timezone of an event, passing the event unmodified to the
> client. It's more to point out that you have something somewhere
> creating odd timezones.

Okay, that sounds possible as I have tested several clients over the last few years.


> I expect timezone handling to be assisted greatly over the next few
> versions by the timezone server implementation which will land in
> 0.9.9.6 (mostly done now) as we will have a full timezone definitions in
> place at that time, including database mechanisms for aliasing and
> localisation of timezones.
>
> The next version also adds a simple configuration setting which will let
> you manually alias an odd timezone like the one above to a more standard
> name like "Europe/Berlin" or something, but I'll try and make that
> better in future versions by moving it to a database, and (perhaps) even
> providing a centralised point where we can maintain aliases / localised
> zone names for everyone.

Yes, I have seen this in git. Thanks for your hard work with DAViCal!


Philip
_______________________________________________
DAViCal-dev mailing list
DAViCal-dev@lists.davical.org
http://lists.davical.org/listinfo/davical-dev
Re: [Davical-general] 0.9.9.5 regressions [ In reply to ]
On Tue, 2011-09-20 at 17:39 +0200, Philip Achenbach wrote:
>
>
> > From one problem that was discussed on IRC earlier today it seems like
> > the 'active/email/???' issue you see might occur in relation to changing
> > details on the LDAP server, which suggests to me that the
> > sync-during-logon might be at fault here. It would be good to get
> > confirmation of that.
>
> Sorry, but I did not change something on the LDAP server in the last
> few days. It also only appeared twice since the update (once affecting
> two users, once affecting only one), so I really don't have any idea
> what triggers this.

Hi Philip,


I'm not suggesting there was a configuration change, but a data value
changed for a user (e.g. a password reset, added to a group, or
something like that which changes the LDAP modification timestamp) which
will cause *that user* to be synced from the LDAP data and at that point
overwrite the old (good) values with rubbish.



> >> An other major problem I have is that the synchronization with the
> >> iPhone does not work properly anymore: Changes made to existing events
> >> are synchronized properly, but new events created with Apple iCal are
> >> not synchronized to an iPhone. Another instance of iCal does receive
> >> these new events, though. Events added with an iPhone are synchronized
> >> to the server and appear on instances of iCal, but disappear from the
> >> iPhone with the next synchronization. Any help appreciated!
> >
> > Do you have the iPhone set to "Sync All Events"? That seems to be the
> > current working setting, which is changed from what once used to work
> > best.
>
> Thank you! That did the trick. Is there anything one can do to help
> you locating the problem with the other settings?

There's no visible difference between the requests made in one mode or
the other, as far as I've been able to find out (though Apple no longer
support upgrading my iPhone, so I don't have access to recent versions
of iOS personally - this is from traces people have sent to me.

So while I think it's quite plausible that the issue is a bug in
DAViCal, without some further information from inside Apple I probably
won't find it. I may get the opportunity to find out more when I am at
the CalConnect interop event in a few weeks.


> > I was recently contacted by an Apple developer and have fixed a bug
> > (post 0.9.9.5) which he advised me of. That fix will be included in
> > 0.9.9.6 that I was hoping to release this week, but it would also be
> > good to receive some fixes to the LDAP bugs you're talking about here.
>
> Maybe you could release 0.9.9.6 with the small database changes I
> pointed out above. If the problem would reoccur one would at least
> have an error message.

I'll certainly be releasing 0.9.9.6 this week, and including fixes for
the LDAP is basically what that is currently waiting on. The LDAP
driver people are working hard on it as I write this e-mail and I'm sure
they'll sort it out soon.


> >> During my testing, the following errors appeared in the error-log
> >> (don't know if they are related):
> >>> davical: ***: ERROR:Could not recognize timezone "GMT +0100
> >> (Standard) / GMT +0200 (Daylight)" - will use floating time
> >> This error appeared quite often. I think it only appeared since the
> >> update.
> >
> > This is more of a warning than an error. DAViCal doesn't really care
> > about the timezone of an event, passing the event unmodified to the
> > client. It's more to point out that you have something somewhere
> > creating odd timezones.
>
> Okay, that sounds possible as I have tested several clients over the
> last few years.

Yeah, invitations from Exchange Server are classic for this. There's
some stuff in 0.9.9.6 which will make that particular issue a bit better
too.

Regards,
Andrew.

--
------------------------------------------------------------------------
andrew (AT) morphoss (DOT) com +64(272)DEBIAN
What does "it" mean in the sentence "What time is it?"?
------------------------------------------------------------------------
Re: [Davical-general] 0.9.9.5 regressions [ In reply to ]
On Sep 20, 2011, at 17:39 , Philip Achenbach wrote:
>
> Sorry, but I did not change something on the LDAP server in the last few days. It also only appeared twice since the update (once affecting two users, once affecting only one), so I really don't have any idea what triggers this.


Just to let you know: I have a similar setup (openldap-server), and the usr.active column gets nulled, too. I also didn't find out yet why, but it happens. So I'm also eager on finding a solution.

wolfgang
--
http://www.wogri.com

_______________________________________________
DAViCal-dev mailing list
DAViCal-dev@lists.davical.org
http://lists.davical.org/listinfo/davical-dev
Re: [Davical-general] 0.9.9.5 regressions [ In reply to ]
Hello Andrew,

Am 21.09.2011 um 01:25 schrieb Andrew McMillan:
> On Tue, 2011-09-20 at 17:39 +0200, Philip Achenbach wrote:
>>
>>> From one problem that was discussed on IRC earlier today it seems like
>>> the 'active/email/???' issue you see might occur in relation to changing
>>> details on the LDAP server, which suggests to me that the
>>> sync-during-logon might be at fault here. It would be good to get
>>> confirmation of that.
>>
>> Sorry, but I did not change something on the LDAP server in the last
>> few days. It also only appeared twice since the update (once affecting
>> two users, once affecting only one), so I really don't have any idea
>> what triggers this.
>
> I'm not suggesting there was a configuration change, but a data value
> changed for a user (e.g. a password reset, added to a group, or
> something like that which changes the LDAP modification timestamp) which
> will cause *that user* to be synced from the LDAP data and at that point
> overwrite the old (good) values with rubbish.

Ok, I can confirm this. All the affected users have been modified in LDAP. I have tested it and can reproduce it now. Hopefully the LDAP people will find the bug.

Philip
_______________________________________________
DAViCal-dev mailing list
DAViCal-dev@lists.davical.org
http://lists.davical.org/listinfo/davical-dev
Re: [Davical-general] 0.9.9.5 regressions [ In reply to ]
On Sep 21, 2011, at 01:25 , Andrew McMillan wrote:
>
> Hi Philip,
>
>
> I'm not suggesting there was a configuration change, but a data value
> changed for a user (e.g. a password reset, added to a group, or
> something like that which changes the LDAP modification timestamp) which
> will cause *that user* to be synced from the LDAP data and at that point
> overwrite the old (good) values with rubbish.

that is definitely the case in my setup (nightly update of values in a database which triggers an ldap-update), and thus it's reproducible, usr.acitve gets overwritten.

--
http://www.wogri.com

_______________________________________________
DAViCal-dev mailing list
DAViCal-dev@lists.davical.org
http://lists.davical.org/listinfo/davical-dev