Mailing List Archive

Re: mysql & xen - is anyone using this combinationsuccessfully?
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Ian Pratt wrote, On 24/05/05 13:54:
>
>
>>I'm beginning to wonder whether it's safe to use mysql on xen
>>in a live environment.
>
>
> We've tended to do our testing with PostgreSQL, but we obviously want
> mysql to work perfectly too.
>
> Are you just running with the glibc tls disabled? If so, its possible
> that its an incompatibility with the old thread library that it falls
> back to.

I'm using gentoo, and have specifically excluded the "nptl" USE flag to
prevent the new thread handling. I have no tls directory under /lib, so I
guess this is working (?)

>
> The best soloution is to install a 'xen friendly' glibc for your
> installation. What distro are you running?
>
> The othe ralternative is to not disable tls by mv'ing the directory out
> the way, but to leave it active. You'll get some loss of performance,
> but it should be executed correctly.
>
> Another interesting datapoint would be to try the unstable.bk tree. It's
> still a bit 'raw', but providing you're just using the features present
> in 2.x its actually pretty stable.
>
> If anyone has a simple recipe for deterministically provoking this issue
> it would be good to know.

FWIW, my setup here has involved several machines a couple of "live" ones
basically used to hold transient data in a queue, a development box and a
reporting server containing large volumes of log records - mostly used for
queries.

It's the reporting server which had the data corruption, and the two queue
handlers which have experienced the segvs.

The queue handlers are running on identical boxes (IBM e325s over scsi), and
the reporting server on a generic system over SATA, if this helps.

The queue handlers have both had the segv, but at different times. They're in
a round-robin carrying much the same traffic. I guess this means the problem
is going to be difficult to reproduce :-(

>
> Best,
> Ian
>
>

Hope this helps,
Paul.

- --
Paul Laws
Analyst / Programmer
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iD8DBQFClEjJYmQ8biuDK88RAiKzAJ46ALzxjd+jqMmsve4XMJi/PpEAhgCfWs9Q
f9qKuhOJh4MKPXuX2lBdBSA=
=TMDL
-----END PGP SIGNATURE-----

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Re: mysql & xen - is anyone using this combinationsuccessfully? [ In reply to ]
> I'm using gentoo, and have specifically excluded the "nptl" USE flag to
> prevent the new thread handling. I have no tls directory under /lib, so I
> guess this is working (?)

There's also a gcc flag for emitting direct TLS references directly in the
code (the TLS library does this, which is why we disable it). The gcc flag
is "-mno-tls-direct-seg-refs". Could this be your problem? Does
recompiling, with no-tls-direct-seg-refs help?

Cheers,
Mark

> > The best soloution is to install a 'xen friendly' glibc for your
> > installation. What distro are you running?
> >
> > The othe ralternative is to not disable tls by mv'ing the directory out
> > the way, but to leave it active. You'll get some loss of performance,
> > but it should be executed correctly.
> >
> > Another interesting datapoint would be to try the unstable.bk tree. It's
> > still a bit 'raw', but providing you're just using the features present
> > in 2.x its actually pretty stable.
> >
> > If anyone has a simple recipe for deterministically provoking this issue
> > it would be good to know.
>
> FWIW, my setup here has involved several machines a couple of "live" ones
> basically used to hold transient data in a queue, a development box and a
> reporting server containing large volumes of log records - mostly used for
> queries.
>
> It's the reporting server which had the data corruption, and the two queue
> handlers which have experienced the segvs.
>
> The queue handlers are running on identical boxes (IBM e325s over scsi),
> and the reporting server on a generic system over SATA, if this helps.
>
> The queue handlers have both had the segv, but at different times. They're
> in a round-robin carrying much the same traffic. I guess this means the
> problem is going to be difficult to reproduce :-(
>
> > Best,
> > Ian
>
> Hope this helps,
> Paul.

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Re: mysql & xen - is anyone using this combinationsuccessfully? [ In reply to ]
> Would I have to use this when compiling gcc or when compiling mysql? (FWIW
> I get the segv with both with a native mysql compilation under gentoo, and
> with the precompiled (statically linked) binaries from mysql)

In this case, when compiling MySQL (although, in general, when compiling
everything - there are a few other packages (OOo, for instance) which break
otherwise).

Another thing you could do is compile Xen itself with more debugging
information and see if it's complaining about any errors when MySQL crashes:
cd $(XENROOT)/xen/
make debug=y verbose=y
cp xen.gz /boot/xen-2.0.gz # or whatever you called it

I think we've had this problem on Gentoo before - can anyone confirm / deny?

Cheers,
Mark

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Re: mysql & xen - is anyone using this combinationsuccessfully? [ In reply to ]
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Mark Williamson wrote, On 25/05/05 10:54:
>>I'm using gentoo, and have specifically excluded the "nptl" USE flag to
>>prevent the new thread handling. I have no tls directory under /lib, so I
>>guess this is working (?)
>
>
> There's also a gcc flag for emitting direct TLS references directly in the
> code (the TLS library does this, which is why we disable it). The gcc flag
> is "-mno-tls-direct-seg-refs". Could this be your problem? Does
> recompiling, with no-tls-direct-seg-refs help?
>
> Cheers,
> Mark
>

Would I have to use this when compiling gcc or when compiling mysql? (FWIW I
get the segv with both with a native mysql compilation under gentoo, and with
the precompiled (statically linked) binaries from mysql)

[snip]

- --
Paul Laws
Analyst / Programmer
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iD8DBQFClFgyYmQ8biuDK88RAj7LAJ4sj7PCNaTui3F8tDOULqhgwX25FwCg3/vm
RvX6kjG9sYuWWE71YII/Tkw=
=MnfZ
-----END PGP SIGNATURE-----

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Re: RE: mysql & xen - is anyone using this combinationsuccessfully? [ In reply to ]
M.A. Williamson wrote:
>> Getting a problem here with OpenLDAP, also using Berkeley DB....
>>
>> Xen testing / 2.6.11 kernel
>
>
> What distro are you on? Maybe your Berkeley DB is tickling the same
> issue for some reason.
>

Debian Sarge.


--

-Barry Flanagan

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Re: RE: mysql & xen - is anyone using this combinationsuccessfully? [ In reply to ]
> Debian Sarge.

Hrrmmm strange. I asked because we occasionally get problems with Gentoo
systems USE flags, since for some packages gcc wants to emit certain TLS
manipulations that won't work.

How does it die on your system? Does "xm dmesg" tell you anything useful?
What about with a debug/verbose build of Xen?

Cheers,
Mark
(who has now fixed his system clock!)

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Re: mysql & xen - is anyone using this combinationsuccessfully? [ In reply to ]
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1


Mark Williamson wrote, On 25/05/05 11:03:
>>Would I have to use this when compiling gcc or when compiling mysql? (FWIW
>>I get the segv with both with a native mysql compilation under gentoo, and
>>with the precompiled (statically linked) binaries from mysql)
>
>
> In this case, when compiling MySQL (although, in general, when compiling
> everything - there are a few other packages (OOo, for instance) which break
> otherwise).

I'll give this a compile when I can - hopefully soon.

>
> Another thing you could do is compile Xen itself with more debugging
> information and see if it's complaining about any errors when MySQL crashes:
> cd $(XENROOT)/xen/
> make debug=y verbose=y
> cp xen.gz /boot/xen-2.0.gz # or whatever you called it
>
> I think we've had this problem on Gentoo before - can anyone confirm / deny?
>
> Cheers,
> Mark
>
>

- --
Paul Laws
Analyst / Programmer

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iD8DBQFClYYqYmQ8biuDK88RAu89AJ9eVvBAEE09hYLPdjfnva6yd7L5NQCggwsG
llRz+QhF7tQSBPip0g5CbEs=
=f6xV
-----END PGP SIGNATURE-----

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users
Re: mysql & xen - is anyone using this combinationsuccessfully? [ In reply to ]
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Paul Laws wrote, On 25/05/05 11:49:
> Mark Williamson wrote, On 25/05/05 10:54:
>
>>>>I'm using gentoo, and have specifically excluded the "nptl" USE flag to
>>>>prevent the new thread handling. I have no tls directory under /lib, so I
>>>>guess this is working (?)
>>>
>>>
>>>There's also a gcc flag for emitting direct TLS references directly in the
>>>code (the TLS library does this, which is why we disable it). The gcc flag
>>>is "-mno-tls-direct-seg-refs". Could this be your problem? Does
>>>recompiling, with no-tls-direct-seg-refs help?

I get this error from configure when trying this flag:

configure:2693: i686-pc-linux-gnu-gcc -mno-tls-direct-seg-refs
- -DHAVE_ERRNO_AS_DEFINE=1 -DUSE_OLD_FUNCTIONS conftest.c >&5
cc1: error: invalid option `no-tls-direct-seg-refs'

I've checked the gcc info, and the nearest I can find is this:

`-ftls-model=MODEL'
Alter the thread-local storage model to be used (*note
Thread-Local::). The MODEL argument should be one of
`global-dynamic', `local-dynamic', `initial-exec' or `local-exec'.

The default without `-fpic' is `initial-exec'; with `-fpic' the
default is `global-dynamic'.

I'm not using pic.

# gcc --version
gcc (GCC) 3.3.5-20050130 (Gentoo Linux 3.3.5.20050130-r1,
ssp-3.3.5.20050130-1, pie-8.7.7.1)
Copyright (C) 2003 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Any other ideas?

>>>
>>>Cheers,
>>>Mark
>>>
>
>
> Would I have to use this when compiling gcc or when compiling mysql? (FWIW I
> get the segv with both with a native mysql compilation under gentoo, and with
> the precompiled (statically linked) binaries from mysql)
>
> [snip]
>
> --
> Paul Laws
> Analyst / Programmer

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users



- --
Paul Laws
Analyst / Programmer
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.1 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iD8DBQFClYi5YmQ8biuDK88RAoZhAJ9xrL86iGLmIxDcB2qvCFl/M8Gx6wCfZVXX
fccQy4FMMXg7jQ0zn2mrGR8=
=PYl5
-----END PGP SIGNATURE-----

_______________________________________________
Xen-users mailing list
Xen-users@lists.xensource.com
http://lists.xensource.com/xen-users