Mailing List Archive: Heartbeat 0.4.5 released

Heartbeat 0.4.5 released

alanr at bell-labs

Oct 13, 1999, 12:08 AM

Post #1 of 13 (5668 views)

Hi,

Heartbeat 0.4.5 is now officially relased. Here's the highlights:

Added strong packet authentication, restart via SIGHUP (or -r flag), serial port
locking, run time memory usage reporting, enhanced and cleaned up logging, made
startup and shutdown cleaner, allow the user to (optionally) specify which
interface will take over a given IP address instead of inferring it from the
route table. Fixed the only known bug of any significance, and a couple of
others never reported for good measure.

Generally, a ton of good things were added. Thanks to everyone who contributed
bug fixes, testing, and feature code. The detailed changelog entry for this
release is at the end of this mail.

This release looks pretty good from my testing. Let me know what you find out.
You'll find it here:
http://linux-ha.org/download/

You'll have to upgrade all the nodes in pretty much in a flash cut because of
the authentication stuff. On the other hand, this release will make this easier
to do because of the restart capability.

Thanks!

-- Alan Robertson
alanr@bell-labs.com

+ Mijta Sarp added a new feature to authenticate heartbeat packets
using a variety of strong authentication techniques
+ Changed resource acquisition and relinquishment to occur in heartbeat,
instead of in the start/stop script. This means you don't *really*
have to use the start/stop script if you don't want to.
+ Added -k option to gracefully shut down current heartbeat instance
+ Added -r option to cause currently running heartbeat to reread config files
+ Added -s option to report on operational status of "heartbeat"
+ Sped up resource acquisition on master restart.
+ Added validation of ipresources file at startup time.
+ Added code to allow the IPaddr takeover script to be given the
interface to take over, instead of inferring it. This was requested
by Lars Marowsky-Bree
+ Incorporated patch from Guenther Thomsen to implement locking for
serial ports used for heartbeats
+ Incorporated patch from Guenther Thomsen to clean up logging.
(you can now use syslog and/or file logs)
+ Improved FreeBSD compatibility.
+ Fixed a bug where the FIFO doesn't get created correctly.
+ Fixed a couple of uninitialized variables in heartbeat and /proc/ha code
+ Fixed longstanding crash bug related to getting a SIGALRM while in malloc
or free.
+ Implemented new memory management scheme, including memory stats

Heartbeat 0.4.5 released [ In reply to ]

alanr at bell-labs

Oct 13, 1999, 12:08 AM

Post #2 of 13 (5608 views)

Hi,

Heartbeat 0.4.5 is now officially relased. Here's the highlights:

Added strong packet authentication, restart via SIGHUP (or -r flag), serial port
locking, run time memory usage reporting, enhanced and cleaned up logging, made
startup and shutdown cleaner, allow the user to (optionally) specify which
interface will take over a given IP address instead of inferring it from the
route table. Fixed the only known bug of any significance, and a couple of
others never reported for good measure.

Generally, a ton of good things were added. Thanks to everyone who contributed
bug fixes, testing, and feature code. The detailed changelog entry for this
release is at the end of this mail.

This release looks pretty good from my testing. Let me know what you find out.
You'll find it here:
http://linux-ha.org/download/

You'll have to upgrade all the nodes in pretty much in a flash cut because of
the authentication stuff. On the other hand, this release will make this easier
to do because of the restart capability.

Thanks!

-- Alan Robertson
alanr@bell-labs.com

+ Mijta Sarp added a new feature to authenticate heartbeat packets
using a variety of strong authentication techniques
+ Changed resource acquisition and relinquishment to occur in heartbeat,
instead of in the start/stop script. This means you don't *really*
have to use the start/stop script if you don't want to.
+ Added -k option to gracefully shut down current heartbeat instance
+ Added -r option to cause currently running heartbeat to reread config files
+ Added -s option to report on operational status of "heartbeat"
+ Sped up resource acquisition on master restart.
+ Added validation of ipresources file at startup time.
+ Added code to allow the IPaddr takeover script to be given the
interface to take over, instead of inferring it. This was requested
by Lars Marowsky-Bree
+ Incorporated patch from Guenther Thomsen to implement locking for
serial ports used for heartbeats
+ Incorporated patch from Guenther Thomsen to clean up logging.
(you can now use syslog and/or file logs)
+ Improved FreeBSD compatibility.
+ Fixed a bug where the FIFO doesn't get created correctly.
+ Fixed a couple of uninitialized variables in heartbeat and /proc/ha code
+ Fixed longstanding crash bug related to getting a SIGALRM while in malloc
or free.
+ Implemented new memory management scheme, including memory stats

Heartbeat 0.4.5 released [ In reply to ]

alanr at bell-labs

Oct 13, 1999, 12:08 AM

Post #3 of 13 (5655 views)

Hi,

Heartbeat 0.4.5 is now officially relased. Here's the highlights:

Added strong packet authentication, restart via SIGHUP (or -r flag), serial port
locking, run time memory usage reporting, enhanced and cleaned up logging, made
startup and shutdown cleaner, allow the user to (optionally) specify which
interface will take over a given IP address instead of inferring it from the
route table. Fixed the only known bug of any significance, and a couple of
others never reported for good measure.

Generally, a ton of good things were added. Thanks to everyone who contributed
bug fixes, testing, and feature code. The detailed changelog entry for this
release is at the end of this mail.

This release looks pretty good from my testing. Let me know what you find out.
You'll find it here:
http://linux-ha.org/download/

You'll have to upgrade all the nodes in pretty much in a flash cut because of
the authentication stuff. On the other hand, this release will make this easier
to do because of the restart capability.

Thanks!

-- Alan Robertson
alanr@bell-labs.com

+ Mijta Sarp added a new feature to authenticate heartbeat packets
using a variety of strong authentication techniques
+ Changed resource acquisition and relinquishment to occur in heartbeat,
instead of in the start/stop script. This means you don't *really*
have to use the start/stop script if you don't want to.
+ Added -k option to gracefully shut down current heartbeat instance
+ Added -r option to cause currently running heartbeat to reread config files
+ Added -s option to report on operational status of "heartbeat"
+ Sped up resource acquisition on master restart.
+ Added validation of ipresources file at startup time.
+ Added code to allow the IPaddr takeover script to be given the
interface to take over, instead of inferring it. This was requested
by Lars Marowsky-Bree
+ Incorporated patch from Guenther Thomsen to implement locking for
serial ports used for heartbeats
+ Incorporated patch from Guenther Thomsen to clean up logging.
(you can now use syslog and/or file logs)
+ Improved FreeBSD compatibility.
+ Fixed a bug where the FIFO doesn't get created correctly.
+ Fixed a couple of uninitialized variables in heartbeat and /proc/ha code
+ Fixed longstanding crash bug related to getting a SIGALRM while in malloc
or free.
+ Implemented new memory management scheme, including memory stats

Heartbeat 0.4.5 released [ In reply to ]

alanr at bell-labs

Oct 13, 1999, 12:08 AM

Post #4 of 13 (5612 views)

Hi,

Heartbeat 0.4.5 is now officially relased. Here's the highlights:

Added strong packet authentication, restart via SIGHUP (or -r flag), serial port
locking, run time memory usage reporting, enhanced and cleaned up logging, made
startup and shutdown cleaner, allow the user to (optionally) specify which
interface will take over a given IP address instead of inferring it from the
route table. Fixed the only known bug of any significance, and a couple of
others never reported for good measure.

Generally, a ton of good things were added. Thanks to everyone who contributed
bug fixes, testing, and feature code. The detailed changelog entry for this
release is at the end of this mail.

This release looks pretty good from my testing. Let me know what you find out.
You'll find it here:
http://linux-ha.org/download/

You'll have to upgrade all the nodes in pretty much in a flash cut because of
the authentication stuff. On the other hand, this release will make this easier
to do because of the restart capability.

Thanks!

-- Alan Robertson
alanr@bell-labs.com

+ Mijta Sarp added a new feature to authenticate heartbeat packets
using a variety of strong authentication techniques
+ Changed resource acquisition and relinquishment to occur in heartbeat,
instead of in the start/stop script. This means you don't *really*
have to use the start/stop script if you don't want to.
+ Added -k option to gracefully shut down current heartbeat instance
+ Added -r option to cause currently running heartbeat to reread config files
+ Added -s option to report on operational status of "heartbeat"
+ Sped up resource acquisition on master restart.
+ Added validation of ipresources file at startup time.
+ Added code to allow the IPaddr takeover script to be given the
interface to take over, instead of inferring it. This was requested
by Lars Marowsky-Bree
+ Incorporated patch from Guenther Thomsen to implement locking for
serial ports used for heartbeats
+ Incorporated patch from Guenther Thomsen to clean up logging.
(you can now use syslog and/or file logs)
+ Improved FreeBSD compatibility.
+ Fixed a bug where the FIFO doesn't get created correctly.
+ Fixed a couple of uninitialized variables in heartbeat and /proc/ha code
+ Fixed longstanding crash bug related to getting a SIGALRM while in malloc
or free.
+ Implemented new memory management scheme, including memory stats

Heartbeat 0.4.5 released [ In reply to ]

alanr at bell-labs

Oct 13, 1999, 12:08 AM

Post #5 of 13 (5621 views)

Hi,

Heartbeat 0.4.5 is now officially relased. Here's the highlights:

Added strong packet authentication, restart via SIGHUP (or -r flag), serial port
locking, run time memory usage reporting, enhanced and cleaned up logging, made
startup and shutdown cleaner, allow the user to (optionally) specify which
interface will take over a given IP address instead of inferring it from the
route table. Fixed the only known bug of any significance, and a couple of
others never reported for good measure.

Generally, a ton of good things were added. Thanks to everyone who contributed
bug fixes, testing, and feature code. The detailed changelog entry for this
release is at the end of this mail.

This release looks pretty good from my testing. Let me know what you find out.
You'll find it here:
http://linux-ha.org/download/

You'll have to upgrade all the nodes in pretty much in a flash cut because of
the authentication stuff. On the other hand, this release will make this easier
to do because of the restart capability.

Thanks!

-- Alan Robertson
alanr@bell-labs.com

+ Mijta Sarp added a new feature to authenticate heartbeat packets
using a variety of strong authentication techniques
+ Changed resource acquisition and relinquishment to occur in heartbeat,
instead of in the start/stop script. This means you don't *really*
have to use the start/stop script if you don't want to.
+ Added -k option to gracefully shut down current heartbeat instance
+ Added -r option to cause currently running heartbeat to reread config files
+ Added -s option to report on operational status of "heartbeat"
+ Sped up resource acquisition on master restart.
+ Added validation of ipresources file at startup time.
+ Added code to allow the IPaddr takeover script to be given the
interface to take over, instead of inferring it. This was requested
by Lars Marowsky-Bree
+ Incorporated patch from Guenther Thomsen to implement locking for
serial ports used for heartbeats
+ Incorporated patch from Guenther Thomsen to clean up logging.
(you can now use syslog and/or file logs)
+ Improved FreeBSD compatibility.
+ Fixed a bug where the FIFO doesn't get created correctly.
+ Fixed a couple of uninitialized variables in heartbeat and /proc/ha code
+ Fixed longstanding crash bug related to getting a SIGALRM while in malloc
or free.
+ Implemented new memory management scheme, including memory stats

Heartbeat 0.4.5 released [ In reply to ]

alanr at bell-labs

Oct 13, 1999, 12:08 AM

Post #6 of 13 (5613 views)

Hi,

Heartbeat 0.4.5 is now officially relased. Here's the highlights:

Added strong packet authentication, restart via SIGHUP (or -r flag), serial port
locking, run time memory usage reporting, enhanced and cleaned up logging, made
startup and shutdown cleaner, allow the user to (optionally) specify which
interface will take over a given IP address instead of inferring it from the
route table. Fixed the only known bug of any significance, and a couple of
others never reported for good measure.

Generally, a ton of good things were added. Thanks to everyone who contributed
bug fixes, testing, and feature code. The detailed changelog entry for this
release is at the end of this mail.

This release looks pretty good from my testing. Let me know what you find out.
You'll find it here:
http://linux-ha.org/download/

You'll have to upgrade all the nodes in pretty much in a flash cut because of
the authentication stuff. On the other hand, this release will make this easier
to do because of the restart capability.

Thanks!

-- Alan Robertson
alanr@bell-labs.com

+ Mijta Sarp added a new feature to authenticate heartbeat packets
using a variety of strong authentication techniques
+ Changed resource acquisition and relinquishment to occur in heartbeat,
instead of in the start/stop script. This means you don't *really*
have to use the start/stop script if you don't want to.
+ Added -k option to gracefully shut down current heartbeat instance
+ Added -r option to cause currently running heartbeat to reread config files
+ Added -s option to report on operational status of "heartbeat"
+ Sped up resource acquisition on master restart.
+ Added validation of ipresources file at startup time.
+ Added code to allow the IPaddr takeover script to be given the
interface to take over, instead of inferring it. This was requested
by Lars Marowsky-Bree
+ Incorporated patch from Guenther Thomsen to implement locking for
serial ports used for heartbeats
+ Incorporated patch from Guenther Thomsen to clean up logging.
(you can now use syslog and/or file logs)
+ Improved FreeBSD compatibility.
+ Fixed a bug where the FIFO doesn't get created correctly.
+ Fixed a couple of uninitialized variables in heartbeat and /proc/ha code
+ Fixed longstanding crash bug related to getting a SIGALRM while in malloc
or free.
+ Implemented new memory management scheme, including memory stats

Heartbeat 0.4.5 released [ In reply to ]

alanr at bell-labs

Oct 13, 1999, 12:08 AM

Post #7 of 13 (5606 views)

Hi,

Heartbeat 0.4.5 is now officially relased. Here's the highlights:

Added strong packet authentication, restart via SIGHUP (or -r flag), serial port
locking, run time memory usage reporting, enhanced and cleaned up logging, made
startup and shutdown cleaner, allow the user to (optionally) specify which
interface will take over a given IP address instead of inferring it from the
route table. Fixed the only known bug of any significance, and a couple of
others never reported for good measure.

Generally, a ton of good things were added. Thanks to everyone who contributed
bug fixes, testing, and feature code. The detailed changelog entry for this
release is at the end of this mail.

This release looks pretty good from my testing. Let me know what you find out.
You'll find it here:
http://linux-ha.org/download/

You'll have to upgrade all the nodes in pretty much in a flash cut because of
the authentication stuff. On the other hand, this release will make this easier
to do because of the restart capability.

Thanks!

-- Alan Robertson
alanr@bell-labs.com

+ Mijta Sarp added a new feature to authenticate heartbeat packets
using a variety of strong authentication techniques
+ Changed resource acquisition and relinquishment to occur in heartbeat,
instead of in the start/stop script. This means you don't *really*
have to use the start/stop script if you don't want to.
+ Added -k option to gracefully shut down current heartbeat instance
+ Added -r option to cause currently running heartbeat to reread config files
+ Added -s option to report on operational status of "heartbeat"
+ Sped up resource acquisition on master restart.
+ Added validation of ipresources file at startup time.
+ Added code to allow the IPaddr takeover script to be given the
interface to take over, instead of inferring it. This was requested
by Lars Marowsky-Bree
+ Incorporated patch from Guenther Thomsen to implement locking for
serial ports used for heartbeats
+ Incorporated patch from Guenther Thomsen to clean up logging.
(you can now use syslog and/or file logs)
+ Improved FreeBSD compatibility.
+ Fixed a bug where the FIFO doesn't get created correctly.
+ Fixed a couple of uninitialized variables in heartbeat and /proc/ha code
+ Fixed longstanding crash bug related to getting a SIGALRM while in malloc
or free.
+ Implemented new memory management scheme, including memory stats

Heartbeat 0.4.5 released [ In reply to ]

alanr at bell-labs

Oct 13, 1999, 12:08 AM

Post #8 of 13 (5607 views)

Hi,

Heartbeat 0.4.5 is now officially relased. Here's the highlights:

Added strong packet authentication, restart via SIGHUP (or -r flag), serial port
locking, run time memory usage reporting, enhanced and cleaned up logging, made
startup and shutdown cleaner, allow the user to (optionally) specify which
interface will take over a given IP address instead of inferring it from the
route table. Fixed the only known bug of any significance, and a couple of
others never reported for good measure.

Generally, a ton of good things were added. Thanks to everyone who contributed
bug fixes, testing, and feature code. The detailed changelog entry for this
release is at the end of this mail.

This release looks pretty good from my testing. Let me know what you find out.
You'll find it here:
http://linux-ha.org/download/

You'll have to upgrade all the nodes in pretty much in a flash cut because of
the authentication stuff. On the other hand, this release will make this easier
to do because of the restart capability.

Thanks!

-- Alan Robertson
alanr@bell-labs.com

+ Mijta Sarp added a new feature to authenticate heartbeat packets
using a variety of strong authentication techniques
+ Changed resource acquisition and relinquishment to occur in heartbeat,
instead of in the start/stop script. This means you don't *really*
have to use the start/stop script if you don't want to.
+ Added -k option to gracefully shut down current heartbeat instance
+ Added -r option to cause currently running heartbeat to reread config files
+ Added -s option to report on operational status of "heartbeat"
+ Sped up resource acquisition on master restart.
+ Added validation of ipresources file at startup time.
+ Added code to allow the IPaddr takeover script to be given the
interface to take over, instead of inferring it. This was requested
by Lars Marowsky-Bree
+ Incorporated patch from Guenther Thomsen to implement locking for
serial ports used for heartbeats
+ Incorporated patch from Guenther Thomsen to clean up logging.
(you can now use syslog and/or file logs)
+ Improved FreeBSD compatibility.
+ Fixed a bug where the FIFO doesn't get created correctly.
+ Fixed a couple of uninitialized variables in heartbeat and /proc/ha code
+ Fixed longstanding crash bug related to getting a SIGALRM while in malloc
or free.
+ Implemented new memory management scheme, including memory stats

Heartbeat 0.4.5 released [ In reply to ]

alanr at bell-labs

Oct 13, 1999, 12:08 AM

Post #9 of 13 (5610 views)

Hi,

Heartbeat 0.4.5 is now officially relased. Here's the highlights:

Added strong packet authentication, restart via SIGHUP (or -r flag), serial port
locking, run time memory usage reporting, enhanced and cleaned up logging, made
startup and shutdown cleaner, allow the user to (optionally) specify which
interface will take over a given IP address instead of inferring it from the
route table. Fixed the only known bug of any significance, and a couple of
others never reported for good measure.

Generally, a ton of good things were added. Thanks to everyone who contributed
bug fixes, testing, and feature code. The detailed changelog entry for this
release is at the end of this mail.

This release looks pretty good from my testing. Let me know what you find out.
You'll find it here:
http://linux-ha.org/download/

You'll have to upgrade all the nodes in pretty much in a flash cut because of
the authentication stuff. On the other hand, this release will make this easier
to do because of the restart capability.

Thanks!

-- Alan Robertson
alanr@bell-labs.com

+ Mijta Sarp added a new feature to authenticate heartbeat packets
using a variety of strong authentication techniques
+ Changed resource acquisition and relinquishment to occur in heartbeat,
instead of in the start/stop script. This means you don't *really*
have to use the start/stop script if you don't want to.
+ Added -k option to gracefully shut down current heartbeat instance
+ Added -r option to cause currently running heartbeat to reread config files
+ Added -s option to report on operational status of "heartbeat"
+ Sped up resource acquisition on master restart.
+ Added validation of ipresources file at startup time.
+ Added code to allow the IPaddr takeover script to be given the
interface to take over, instead of inferring it. This was requested
by Lars Marowsky-Bree
+ Incorporated patch from Guenther Thomsen to implement locking for
serial ports used for heartbeats
+ Incorporated patch from Guenther Thomsen to clean up logging.
(you can now use syslog and/or file logs)
+ Improved FreeBSD compatibility.
+ Fixed a bug where the FIFO doesn't get created correctly.
+ Fixed a couple of uninitialized variables in heartbeat and /proc/ha code
+ Fixed longstanding crash bug related to getting a SIGALRM while in malloc
or free.
+ Implemented new memory management scheme, including memory stats

Heartbeat 0.4.5 released [ In reply to ]

Oct 14, 1999, 9:12 AM

Post #10 of 13 (5648 views)

Hi,
On Wed, Oct 13, 1999 at 01:08:23AM -0600, Alan Robertson wrote:
> Hi,
>
>
> This release looks pretty good from my testing. Let me know what you find out.

Some comments/questions.

1. Are the examples in the haresources file are correct ?.
The example shows at first the ip address and then the scripts
(192.168.1.1 http named ....), i thought it must be
http named 192.168.1.1
to get the scripts started after the address takeover ?

2. In the changelog is an entry telling that it is now possible to
specify an interface on which the address should run, but i can't
find an example on the syntax...

3. The ha.o module is still not active in the heasrtbeat script

Thomas
--
-----------------------------------------------
| Thomas Hepper th@ant.han.de |
| ( If the above address fail try ) |
| ( thomas.hepper@planet-interkom.de) |
-----------------------------------------------

Heartbeat 0.4.5 released [ In reply to ]

alanr at bell-labs

Oct 14, 1999, 10:43 AM

Post #11 of 13 (5639 views)

Thomas Hepper wrote:
>
> Hi,
> On Wed, Oct 13, 1999 at 01:08:23AM -0600, Alan Robertson wrote:
> > Hi,
> >
> >
> > This release looks pretty good from my testing. Let me know what you find out.
>
> Some comments/questions.
>
> 1. Are the examples in the haresources file are correct ?.
> The example shows at first the ip address and then the scripts
> (192.168.1.1 http named ....), i thought it must be
> http named 192.168.1.1
> to get the scripts started after the address takeover ?

I tend to start things before the HA address takeover. Maybe that's a
bad idea...

I wasn't completely sure what the right order is. I suspect that this
will all be clearer with time...

> 2. In the changelog is an entry telling that it is now possible to
> specify an interface on which the address should run, but i can't
> find an example on the syntax...

It's a secret :-)

ip-address/mask-bits/interface{/broadcast-addr}

The last part is optional.
>
> 3. The ha.o module is still not active in the heasrtbeat script

I thought I changed that. I keep hoping Volker will send me some new
code...

-- Alan R.

Heartbeat 0.4.5 released [ In reply to ]

Oct 15, 1999, 1:24 PM

Post #12 of 13 (5653 views)

Hi,
On Wed, Oct 13, 1999 at 01:08:23AM -0600, Alan Robertson wrote:
> Hi,
>
> Heartbeat 0.4.5 is now officially relased. Here's the highlights:
>
>
> This release looks pretty good from my testing. Let me know what you find out.

Next point/question. I have a setup with 2 network cards in each node.
In the ha.cf file both interfaces are defined for the heartbeat, but
with tcpdump i can only see packets on one interface. The output in
the log files say that it is starting heartbeat on eth0 and eth1.

Some special things needed for this setup ?

Thomas
--
-----------------------------------------------
| Thomas Hepper th@ant.han.de |
| ( If the above address fail try ) |
| ( thomas.hepper@planet-interkom.de) |
-----------------------------------------------

Heartbeat 0.4.5 released [ In reply to ]

alanr at bell-labs

Oct 16, 1999, 3:00 AM

Post #13 of 13 (5664 views)

Thomas Hepper wrote:
>
> Hi,
> On Wed, Oct 13, 1999 at 01:08:23AM -0600, Alan Robertson wrote:
> > Hi,
> >
> > Heartbeat 0.4.5 is now officially relased. Here's the highlights:
> >
> >
> > This release looks pretty good from my testing. Let me know what you find out.
>
> Next point/question. I have a setup with 2 network cards in each node.
> In the ha.cf file both interfaces are defined for the heartbeat, but
> with tcpdump i can only see packets on one interface. The output in
> the log files say that it is starting heartbeat on eth0 and eth1.
>
> Some special things needed for this setup ?

No. The code should work as best I understand it. I haven't tested it with
tcpdump, or a sniffer. Can you tell which interface it's coming out of?

This sounds like a bug to me. If so, it's probably always been there. The new
release probably didn't break anything new there.

Three possibilities come to mind:

A) I'm not distributing the heartbeat packets to every write process.
Each media interface has a read and a write process. If I'm not sending
it to every write process, then they have no chance to write it out.

The way to tell if this is what's happening is:
send a SIGUSR2 to any process except for the first one.
This will give you the list of processes, and what they do on the
debug-log.

The write processes should be created in the same order you specified them
in the config file. Give the one you suspect of not writing about
six SIGUSR1 signals in a row. As I recall, this will crank the debug level
up to the point it should be dumping packet contents to the debug log.
If you don't see any packets going into the log, then I'm not writing
to it's pipe.

B) I'm distributing the heartbeat packets to each write process, but for some
reason it's not trying to write them to the interface, or (more likely)
something is wrong in the way it binds to the interface, so they either
don't come out at all, or routing is applied, and they all come out the
same interface. The current code tries HARD to make sure that
code tries hard to bind to the interface you specified, but maybe it isn't
doing it quite right...

C) None of the above :-)

-- Alan Robertson
alanr@bell-labs.com