Mailing List Archive

BackPlane Database ?
Hi,

In a recent interview with Matt Dillon of the DragonFlyBsd project on OsNews
on of his other projects was mentioned as well : BackPlane Fault-Tolerant
Distributed RDMS

The idea from what i can gather with this project is to create a scalable
(for lack of a better word) unkillable fast database server that can be
easily plugged into other programs.

This project would help alot with a whole lot of the problems that people
have with DBMail ( DB Redundancy, Issues with DB Replication Engines ) if of
course it can be plugged into DBMail and its free...

There are docs on its C API at :
http://www.backplane.com/docs.shtml?doc=1

The only problems i have see so far is :

Only one datatype is implemented, 'varchar'. In otherwords, everything is a
string.

We do not support UNIQUE

( more info at : http://www.backplane.com/docs.shtml?doc=2 )

Comments ?

P
Re: BackPlane Database ? [ In reply to ]
There's another project out there that, although not specifically targetted
towards fault tolerance, adresses some of those same issues:

http://sqlrelay.sourceforge.net/

Incidentally, only implementing the varchar datatype isn't as much of a
problem as you might think; right now, all results come back as char arrays
and any numerical types need to be converted using atoi, strtoull, etc.

Aaron


""Patrick"" <patrick@xsinet.com> said:

> Hi,
>
> In a recent interview with Matt Dillon of the DragonFlyBsd project on OsNews
> on of his other projects was mentioned as well : BackPlane Fault-Tolerant
> Distributed RDMS
>
> The idea from what i can gather with this project is to create a scalable
> (for lack of a better word) unkillable fast database server that can be
> easily plugged into other programs.
>
> This project would help alot with a whole lot of the problems that people
> have with DBMail ( DB Redundancy, Issues with DB Replication Engines ) if of
> course it can be plugged into DBMail and its free...
>
> There are docs on its C API at :
> http://www.backplane.com/docs.shtml?doc=1
>
> The only problems i have see so far is :
>
> Only one datatype is implemented, 'varchar'. In otherwords, everything is a
> string.
>
> We do not support UNIQUE
>
> ( more info at : http://www.backplane.com/docs.shtml?doc=2 )
>
> Comments ?
>
> P
>
> _______________________________________________
> Dbmail-dev mailing list
> Dbmail-dev@dbmail.org
> http://twister.fastxs.net/mailman/listinfo/dbmail-dev
>



--
Re: BackPlane Database ? [ In reply to ]
All,

I am with arron on this one, I have been looking to implement a sqlrelay
interface for a while now, the benifit of it is that it gives us an easy
migration to other RDBM's such as oracle, which is relatively hard to
code natively for. As Aaron pointed out it also solves some if not all of
the load balancing and redundancy issues we are facing in a large scale
implementation of dbmail. With the right options in my tests against the
dbmail schema in mysql it shows little to no performance hit. Except for
the way it caches the result sets.

-leif


> There's another project out there that, although not specifically
> targetted
> towards fault tolerance, adresses some of those same issues:
>
> http://sqlrelay.sourceforge.net/
>
> Incidentally, only implementing the varchar datatype isn't as much of a
> problem as you might think; right now, all results come back as char
> arrays
> and any numerical types need to be converted using atoi, strtoull, etc.
>
> Aaron
>
>
> ""Patrick"" <patrick@xsinet.com> said:
>
>> Hi,
>>
>> In a recent interview with Matt Dillon of the DragonFlyBsd project on
>> OsNews
>> on of his other projects was mentioned as well : BackPlane
>> Fault-Tolerant
>> Distributed RDMS
>>
>> The idea from what i can gather with this project is to create a
>> scalable
>> (for lack of a better word) unkillable fast database server that can be
>> easily plugged into other programs.
>>
>> This project would help alot with a whole lot of the problems that
>> people
>> have with DBMail ( DB Redundancy, Issues with DB Replication Engines )
>> if of
>> course it can be plugged into DBMail and its free...
>>
>> There are docs on its C API at :
>> http://www.backplane.com/docs.shtml?doc=1
>>
>> The only problems i have see so far is :
>>
>> Only one datatype is implemented, 'varchar'. In otherwords, everything
>> is a
>> string.
>>
>> We do not support UNIQUE
>>
>> ( more info at : http://www.backplane.com/docs.shtml?doc=2 )
>>
>> Comments ?
>>
>> P
>>
>> _______________________________________________
>> Dbmail-dev mailing list
>> Dbmail-dev@dbmail.org
>> http://twister.fastxs.net/mailman/listinfo/dbmail-dev
>>
>
>
>
> --
>
>
>
> _______________________________________________
> Dbmail-dev mailing list
> Dbmail-dev@dbmail.org
> http://twister.fastxs.net/mailman/listinfo/dbmail-dev
>
Re: BackPlane Database ? [ In reply to ]
SQLRelay takes care of load balancing and fail over, and also gives a very
good abstraction layer with such goodies as variable binding (which may be
able to help us escape the escaping and quoting concerns we have now).

What it won't help with is *redundancy* for which we'll need to design better
schemas that are able to handle insertions to multiple copies of the database
without needing to have a single "key master" to keep it all consistent.

Aaron


""Leif Jackson"" <ljackson@jjcons.com> said:

> All,
>
> I am with arron on this one, I have been looking to implement a sqlrelay
> interface for a while now, the benifit of it is that it gives us an easy
> migration to other RDBM's such as oracle, which is relatively hard to
> code natively for. As Aaron pointed out it also solves some if not all of
> the load balancing and redundancy issues we are facing in a large scale
> implementation of dbmail. With the right options in my tests against the
> dbmail schema in mysql it shows little to no performance hit. Except for
> the way it caches the result sets.
>
> -leif
>
>
> > There's another project out there that, although not specifically
> > targetted
> > towards fault tolerance, adresses some of those same issues:
> >
> > http://sqlrelay.sourceforge.net/
> >
> > Incidentally, only implementing the varchar datatype isn't as much of a
> > problem as you might think; right now, all results come back as char
> > arrays
> > and any numerical types need to be converted using atoi, strtoull, etc.
> >
> > Aaron
> >
> >
> > ""Patrick"" <patrick@xsinet.com> said:
> >
> >> Hi,
> >>
> >> In a recent interview with Matt Dillon of the DragonFlyBsd project on
> >> OsNews
> >> on of his other projects was mentioned as well : BackPlane
> >> Fault-Tolerant
> >> Distributed RDMS
> >>
> >> The idea from what i can gather with this project is to create a
> >> scalable
> >> (for lack of a better word) unkillable fast database server that can be
> >> easily plugged into other programs.
> >>
> >> This project would help alot with a whole lot of the problems that
> >> people
> >> have with DBMail ( DB Redundancy, Issues with DB Replication Engines )
> >> if of
> >> course it can be plugged into DBMail and its free...
> >>
> >> There are docs on its C API at :
> >> http://www.backplane.com/docs.shtml?doc=1
> >>
> >> The only problems i have see so far is :
> >>
> >> Only one datatype is implemented, 'varchar'. In otherwords, everything
> >> is a
> >> string.
> >>
> >> We do not support UNIQUE
> >>
> >> ( more info at : http://www.backplane.com/docs.shtml?doc=2 )
> >>
> >> Comments ?
> >>
> >> P
> >>
> >> _______________________________________________
> >> Dbmail-dev mailing list
> >> Dbmail-dev@dbmail.org
> >> http://twister.fastxs.net/mailman/listinfo/dbmail-dev
> >>
> >
> >
> >
> > --
> >
> >
> >
> > _______________________________________________
> > Dbmail-dev mailing list
> > Dbmail-dev@dbmail.org
> > http://twister.fastxs.net/mailman/listinfo/dbmail-dev
> >
>
> _______________________________________________
> Dbmail-dev mailing list
> Dbmail-dev@dbmail.org
> http://twister.fastxs.net/mailman/listinfo/dbmail-dev
>



--
Re: BackPlane Database ? [ In reply to ]
Haai,

This is a major problem with most 'redundant' database based systems as far
as i understand it ... When i looked as sql relay it didnt seem to do
anything natively with the database. And considering i havent used it much i
wouldnt be able to yay or nay it. The stuff in the white papers about
backplane seem to be rather advanced and seem to fix alot of my personal
gripes with running a system such as DBMail. Redundancy in a mail system was
a really big thing for me considering that the biggest part of the internet
from an isp/companys point of view is E-Mail and downtime is not always an
option.

Another one of the features that i would think would be rather usefull would
be the SNAPShots ( for backup purposes ) I currently backup a mail
filesystem with XFSDump which is nice and allows me to make file system
snapshots. But this is not the ultimate solution in a large system because
of the nature of E-Mail in those enviroments.

Would adding SQL Relay not add another possible point of failure ? I know
with systems like portfwd and suchlike they arent created to handle high
loads of traffic or mass ammounts of threading ( as i say again i havent
used SQL Relay :) ) ?

Comments ?

P

----- Original Message -----
From: "Aaron Stone" <aaron@serendipity.palo-alto.ca.us>
To: "DBMAIL Developers Mailinglist" <dbmail-dev@dbmail.org>
Sent: Wednesday, March 17, 2004 9:11 PM
Subject: Re: [Dbmail-dev] BackPlane Database ?


| SQLRelay takes care of load balancing and fail over, and also gives a very
| good abstraction layer with such goodies as variable binding (which may be
| able to help us escape the escaping and quoting concerns we have now).
|
| What it won't help with is *redundancy* for which we'll need to design
better
| schemas that are able to handle insertions to multiple copies of the
database
| without needing to have a single "key master" to keep it all consistent.
|
| Aaron
|
|
| ""Leif Jackson"" <ljackson@jjcons.com> said:
|
| > All,
| >
| > I am with arron on this one, I have been looking to implement a
sqlrelay
| > interface for a while now, the benifit of it is that it gives us an easy
| > migration to other RDBM's such as oracle, which is relatively hard to
| > code natively for. As Aaron pointed out it also solves some if not all
of
| > the load balancing and redundancy issues we are facing in a large scale
| > implementation of dbmail. With the right options in my tests against the
| > dbmail schema in mysql it shows little to no performance hit. Except for
| > the way it caches the result sets.
| >
| > -leif
| >
| >
| > > There's another project out there that, although not specifically
| > > targetted
| > > towards fault tolerance, adresses some of those same issues:
| > >
| > > http://sqlrelay.sourceforge.net/
| > >
| > > Incidentally, only implementing the varchar datatype isn't as much of
a
| > > problem as you might think; right now, all results come back as char
| > > arrays
| > > and any numerical types need to be converted using atoi, strtoull,
etc.
| > >
| > > Aaron
| > >
| > >
| > > ""Patrick"" <patrick@xsinet.com> said:
| > >
| > >> Hi,
| > >>
| > >> In a recent interview with Matt Dillon of the DragonFlyBsd project on
| > >> OsNews
| > >> on of his other projects was mentioned as well : BackPlane
| > >> Fault-Tolerant
| > >> Distributed RDMS
| > >>
| > >> The idea from what i can gather with this project is to create a
| > >> scalable
| > >> (for lack of a better word) unkillable fast database server that can
be
| > >> easily plugged into other programs.
| > >>
| > >> This project would help alot with a whole lot of the problems that
| > >> people
| > >> have with DBMail ( DB Redundancy, Issues with DB Replication
Engines )
| > >> if of
| > >> course it can be plugged into DBMail and its free...
| > >>
| > >> There are docs on its C API at :
| > >> http://www.backplane.com/docs.shtml?doc=1
| > >>
| > >> The only problems i have see so far is :
| > >>
| > >> Only one datatype is implemented, 'varchar'. In otherwords,
everything
| > >> is a
| > >> string.
| > >>
| > >> We do not support UNIQUE
| > >>
| > >> ( more info at : http://www.backplane.com/docs.shtml?doc=2 )
| > >>
| > >> Comments ?
| > >>
| > >> P
| > >>
| > >> _______________________________________________
| > >> Dbmail-dev mailing list
| > >> Dbmail-dev@dbmail.org
| > >> http://twister.fastxs.net/mailman/listinfo/dbmail-dev
| > >>
| > >
| > >
| > >
| > > --
| > >
| > >
| > >
| > > _______________________________________________
| > > Dbmail-dev mailing list
| > > Dbmail-dev@dbmail.org
| > > http://twister.fastxs.net/mailman/listinfo/dbmail-dev
| > >
| >
| > _______________________________________________
| > Dbmail-dev mailing list
| > Dbmail-dev@dbmail.org
| > http://twister.fastxs.net/mailman/listinfo/dbmail-dev
| >
|
|
|
| --
|
|
|
| _______________________________________________
| Dbmail-dev mailing list
| Dbmail-dev@dbmail.org
| http://twister.fastxs.net/mailman/listinfo/dbmail-dev
|
|