Mailing List Archive

On Mon, Dec 1, 2008 at 7:29 AM, Nikola Smolenski <smolensk@eunet.yu> wrote:
> On Monday 01 December 2008 04:09:11 Robert Rohde wrote:
>> On Sun, Nov 30, 2008 at 6:16 PM, Neil Harris <usenet@tonal.clara.co.uk>
> wrote:
>> > Is the data replicated anywhere outside the Tampa data centre (such as
>> > in Amsterdam or Seoul)? If not, just one fire, flood or hurricane could
>> > destroy the entire en: Wikipedia.
>>
>> There are database mirrors of every wiki, including en, as part of the
>> toolserver cluster in Amsterdam.
>
> Unfortunately, enwiki mirror doesn't include article text :(
>
>
Are you sure about that? Last time I checked the text databases were
shared between all wikimedia project and thus replicated all at once
or not at all.


Bryan

_______________________________________________
foundation-l mailing list
foundation-l@lists.wikimedia.org
Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/foundation-l

2008/12/1 Bryan Tong Minh <bryan.tongminh@gmail.com>:
> On Mon, Dec 1, 2008 at 7:29 AM, Nikola Smolenski <smolensk@eunet.yu> wrote:
>> On Monday 01 December 2008 04:09:11 Robert Rohde wrote:
>>> On Sun, Nov 30, 2008 at 6:16 PM, Neil Harris <usenet@tonal.clara.co.uk>
>> wrote:
>>> > Is the data replicated anywhere outside the Tampa data centre (such as
>>> > in Amsterdam or Seoul)? If not, just one fire, flood or hurricane could
>>> > destroy the entire en: Wikipedia.
>>>
>>> There are database mirrors of every wiki, including en, as part of the
>>> toolserver cluster in Amsterdam.
>>
>> Unfortunately, enwiki mirror doesn't include article text :(
>>
>>
> Are you sure about that? Last time I checked the text databases were
> shared between all wikimedia project and thus replicated all at once
> or not at all.
>
>
> Bryan

http://upload.wikimedia.org/wikipedia/commons/f/ff/Wikimedia-servers-2008-11-10.svg
is a good picture of it. If I'm interpreting it correctly:

* There are the "database servers" running MySQL, which store
metadata. These are split into clusters (en on 1; de + commons +
possibly others on 2; others on 3). I believe these are all located in
Florida.
* These databases (i.e. only metadata) are replicated for the
Toolserver machines located in Amsterdam.
* The actaul wikitext is stored on Apache servers, again I think these
are all in Florida. They are not split into clusters like the database
servers AFAICT.
* There are squids - caching servers - located in Florida, Korea and
Amsterdam (these are not the same as the toolserver machines).

So in other words the whole wikitext for all wikis is not backed up
anywhere except in database dumps. Scary.

the wub

_______________________________________________
foundation-l mailing list
foundation-l@lists.wikimedia.org
Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/foundation-l

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Nathan wrote:
> Wow, someone had more than 10,000 edits in February of 2002.

That's probably "Conversion script". :)

- -- brion
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.8 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org

iEYEARECAAYFAkk0WRoACgkQwRnhpk1wk45UngCfdUkZa1wV8zskTs6kvdADgyyX
SjgAni2hvsPi5h3XbkXaUF5QtmWLKULD
=Dahu
-----END PGP SIGNATURE-----

_______________________________________________
foundation-l mailing list
foundation-l@lists.wikimedia.org
Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/foundation-l

On Mon, Dec 1, 2008 at 6:04 PM, the wub <thewub.wiki@googlemail.com> wrote:

> So in other words the whole wikitext for all wikis is not backed up
> anywhere except in database dumps. Scary.
>
That's not true. There is a wikitext backup on the toolserver cluster.
And as you state they are not divided into clusters they should
contain the text of all wikis.

Bryan

_______________________________________________
foundation-l mailing list
foundation-l@lists.wikimedia.org
Unsubscribe: https://lists.wikimedia.org/mailman/listinfo/foundation-l