@laban. what were your server specs??

On Wed, Nov 24, 2010 at 6:06 PM, Laban Mwangi <lmwangi@gmail.com> wrote:

Ah.. I tried MongoDB:

The insert rates i got were pathetic. ~3k for MongoDB vs ~11k for
PostgreSQL (w/out fsync). Yes i tried every rule in the book, but a
run time of > 2 days for 400 million inserts was not doable.
PostgreSQL < 12 hours was acceptable.

This test included scripts in sed/awk and a python based inserter to
both datastores.

whoislogger=# select last_value from whois_logs2_id_seq;select
pg_sleep(60); select last_value from whois_logs2_id_seq;
 last_value
------------
 202353081
(1 row)

pg_sleep
----------

(1 row)

 last_value
------------
 202990585
(1 row)

over 650k inserts/min

So you see with proper tuning, I can get PostgreSQL to do better
insert rates than MongoDB.. with all the benefits of PostgreSQL and
standard sql.

MongoDB is webscale!

PS: Whatever you do, DO NOT STORE YOUR SENSITIVE DATA IN MongoDB. Logs
are ok, banking data/e-commerce transactions are not.

Read this: http://ivoras.sharanet.org/blog/tree/2009-11-05.a-short-time-with-mongodb.html
and watch this: http://www.xtranormal.com/watch/6995033/

On Wed, Nov 24, 2010 at 10:38 AM, Ndungi Kyalo <ndungi@gmail.com> wrote:
> Hi David,
>
> You have a nice online resource (tutorial, writeup, review etc) that ties
> the 3 (mongodb, json and pure) up together ? I've scratched the surfae on
> IBM's Lotus and couchdb and I think the whole idea behind
> document-based/key-value db's are revolutionary.
>
> On 22 November 2010 16:57, David Njuguna <dnjuguna@gmail.com> wrote:
>>
>> Check this out, design your database without tables using mongodb, create
>> a web backend that sends a HTML template and a JSON document then template
>> on the browser using PURE
>> Anyone else looking into heading this direction please spread the gospel.
>>
>> D
>> _______________________________________________
>> Skunkworks mailing list
>> Skunkworks@lists.my.co.ke
>> http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks
>> ------------
>> Skunkworks Rules
>> http://my.co.ke/phpbb/viewtopic.php?f=24&t=94
>> ------------
>> Other services @ http://my.co.ke
>
>
> _______________________________________________
> Skunkworks mailing list
> Skunkworks@lists.my.co.ke
> http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks
> ------------
> Skunkworks Rules
> http://my.co.ke/phpbb/viewtopic.php?f=24&t=94
> ------------
> Other services @ http://my.co.ke
>
_______________________________________________
Skunkworks mailing list
Skunkworks@lists.my.co.ke
http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks
------------
Skunkworks Rules
http://my.co.ke/phpbb/viewtopic.php?f=24&t=94
------------
Other services @ http://my.co.ke

--

Thanks and Regards,
Erick Njenga Nyachwaya,

M: +254-725-008-790

_______________________________________________
Skunkworks mailing list
Skunkworks@lists.my.co.ke
http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks
------------
Skunkworks Rules
http://my.co.ke/phpbb/viewtopic.php?f=24&t=94
------------
Other services @ http://my.co.ke