Ah.. I tried MongoDB: The insert rates i got were pathetic. ~3k for MongoDB vs ~11k for PostgreSQL (w/out fsync). Yes i tried every rule in the book, but a run time of > 2 days for 400 million inserts was not doable. PostgreSQL < 12 hours was acceptable. This test included scripts in sed/awk and a python based inserter to both datastores. whoislogger=# select last_value from whois_logs2_id_seq;select pg_sleep(60); select last_value from whois_logs2_id_seq; last_value ------------ 202353081 (1 row) pg_sleep ---------- (1 row) last_value ------------ 202990585 (1 row) over 650k inserts/min So you see with proper tuning, I can get PostgreSQL to do better insert rates than MongoDB.. with all the benefits of PostgreSQL and standard sql. MongoDB is webscale! PS: Whatever you do, DO NOT STORE YOUR SENSITIVE DATA IN MongoDB. Logs are ok, banking data/e-commerce transactions are not. Read this: http://ivoras.sharanet.org/blog/tree/2009-11-05.a-short-time-with-mongodb.ht... and watch this: http://www.xtranormal.com/watch/6995033/ On Wed, Nov 24, 2010 at 10:38 AM, Ndungi Kyalo <ndungi@gmail.com> wrote:
Hi David,
You have a nice online resource (tutorial, writeup, review etc) that ties the 3 (mongodb, json and pure) up together ? I've scratched the surfae on IBM's Lotus and couchdb and I think the whole idea behind document-based/key-value db's are revolutionary.
On 22 November 2010 16:57, David Njuguna <dnjuguna@gmail.com> wrote:
Check this out, design your database without tables using mongodb, create a web backend that sends a HTML template and a JSON document then template on the browser using PURE Anyone else looking into heading this direction please spread the gospel.
D _______________________________________________ Skunkworks mailing list Skunkworks@lists.my.co.ke http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------ Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke
_______________________________________________ Skunkworks mailing list Skunkworks@lists.my.co.ke http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------ Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke