On Wed, Nov 24, 2010 at 7:10 PM, Erick Njenga <eriknjenga@gmail.com> wrote:
@laban. what were your server specs??
Both PG and Mongo sat on the same server. Well a VM: * 2 GHz Quad Core * 2 GB RAM # vgs VG #PV #LV #SN Attr VSize VFree nosqlstore 1 1 0 wz--n- 100.00g 0 /dev/mapper/nosqlstore-lvol0 on /mnt/data type xfs (rw,noatime,logbufs=8) # uname -a Linux mongodb 2.6.32-5-amd64 #1 SMP Fri Sep 17 21:50:19 UTC 2010 x86_64 GNU/Linux and the LVM volume is a virtio block device
On Wed, Nov 24, 2010 at 6:06 PM, Laban Mwangi <lmwangi@gmail.com> wrote:
Ah.. I tried MongoDB:
The insert rates i got were pathetic. ~3k for MongoDB vs ~11k for PostgreSQL (w/out fsync). Yes i tried every rule in the book, but a run time of > 2 days for 400 million inserts was not doable. PostgreSQL < 12 hours was acceptable.
This test included scripts in sed/awk and a python based inserter to both datastores.
whoislogger=# select last_value from whois_logs2_id_seq;select pg_sleep(60); select last_value from whois_logs2_id_seq; last_value ------------ 202353081 (1 row)
pg_sleep ----------
(1 row)
last_value ------------ 202990585 (1 row)
over 650k inserts/min
So you see with proper tuning, I can get PostgreSQL to do better insert rates than MongoDB.. with all the benefits of PostgreSQL and standard sql.
MongoDB is webscale!
PS: Whatever you do, DO NOT STORE YOUR SENSITIVE DATA IN MongoDB. Logs are ok, banking data/e-commerce transactions are not.
Read this: http://ivoras.sharanet.org/blog/tree/2009-11-05.a-short-time-with-mongodb.ht... and watch this: http://www.xtranormal.com/watch/6995033/
On Wed, Nov 24, 2010 at 10:38 AM, Ndungi Kyalo <ndungi@gmail.com> wrote:
Hi David,
You have a nice online resource (tutorial, writeup, review etc) that ties the 3 (mongodb, json and pure) up together ? I've scratched the surfae on IBM's Lotus and couchdb and I think the whole idea behind document-based/key-value db's are revolutionary.
On 22 November 2010 16:57, David Njuguna <dnjuguna@gmail.com> wrote:
Check this out, design your database without tables using mongodb,
create
a web backend that sends a HTML template and a JSON document then template on the browser using PURE Anyone else looking into heading this direction please spread the gospel.
D _______________________________________________ Skunkworks mailing list Skunkworks@lists.my.co.ke http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------ Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke
_______________________________________________ Skunkworks mailing list Skunkworks@lists.my.co.ke http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------ Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke
_______________________________________________ Skunkworks mailing list Skunkworks@lists.my.co.ke http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------ Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke
--
Thanks and Regards, Erick Njenga Nyachwaya, M: +254-725-008-790
<http://www.facebook.com/ErickNjenga> <http://www.twitter.com/ErickNjenga>
_______________________________________________ Skunkworks mailing list Skunkworks@lists.my.co.ke http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------ Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke