High Scalability - The WhatsApp Architecture Facebook Bought For $19 Billion

http://highscalability.com/blog/2014/2/26/the-whatsapp-architecture-facebook... "Interesting to note Facebook Chat was written in Erlang in 2009, but they went away from it because it was hard to find qualified programmers." Same year Brian Barton was turned down. Interesting stats 450 million active users, and reached that number faster than any other company in history. 32 engineers, one developer supports 14 million active users 50 billion messages every day across seven platforms (inbound + outbound) 1+ million people sign up every day $0 invested in advertising $8 million investment Hundreds of nodes
8000 cores
Hundreds of terabytes of RAM
70M Erlang messages per second
In 2011 WhatsApp achieved 1 million established tcp sessions on a single machine with memory and cpu to spare. In 2012 that was pushed to over 2 million tcp connections. In 2013 WhatsApp tweeted out: On Dec 31st we had a new record day: 7B msgs inbound, 11B msgs outbound = 18 billion total messages processed in one day! Happy 2013!! ./bernard

And here I am struggling with a database with 500,000 rows, clearly, I don't know s***! On Thu, Feb 27, 2014 at 2:45 AM, Bernard Mwagiru <bmwagiru@gmail.com> wrote:
http://highscalability.com/blog/2014/2/26/the-whatsapp-architecture-facebook...
"Interesting to note Facebook Chat was written in Erlang in 2009, but they went away from it because it was hard to find qualified programmers."
Same year Brian Barton was turned down.
Interesting stats
450 million active users, and reached that number faster than any other company in history.
32 engineers, one developer supports 14 million active users
50 billion messages every day across seven platforms (inbound + outbound)
1+ million people sign up every day
$0 invested in advertising
$8 million investment
Hundreds of nodes
8000 cores
Hundreds of terabytes of RAM
70M Erlang messages per second
In 2011 WhatsApp achieved 1 million established tcp sessions on a single machine with memory and cpu to spare. In 2012 that was pushed to over 2 million tcp connections. In 2013 WhatsApp tweeted out: On Dec 31st we had a new record day: 7B msgs inbound, 11B msgs outbound = 18 billion total messages processed in one day! Happy 2013!!
./bernard
_______________________________________________ skunkworks mailing list skunkworks@lists.my.co.ke ------------ List info, subscribe/unsubscribe http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------
Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke
-- Regards, Peter Karunyu -------------------

Me trying to create a thread for sending 50 msg in 10 seconds. i blame the books. :( On Thu, Feb 27, 2014 at 8:26 AM, Peter Karunyu <pkarunyu@gmail.com> wrote:
And here I am struggling with a database with 500,000 rows, clearly, I don't know s***!
On Thu, Feb 27, 2014 at 2:45 AM, Bernard Mwagiru <bmwagiru@gmail.com>wrote:
http://highscalability.com/blog/2014/2/26/the-whatsapp-architecture-facebook...
"Interesting to note Facebook Chat was written in Erlang in 2009, but they went away from it because it was hard to find qualified programmers."
Same year Brian Barton was turned down.
Interesting stats
450 million active users, and reached that number faster than any other company in history.
32 engineers, one developer supports 14 million active users
50 billion messages every day across seven platforms (inbound + outbound)
1+ million people sign up every day
$0 invested in advertising
$8 million investment
Hundreds of nodes
8000 cores
Hundreds of terabytes of RAM
70M Erlang messages per second
In 2011 WhatsApp achieved 1 million established tcp sessions on a single machine with memory and cpu to spare. In 2012 that was pushed to over 2 million tcp connections. In 2013 WhatsApp tweeted out: On Dec 31st we had a new record day: 7B msgs inbound, 11B msgs outbound = 18 billion total messages processed in one day! Happy 2013!!
./bernard
_______________________________________________ skunkworks mailing list skunkworks@lists.my.co.ke ------------ List info, subscribe/unsubscribe http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------
Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke
-- Regards, Peter Karunyu -------------------
_______________________________________________ skunkworks mailing list skunkworks@lists.my.co.ke ------------ List info, subscribe/unsubscribe http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------
Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke

But Erlang ! What makes you handle so many TPS ? http://blog.whatsapp.com/index.php/2012/01/1-million-is-so-2011/ On 27 February 2014 10:55, Benjamin <anangwe@gmail.com> wrote:
Me trying to create a thread for sending 50 msg in 10 seconds. i blame the books. :(
On Thu, Feb 27, 2014 at 8:26 AM, Peter Karunyu <pkarunyu@gmail.com> wrote:
And here I am struggling with a database with 500,000 rows, clearly, I don't know s***!
On Thu, Feb 27, 2014 at 2:45 AM, Bernard Mwagiru <bmwagiru@gmail.com>wrote:
http://highscalability.com/blog/2014/2/26/the-whatsapp-architecture-facebook...
"Interesting to note Facebook Chat was written in Erlang in 2009, but they went away from it because it was hard to find qualified programmers."
Same year Brian Barton was turned down.
Interesting stats
450 million active users, and reached that number faster than any other company in history.
32 engineers, one developer supports 14 million active users
50 billion messages every day across seven platforms (inbound + outbound)
1+ million people sign up every day
$0 invested in advertising
$8 million investment
Hundreds of nodes
8000 cores
Hundreds of terabytes of RAM
70M Erlang messages per second
In 2011 WhatsApp achieved 1 million established tcp sessions on a single machine with memory and cpu to spare. In 2012 that was pushed to over 2 million tcp connections. In 2013 WhatsApp tweeted out: On Dec 31st we had a new record day: 7B msgs inbound, 11B msgs outbound = 18 billion total messages processed in one day! Happy 2013!!
./bernard
_______________________________________________ skunkworks mailing list skunkworks@lists.my.co.ke ------------ List info, subscribe/unsubscribe http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------
Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke
-- Regards, Peter Karunyu -------------------
_______________________________________________ skunkworks mailing list skunkworks@lists.my.co.ke ------------ List info, subscribe/unsubscribe http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------
Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke
_______________________________________________ skunkworks mailing list skunkworks@lists.my.co.ke ------------ List info, subscribe/unsubscribe http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------
Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke
-- Kind regards, Alex Nyika Omuyonga

Hi Bernard, Thanks for the link, am just amazed by the stats mentioned in the article. High Performance is key for any application. I have always seen that most Developers tend to lean towards meeting user requirements when developing apps and then later forget to finetune their apps to achieve high performamance. This should always be a gradual process. On another note, I think I should now read about Erlang language and see what makes it "powerful". On Thu, Feb 27, 2014 at 2:45 AM, Bernard Mwagiru <bmwagiru@gmail.com> wrote:
http://highscalability.com/blog/2014/2/26/the-whatsapp-architecture-facebook...
"Interesting to note Facebook Chat was written in Erlang in 2009, but they went away from it because it was hard to find qualified programmers."
Same year Brian Barton was turned down.
Interesting stats
450 million active users, and reached that number faster than any other company in history.
32 engineers, one developer supports 14 million active users
50 billion messages every day across seven platforms (inbound + outbound)
1+ million people sign up every day
$0 invested in advertising
$8 million investment
Hundreds of nodes
8000 cores
Hundreds of terabytes of RAM
70M Erlang messages per second
In 2011 WhatsApp achieved 1 million established tcp sessions on a single machine with memory and cpu to spare. In 2012 that was pushed to over 2 million tcp connections. In 2013 WhatsApp tweeted out: On Dec 31st we had a new record day: 7B msgs inbound, 11B msgs outbound = 18 billion total messages processed in one day! Happy 2013!!
./bernard
_______________________________________________ skunkworks mailing list skunkworks@lists.my.co.ke ------------ List info, subscribe/unsubscribe http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------
Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke

anyone with an idea on hosting an own messaging system? am beta testing a cabs app and gcm is driving me crazy! On Thu, Feb 27, 2014 at 11:15 AM, Emmanuel Ochieng < emmanuelochieng797@gmail.com> wrote:
Hi Bernard,
Thanks for the link, am just amazed by the stats mentioned in the article. High Performance is key for any application. I have always seen that most Developers tend to lean towards meeting user requirements when developing apps and then later forget to finetune their apps to achieve high performamance. This should always be a gradual process.
On another note, I think I should now read about Erlang language and see what makes it "powerful".
On Thu, Feb 27, 2014 at 2:45 AM, Bernard Mwagiru <bmwagiru@gmail.com>wrote:
http://highscalability.com/blog/2014/2/26/the-whatsapp-architecture-facebook...
"Interesting to note Facebook Chat was written in Erlang in 2009, but they went away from it because it was hard to find qualified programmers."
Same year Brian Barton was turned down.
Interesting stats
450 million active users, and reached that number faster than any other company in history.
32 engineers, one developer supports 14 million active users
50 billion messages every day across seven platforms (inbound + outbound)
1+ million people sign up every day
$0 invested in advertising
$8 million investment
Hundreds of nodes
8000 cores
Hundreds of terabytes of RAM
70M Erlang messages per second
In 2011 WhatsApp achieved 1 million established tcp sessions on a single machine with memory and cpu to spare. In 2012 that was pushed to over 2 million tcp connections. In 2013 WhatsApp tweeted out: On Dec 31st we had a new record day: 7B msgs inbound, 11B msgs outbound = 18 billion total messages processed in one day! Happy 2013!!
./bernard
_______________________________________________ skunkworks mailing list skunkworks@lists.my.co.ke ------------ List info, subscribe/unsubscribe http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------
Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke
_______________________________________________ skunkworks mailing list skunkworks@lists.my.co.ke ------------ List info, subscribe/unsubscribe http://lists.my.co.ke/cgi-bin/mailman/listinfo/skunkworks ------------
Skunkworks Rules http://my.co.ke/phpbb/viewtopic.php?f=24&t=94 ------------ Other services @ http://my.co.ke
-- Peter Muchemi Software Developer Electra Software Ltd http://www.software.co.ke +254 722 320986
participants (6)
-
Alex Nyika Omuyonga
-
Benjamin
-
Bernard Mwagiru
-
Emmanuel Ochieng
-
Peter Karunyu
-
Peter Muchemi