Article: How Big Are Porn Sites?

April 5, 2012

http://m.extremetech.com/extremetech/#!/entry/just-how-big-are-porn-sites,4f7c818f01c2d48e1e00396b/5

YouPorn hosts âover 100TB of pornâ, and serves âover 100 millionâ page views per day. All told, this equates to an average of 950 terabytes of data transfer per day, almost all of which is streaming video.

It gets better! At peak time, YouPorn serves 4000 pages per second, equating to burst traffic in the region of 100 gigabytes per second, or 800Gbps. This is equivalent to transferring more than 10 dual-layer DVDs every second.

On the software-side of things, YouPornâs primary data store is 100% Redis, with MySQL used as an admin tool to manage and add data to the Redis cluster. The site used to be primarily programmed in Perl with a MySQL backend, but in 2011 Perl was switched out for PHP and MySQL replaced with Redis. Nginx acts as the HTTP server, with both HAProxy and Varnish both used to load balance.

The Redis server deals with 300,000 queries per second, and between 8-15GB of data is logged every hour (visitor logs, behavior data, and so on). Weâre told that this software stack should be capable of scaling up to 200 million views per day.

Follow

Get every new post delivered to your Inbox.

Join 46 other followers