Hortonworks, a competitor of Cloudera, is in the Hadoop space and just closed a round of $100 million. This comes after Cloudera closed a round of $160 million. This hadoop space is new to me, I am stumbling poorly along it with my new search engine called Konfound.

It’s all about “Big Data”…

If you aren’t familiar with what Hadoop is, and I wasn’t until a few years ago when I wanted to first launch a search engine, it is basically a framework of tools to manipulate large data sets and allows you to span groups of computers to facilitate processing. Cassandra, what I believe is a superior database, is capable of handling hundreds of terabytes of data across hundreds of machines and there is no single point of failure.

I would like to get WordPress to switch to Cassandra and it become the standard for self-hosting solutions as MySQL is so centralized by default that a single hiccup in the system can cause everything to just stop in its tracks. That is my personal, simplistic view of its use.

For the search engine, I am planning to span multiple servers as data develops and processing burdens a single server. Everything is bootstrapped, so things move slow.

Sources:

http://gigaom.com/2014/03/24/hortonworks-raises-100m-to-scale-its-hadoop-business/

http://blogs.wsj.com/venturecapital/2014/03/18/cloudera-raises-160-million-from-t-rowe-price-other-public-market-investors/

http://gigaom.com/2014/03/18/cloudera-raises-160-million-for-its-big-data-platform/