Friday, December 28, 2012

Top 5 Open Source Big Data Technologies to Watch

With more and more work is being put into leveraging the plethora of data we have, a number of technologies have come up and are slowly getting mature. Here is a list of top 5 such technologies you should have a watch on if ever you need any of your workflows to handle huge amounts of data.

  1. Apache Hadoop
    Apache Hadoop is an open source software framework for data-intensive distributed applications originally created by Doug Cutting to support his work on Nutch, an open source Web search engine. To meet Nutch's multimachine processing requirements, Cutting implemented a MapReduce facility and a distributed file system that together became Hadoop. He named it after his son's toy elephant. Through MapReduce, Hadoop distributes Big Data in pieces over a series of nodes running on commodity hardware. Hadoop is now among the most popular technologies for storing the structured, semi-structured and unstructured data that comprise Big Data. Hadoop is available under the Apache License 2.0.

  2. R
    R is an open source programming language and software environment designed for statistical computing and visualization. R was designed by Ross Ihaka and Robert Gentleman at the University of Auckland, New Zealand beginning in 1993 and is rapidly becoming the go-to tool for statistical analysis of very large data sets. It has been commercialized by a company called Revolution Analytics, which is pursuing a services and support model inspired by Red Hat's support for Linux. R is available under the GNU General Public License.

  3. Scribe
    Scribe is a server developed by Facebook and released in 2008. It is intended for aggregating log data streamed in real time from a large number of servers. Facebook designed it to meet its own scaling challenges, and it now uses Scribe to handle tens of billions of messages a day. It is available under the Apache License 2.0.

  4. ElasticSearch
    Developed by Shay Banon and based upon Apache Lucene, ElasticSearch is a distributed, RESTful open source search server. It's a scalable solution that supports near real-time search and multitenancy without a special configuration. It has been adopted by a number of companies, including StumbleUpon and Mozilla. ElasticSearch is available under the Apache License 2.0.

  5. Apache HBase
    Written in Java and modeled after Google's BigTable,Apache HBase is an open source, non-relational columnar distributed database designed to run on top of Hadoop Distributed Filesystem (HDFS). It provides fault-tolerant storage and quick access to large quantities of sparse data. HBase is one of a multitude of NoSQL data stores that have become available in the past several years. In 2010, Facebook adopted HBase to serve its messaging platform. It is available under the Apache License 2.0.

7 comments:

  1. phong lực cuồng bạo . Trên tay gã trọng kỵ binh , kỵ thương tỏa ra hàn quang lạnh lẽo kèm theo những luồng đấu khí vàng nhạt , cho dù bây giờ có đối mặt với bức tường dày đảm bảo nó cũng xuyên qua được .
    Trước khí thế đó , Diệp Âm Trúc không cử động chút nào , hải nguyệt thanh huy cầm vẫn giữ ở khuỷu tay , ánh mắt thản nhiên nhìn Ai lý khắc mẫn long đang lao đến , thái độ đấy của hắn đã khiến rất nhiều đệ tử vũ kỹ bộ phỏng đoán chủ tướng thần âm hệ đã hoàn toàn choáng trước long kỵ binh .đồng tâm
    game mu
    cho thuê nhà trọ
    cho thuê phòng trọ
    nhac san cuc manh
    số điện thoại tư vấn pháp luật miễn phí
    văn phòng luật
    tổng đài tư vấn pháp luật
    dịch vụ thành lập công ty trọn gói
    http://we-cooking.com/
    chém gió
    “ Oong “ . Diệp Âm Trúc rốt cuộc cũng đã động thủ , ngay khi Ai lý khắc mẫn long còn cách hắn mười thước thì hữu thủ hắn lướt trên cầm huyền ( dây đàn ) , bạo âm trong nháy mắt phát ra . Bạo âm ở khoảng cách càng gần thì uy lực càng lớn , Diệp Âm Trúc sử dụng khi đối thủ áp sát vào mình , cho nên hiệu quả sẽ cực kì cao .
    Lực phòng ngự công kích vật lý của trọng kỵ binh so với ma pháp sư tuy cao hơn nhiều nhưng tinh thần phòng ngự lại vô cùng yếu ớt . Bạo âm chợt xuất hiện khiến cho cả hoàng cấp ma

    ReplyDelete
  2. awsome piece of information, I had come to know about your website from my friend vinod, indore,i have read atleast seven posts of yours by now, and let me tell you, your blog gives the best and the most interesting information. This is just the kind of information that i had been looking for, i'm already your rss reader now and i would regularly watch out for the new posts, once again hats off to you! Thanks a ton once again, Regards, Best Friend Quotes and provide more information on the bigdata technologies

    ReplyDelete
  3. REALLY VERY EXCELLENT INFORMATION. I AM VERY GLAD TO SEE YOUR BLOG FOR THIS INFORMATION. THANKS FOR SHARING. KEEP UPDATING.

    NO.1 AQM Services | Application Quality Managment Services | Austere Technologies

    ReplyDelete

Any feedback, good or bad is most welcome.

Name

Email *

Message *