Hive is a data warehouse system for Hadoop that facilitates easy data summarization, ad-hoc queries, and the analysis of large datasets stored in Hadoop compatible file systems. Hive provides a mechanism to project structure onto this data and query the data using a SQL-like language called HiveQL. At the same time this language also allows traditional map/reduce programmers to plug in their custom mappers and reducers when it is inconvenient or inefficient to express this logic in HiveQL.

Apache Pig is a platform for analyzing large data sets that consists of a high-level language for expressing data analysis programs, coupled with infrastructure for evaluating these programs. The salient property of Pig programs is that their structure is amenable to substantial parallelization, which in turns enables them to handle very large data sets.

merge data, crawl web data, then chart and explore it

The 70 Online Databases That Define Our Planet - Technology Review

download and go!

a data architecture flame war begins - excellent!

good to see more people discussing this. as a long time sql developer but also a skeptic when needed, we need to admit that it's not always the best solution.

sql or sqllite database for organizing and importing email

davenport

Web db and interface development for almost mere mortals.