Excited to announce #WikiHadoop so you can use #Hadoop to analyze the full #Wikipedia dump #wikimedia big thx 2 fellows

An introduction to #aws Elastic MapReduce - slides from the recent #Hadoop User Group meeting:

Yet more graph processing with hadoop: Structural Similarity With Apache Pig #hadoop #pig

Dumbo is a project that allows you to easily write and run Hadoop programs in Python (it’s named after Disney’s flying circus elephant, since the logo of Hadoop is an elephant and Python was named after the BBC series “Monty Python’s Flying Circus”). More generally, Dumbo can be considered to be a convenient Python API for writing MapReduce programs.

"This tutorial will get you started with Cloud9 on Amazon's EC2 (running the simple word count demo). For a gentler introduction to Hadoop, or if you don't feel like experimenting with EC2, try my tutorial on getting started in standalone mode. This tutorial assumes you've already downloaded the libraries and gotten it set up."

"Cloud9 is a MapReduce library for Hadoop designed to serve as both a teaching tool and to support research in data-intensive text processing. MapReduce is a programming model for expressing distributed computations on massive datasets and an execution framework for large-scale data processing on clusters of commodity servers. Hadoop provides an open-source implementation of the programming model. The library itself is available on github and distributed under the Apache License.

For additional details on MapReduce algorithm design, Data-Intensive Text Processing with MapReduce by Lin and Dyer is a good resource. This library also serves as a repository of many examples discussed in the book."

Genotyping from short reads using cloud computing

RT @peteskomoroch: Handy #SQL to #Hadoop #Pig syntax conversion cheat sheet by @criccomini #strataconf #nosql

Nutch is open source web-search software. It builds on Lucene and Solr, adding web-specifics, such as a crawler, a link-graph database, parsers for HTML and other document formats, etc.

Nutch can run on a single machine, but gains a lot of its strength from running in a Hadoop cluster

Cloudera’s Distribution for Apache Hadoop (CDH)

RT @KathrynB @lusciouspear on Scalability, #NoSQL & #Hadoop. Free #strataconf webcast 10am PT today. Join:

RT @mza: Very cool: RT @mike_schatz: Quake: quality-aware correction of sequencing errors #hadoop #genomics

Etsy and Amazon ElasticMapReduce: #aws #hadoop

Hmm. Cloudera and ebay doing a joint webinar next Weds about ebay's use of #hadoop. via @mikeloukides

"Apache Mahout's goal is to build scalable machine learning libraries. "

How GE uses Hadoop to analyze big data - CNET News: #hadoop

One of the most important recent developments in computing is the growth in distributed and parallel applications.
Tutorials
Contributed course content
Hadoop tools and resources
Video lectures

Big Data Workshop (Mtn View, CA: Apr. 23): (HT @marshallk) #nosql #mongodb #hadoop #erlang #mapreduce

RT @sachinrekhi A look at how Twitter uses Hadoop and Pig for its data analysis needs http://bit.ly/4j0u7x

open source Crossbow: "a scalable software pipeline for whole genome resequencing analysis" - http://bit.ly/1p4WAL uses Hadoop #dna #hadoop

Hive is a data warehouse infrastructure built on top of Hadoop that provides tools to enable easy data summarization, adhoc querying and analysis of large datasets data stored in Hadoop files. It provides a mechanism to put structure on this data and it also provides a simple query language called Hive QL which is based on SQL and which enables users familiar with SQL to query this data. At the same time, this language also allows traditional map/reduce programmers to be able to plug in their custom mappers and reducers to do more sophisticated analysis which may not be supported by the built-in capabilities of the language.

Search 21 million pages of trustworthy wine information. - uses hadoop