"With this tool you can play with the Data Export API by building queries to get data from your Google Analytics profiles. You can use these queries in any of the client libraries to build your own tools."

"Google-Analytics-export-to-CSV is a simple, command-line tool for exporting data out of Google Analytics and writing it to a CSV file." It uses the Google Data API, so you can actually extract more columns and rows using this than GA's built-in web export tools.

"Welcome to the URLTeam website. The URLTeam is the ArchiveTeam subcommittee on URL shorteners. We believe that they pose a serious threat to the internet's integrity. If one of them dies, gets hacked or sells out, millions of links will stop working. Thus we preemptively release backups, because URL shorteners are too busy to make backups themselves."

yet another "real time" data clean-up tool.

"D3 allows you to bind arbitrary data to a Document Object Model (DOM), and then apply data-driven transformations to the document. As a trivial example, you can use D3 to generate a basic HTML table from an array of numbers. Or, use the same data to create an interactive SVG bar chart with smooth transitions and interaction."

"Google Refine is a power tool for working with messy data, cleaning it up, transforming it from one format into another, extending it with web services, and linking it to databases like Freebase."

"Client/server software, human language dictionary databases, and tools supporting the DICT protocol (RFC 2229)."

"MystiQ is a system that uses a probabilistic data model to find answers in large numbers of data sources exhibiting various kinds of imprecisions."

"DASe (Digital Archive Services) is a lightweight digital asset repository."

"I have a confession to make - I am an open data junkie. When the Guardian newspaper in the UK released a comprehensive set of FIFA Worldcup 2010 statistics, I got itchy fingers and wanted to find the story in that set of data. What better to use for this than YQL (Yahoo! Query Language)?"

"I have released the following datasets for non-commerical research purposes, under a Creative Commons license (refer below). The data for most of the social sites were collected through crawlers that were based on the respective APIs, or via HTML parsers (written by me). "

"MessagePack is a binary-based efficient object serialization library. It enables to exchange structured objects between many languages like JSON. But unlike JSON, it is very fast and small."

"citeulike is a free service for managing and discovering scholarly references"

indeed

"Real-time feed parsing in the cloud. Why build a complex feed fetching and parsing infrastructure when you could just use Superfeedr?"

Clever way to get a data about a location via a photo

I agree that, as of right now, FBML is a scary, under-specified, bag of hurt. I wish I could find myself surprised that the Facebook developer base is happily using it, but... I can't.

"MindNode Pro and MindNode are elegant and simple-to-use mindmapping applications for the Macintosh that help to visually collect, classify and structure ideas & organize, study and solve problems."

"You keep personal data in all sorts of places on the internets. Jellyroll brings them together onto your own site"

"Crowbar is a web scraping environment based on the use of a server-side headless mozilla-based browser. Its purpose is to allow running javascript scrapers against a DOM to automate web sites scraping but avoiding all the syntax normalization issues."

That this project exists demonstrates just how bad the nature of data exports are in the blog software world.

"An open source web crawling and screen scraping framework written in Python." Pure gold.

"Every month Opera conducts a definitive analysis of the key trends affecting the mobile Web worldwide. We publish these findings as the State of the Mobile Web. Each report provides the most frequently visited sites, key data metrics from Opera Mini and a snapshot of a specific trend chosen by the analysis team that month."

<q> element usage

"The API returns official NYTimes.com tags that match your search string. Even better, it ranks the results from most commonly used tags to least."

Effective use of YUI, JSON, XHR, etc.

A study of HTML syntax usage via sampling the web. Think of it as an update to the Google web authoring report from a couple of years ago.

"We use sequential large-scale crawl data to empirically investigate and validate the dynamics that underlie the evolution of the structure of the web. We find that the overall structure of the web is defined by an intricate interplay between experience or entitlement of the pages (as measured by the number of inbound hyperlinks a page already has), inherent talent or fitness of the pages (as measured by the likelihood that someone visiting the page would give a hyperlink to it), and the continual high rates of birth and death of pages on the web. We find that the web is conservative in judging talent and the overall fitness distribution is exponential, showing low variability."

"We revisit a problem introduced by Bharat and Broder almost a decade ago: how to sample random pages from a search engine’s index using only the search engine’s public interface? Such a primitive is particularly useful in creating objective benchmarks for search engines."

On the fence about this right now... but feed consumers have to do something. I was wrestling with similar issues when spec'ing out a system to collect feeds (yes, millions per hour) for an internal linguistics project... in the current environment HTTP If-Modified-Since just isn't enough.

"ELIE is a tool for adaptive information extraction from text. It also provides a number of other text processing tools e.g. POS tagging, chunking, gazetteer, stemming."

European Molecular Biology Laboratory

Standards for the description and exchange of aggregations of Web resources. These aggregations, sometimes called compound digital objects, may combine distributed resources with multiple media types including text, images, data, and video.

"AtomServer is a generic data store implemented as a REST-ful web service." Hooray!