Pinboard: bookmarks for sogrady tagged 'scalability'

large scale data analytics, indexing and search...as a service. spoke with Bradford a week or two ago, and as i told him, this is an interesting proposition. as more folks realize the need for big data processing, the value of such services only goes up.

cloud database databases hadoop scalability scaling hbase drawntoscale from delicious
march 2010 by sogrady

copy to mine

Cassandra @ Twitter: An Interview with Ryan King « MyNoSQL

details on Twitter's migration from MySQL to Cassandra

twitter mysql nosql cassandra scalability
march 2010 by sogrady

copy to mine

Canned Platypus » Blog Archive » Getting Silly About NoSQL

a rebuttal to Forbes' anti-NoSQL rant

nosql dennisforbes sql scaling scalability mysql rdbms
march 2010 by sogrady

copy to mine

Dennis Forbes on Software and Technology - Getting Real about NoSQL and the SQL-Isn't-Scalable Lie

what is essentially an anti-NoSQL rant

nosql dennisforbes sql scaling scalability mysql rdbms
march 2010 by sogrady

copy to mine

Amazon S3 plugin for WordPress : tan tan noodles – msg free since 2005

this is pretty interesting, if you serve static assets from your wordpress instance

amazon s3 plugins wordpress scalability
december 2009 by sogrady

copy to mine

Recommendation against Python? - Unladen Swallow | Google Groups

interesting, if unsurprising, commentary on the role of Python w/in Google

google java programming python performance scalability architecture c++ via:rafe
november 2009 by sogrady

copy to mine

Comparing Mongo DB and Couch DB - MongoDB

Mongo compares itself to Couch: two next generation database options

couchdb mongodb database cloud performance development scalability sysadmin nosql comparisons
november 2009 by sogrady

copy to mine

Dynamo: A flawed architecture - Part I « Joydeep Sen Sarma’s blog

pushback to Dynamo

dynamo amazon scalability architecture distributed computing scaling nosql key-value eventual consistency
november 2009 by sogrady

copy to mine

Github Migration Architecture | Anchor Web Hosting Blog

how Github planned for its migration

github migration architecture anchor infrastructure scalability cluster
october 2009 by sogrady

copy to mine

Digg the Blog » Blog Archive » Looking to the future with Cassandra

where are we going after databases? Cassandra is one answer popping up more and more

digg database performance cassandra nosql architecture hashtable scalability key-value
september 2009 by sogrady

copy to mine

Back to the Future for Data Storage

really excellent piece by Joe that summarizes far more succinctly than I ever have the rapidly evolving database options beyond the one-size-fits-all relational approach.

joegregorio programming hypertable couchdb simpledb databases distributed relational scalability cloudcomputing bigtable gae
february 2009 by sogrady

copy to mine

The New MySQL Landscape (by Jeremy Zawodny)

really interesting look at the current ySQL landscape by one who knows it well, and has a lot of history in it

jeremyzawodny mysql drizzle development database scalability percona opensource
december 2008 by sogrady

copy to mine

Dare Obasanjo aka Carnage4Life - Windows Azure from a Developer's Perspective

one perspective on Azure

windows web software saas microsoft cloud azure rest programming platform scalability
november 2008 by sogrady

copy to mine

What Ray Ozzie didn't tell you about Microsoft Azure • The Register

another perspective on Azure

services scalability programming news microsoft google lockin complexity simple amazon azure
november 2008 by sogrady

copy to mine

Paper tigers and hidden dragons » Untangled

"The point is that you don’t need to change technologies (or even interaction styles) to solve a problem of information transfer efficiency. Sometimes you just need to rethink the problem. There are many systems for which a different architecture is far more efficient, just as XMPP is far more efficient than HTTP for something like group chat. Large-scale collaborative monitoring is not one of them. An XMPP solution is far more applicable to peer-to-peer monitoring, where there is no central service that is interested in the entire state of a big site like Flickr, but even then we have to keep in mind that the economics of the crowd will dictate scalability, not the protocol used for information transfer."

royfielding xmpp http web software scalability pubsub scaling notification messaging performance
september 2008 by sogrady

copy to mine

Welcome to HBase!

interesting.

apache appengine big bigtable cluster clustering couchdb data database hadoop hbase distributed scalability
july 2008 by sogrady

copy to mine

Let the microblogs bloom - RussellBeattie.com

"It's a great effort, looks good....Evan...did a great job creating a nice little project with some cool features like OpenID, Jabber support and the beginnings of a federation system. Looking at the code, however, it's doomed."

russellbeattie twitter microblogging architecture scalability scaling development programming laconica identica via:luis
july 2008 by sogrady

copy to mine

SmugBlog: Don MacAskill » Blog Archive » SkyNet Lives! (aka EC2 @ SmugMug)

"I really don’t want to operate datacenters anymore despite the fact that we’re pretty good at it. It’s a necessary evil because we’re an Internet company, but our mission is to be the best photo sharing site." - Skynet = their GAE abstraction lay

donmacaskill ec2 amazon scalability smugmug s3 aws architecture cloud skynet
june 2008 by sogrady

copy to mine

Twitter Blog: It's Not Rocket Science, But It's Our Work

Twitter's got nothing to be ashamed of, in my view. yes, their architecture is ill conceived and poorly thought out, but so it has been for most of the startups i've know. their transparency here does them credit, IMO.

twitter community future scalability
june 2008 by sogrady

copy to mine

Ma.tt » Infrastructure as Competitive Advantage

"Infrastructure can be a competitive advantage today — the speed and reliability of WordPress.com has certainly put us in a favorable light with users, especially large customers — but that’s going to disappear over time."

infrastructure scaling wordpress mattmullenweg cloud scalability performance googlegears cdn
may 2008 by sogrady

copy to mine

Google AppEngine - A Second Look | High Scalability

"What's more the problem is developers will be acquiring a sort of learned helplessness. It's not that developers can't port to another environment, they simply won't know how to anymore because they will have never had to do it themselves."

google appengine scalability bigtable gae architecture python learnedhelplessness
april 2008 by sogrady

copy to mine

Source: Google To Launch BigTable As Web Service

"Google may be releasing BigTable...as a web service to compete with Amazon SimpleDB, according to a source...There are also rumors that press is being pre-briefed on the product, although we haven’t been contacted by Google." nor have we

google database bigtable cloud amazon scalability computing
april 2008 by sogrady

copy to mine

RAD Lab - RAD Lab

"Our vision is to enable one person to invent and run the next revolutionary IT service, operationally expressing a new business idea as a multi-million-user service over the course of a long weekend." - good luck with that. still, interesting.

rad research distributed technology google scalability datacenter
february 2008 by sogrady

copy to mine

Yahoo! Launches World's Largest Hadoop Production Application (Hadoop and Distributed Computing at Yahoo!)

"Yahoo! recently launched what we believe is the worlds largest Apache Hadoop production application. The Yahoo! Search Webmap is a Hadoop application that runs on a more than 10,000 core Linux cluster"

apache hadoop infrastructure java mapreduce opensource scalability yahoo
february 2008 by sogrady

copy to mine

Google Reveals New MapReduce Stats

just what it says

google mapreduce performance scalability data volume
january 2008 by sogrady

copy to mine

Thrudb - faster, cheaper than SimpleDB - igvita.com

"Developed by Jake Luciani as part of his ThruDB platform which currently powers JunkDepot, it is a highly scalable document-oriented database ideal for deployment on virtual (Amazon EC2+S3) or dedicated infrastructure."

thrudb thrudoc ec2 s3 couchdb aws amazon berkeleydb database scalability
december 2007 by sogrady

copy to mine

Eventually Consistent - All Things Distributed

"Inconsistency can tolerated for two reasons...Whether or not inconsistencies are acceptable depends on the client application."

eventual consistency amazon architecture database distributed distributed-computing scalability wernervogels
december 2007 by sogrady

copy to mine

Joe Gregorio | BitWorking | On the importance of being megadata

"Amazon has opened SimpleDB for beta testers. As you would expect the system is designed to scale and as such has dropped generic relational operations such as joins and transactions."

joegregorio amazon architecture database megadata scalability simpledb saas haas
december 2007 by sogrady

copy to mine

Amazon Web Services Blog: Amazon EC2 Gets More Muscle

all good, except for the "EC2 Compute Unit" - that sounds like MIPS all over again

amazon ec2 64bit applications cpu ram scalability
october 2007 by sogrady

copy to mine

Screenshot-1 on Flickr - Photo Sharing!

interesting performance results for linux-rt

realtime linux rhel tibco messaging performance scalability
september 2007 by sogrady

copy to mine

Making it stick.: AMQP, XMPP

"I think we have a lot to learn still about how simple the enterprise can eventually be." - yes, precisely

architecture notification software xmpp amqp messaging scalability enterprise simplicity via:planetintertwinglymemes
september 2007 by sogrady

copy to mine

On-Demand Infinitely Scalable Database Seed the Amazon EC2 Cloud | High Scalability

does the model have problems? you bet. is it general purpose yet? nope. but is it a sign of things to come? absolutely yes, IMO.

hosted haas saas amazon elastra ec2 s3 dbms scalability via:sequeira
september 2007 by sogrady

copy to mine

Ted Leung on the Air » Blog Archive » Scalability != concurrency

"It is certainly possible to scale a program written in any language - that’s a given. Especially when scaling = throwing more hardware at it. But there’s got to be a better way...Question is whether the better way is worth the price of admission."

concurrency scalability tedleung erlang java samruby
august 2007 by sogrady

copy to mine

http://dev.gentoo.org/~dberkholz/oscon/filesystem-notes.txt

very useful summary of Val Henson's filesystem talk from last year's OSCON (thx, Donnie)

oscon valhenson filesystems opensource scalability via:dberkholz
july 2007 by sogrady

copy to mine

Making Rails Go Vroom

tuning up Rails

charliesavage rails ruby performance scalability scaling
july 2007 by sogrady

copy to mine

funkatron.com : What Matt Mullenweg doesn’t know about PHP5, and how it hurts him and his users

pushback to Matt's thoughts on PHP 5; it's a complicated issue, obviously

mattmullenweg php php5 security scalability objectoriented
july 2007 by sogrady

copy to mine

YouTube Scalability Talk - Kyle Cordes

fascinating talk from the YouTube guys on scalability

architecture clustering code concurrency databases scalability megadata via:joe
july 2007 by sogrady

copy to mine

Bill de hÓra: Comparative Architecture

"In my part of the world, Scala doesn't make Google results front page. Give it a month." - if that

billdeh scala scalability
june 2007 by sogrady

copy to mine

Too-biased - Tobias Luetke's thoughts

specifics on memcached, including some really amazing anecdotal evidence; Facebook's using memcached on 3TBs of RAM? really?

memcached facebook caching performance scalability lamp
may 2007 by sogrady

copy to mine

First Steps to Scala

had a presentation on this at RedMonkOne - will have to track it with respect to adoption

redmonkone scala lift framework scalability
may 2007 by sogrady

copy to mine

John Sequeira's Weblog

"If you google for Twitter and scalability, you'll find a lot of articles on how Twitter's Rails setup has buckled under their obscene growth curve...But I think that fundamentally they're using the wrong technology for what they're trying to accomplish."

johnsequeira twitter scalability streambase vertica eventprocessing messaging framework
may 2007 by sogrady

copy to mine

Rails and Scaling with Multiple Databases

great pushback from Ryan on some of the criticisms leveled at Rails by the Twitter crew

rails ryantomayko databases pooling connection scalability performance postgresql design
april 2007 by sogrady

copy to mine

Twitter trouble (Loud Thinking)

DHH's pushback on some the Rails criticisms from the Twitter interview

davidheinemeier-hansson rails twitter performance bottlenecks scalability
april 2007 by sogrady

copy to mine

Nanobeepers » Infinitely Scalable Framework with AWS?

seen over on Joe's Megadata post: another option built on Amazon's HaaS offerings

s3 ec2 aws haas persistence scalability
april 2007 by sogrady

copy to mine

Joe Gregorio | BitWorking | ETech '07 Summary - Part 2 - MegaData

if you liked Adam Bosworth's "Where Have All the Good Databases Gone", this is important, just trust me (see also Bill's comments); on a completely unrelated note, great to meet Joe in person - albeit briefly - last week

joegregorio databases storage scalability joinless distributed bigdata
april 2007 by sogrady

copy to mine

Joyeur: Joyeur: Thinking about uptime numbers for the top 20 websites

"Does 4 hours and 47 minutes of downtime for blogger.com over-estimate or under-estimate the availability of myblog.blogspot.com?" - good question, don't know the answer

availability scalability uptime joyeur blogger flickr
april 2007 by sogrady

copy to mine

User:alex : Alex Bosworth - The Races : The New Black? Twitter.com - SWiK

Alex, however, is less than impressed with the scalability; i actually haven't seen these problems yet myself

alexbosworth twitter scalability popularity joyeur
march 2007 by sogrady

copy to mine

Joyeur: Joyeur: My Heart Twitters When I See This Chart

Joyeur folks happy for one of their customers that is positively exploding in terms of popularity

twitter joyeur scalability accelerators
march 2007 by sogrady

copy to mine

Code and Whatnot » Blog Archive » Scaling MySQL: thoughts on replication, sharding, and MySQL Cluster

some very interesting thoughts on clustering and scaling MySQL from Greg; most important, note his discussion of the difference between speed and scalability

mysql whitecarver scalability speed performance flickr php clustering replication sharding
february 2007 by sogrady

copy to mine

» MySpace: IT on a wing and a Microsoft prayer | Between the Lines | ZDNet.com

thoughts on MySpace and scaling up on Microsoft

microsoft myspace scalability windows
january 2007 by sogrady

copy to mine

The availability game : Pensieri di un lunatico minore

"I usually tell people that every additional nine costs 2x what the previous one cost...You best be able to write a business case for that." - precisely; great to see others making the case for sanity

petrilli availability scalability economics cost
december 2006 by sogrady

copy to mine

Scalable Web Architectures with Ruby and Amazon S3

"I focused on what we learned from building slideshare, including aspects specific to scaling Ruby on Rails." - slides are nice and useful