Amazon Web Services Blog: Amazon Simple Workflow - Cloud-Based Workflow Management
february 2012 by mcroydon
Up next: Simple Singularity Service.
amazon
aws
ec2
workflow
february 2012 by mcroydon
Elastician: Creating an EBS-backed AMI from an S3-backed AMI
october 2011 by mcroydon
Creating new instances based on snapshots of EBS-backed EC2 instances.
amazon
aws
cloud
ec2
ebs
october 2011 by mcroydon
dl.dropbox.com/u/5586906/slides/Cloud_Scaling.pdf
september 2011 by mcroydon
Performance matters.
amazon
api
aws
cloud
ec2
september 2011 by mcroydon
The Cloud is not a Silver Bullet – stu.mp
april 2011 by mcroydon
Solid thoughts on how to do it right in the cloud.
cloud
engineering
system
amazon
aws
ec2
ebs
april 2011 by mcroydon
How SmugMug survived the Amazonpocalypse « SmugMug's Don MacAskill
april 2011 by mcroydon
How SmugMug survived the AWS outage. Part careful planning part luck, but ultimately due to not using EBS and only suffering a minor outage due to splash damage.
amazon
aws
ebs
ec2
april 2011 by mcroydon
Coping With Cloud Downtime | Backdrift
april 2011 by mcroydon
Being able to go from vanilla image to your custom server is key. Automate, whether it's puppet, chef, or a bash script.
backup
cloud
deployment
ec2
puppet
april 2011 by mcroydon
Skynet, EC2, and Zencoder « Zencoder Blog
april 2011 by mcroydon
Zencoder's reaction to the EC2 outage and how they handled it.
amazon
aws
ec2
ebs
april 2011 by mcroydon
Why the AWS Crash is a Good Thing. | SignNow
april 2011 by mcroydon
"The cloud computing world is in crisis and its a good thing for everyone in the long term."
aws
cloud
ec2
ebs
april 2011 by mcroydon
On Cascading Failures and Amazon’s Elastic Block Store « Joyeur
april 2011 by mcroydon
Thoughts from Joyent.
aws
blog
ec2
ebs
april 2011 by mcroydon
Hacker News | Some quotes regarding how Netflix handled this without interruptions:"Netflix sh...
april 2011 by mcroydon
Info from Netflix on how they weathered the outage.
amazon
aws
hosting
cloud
netflix
ec2
ebs
april 2011 by mcroydon
Why Twilio Wasn’t Affected by Today’s AWS Issues | Twilio Engineering Blog
april 2011 by mcroydon
How to architect for failure and redundancy.
amazon
architecture
aws
cloud
distributed
ec2
ebs
april 2011 by mcroydon
Working around the EC2 outage -
april 2011 by mcroydon
More thoughts on the outage.
amazon
aws
cloud
cloudcomputing
ec2
ebs
april 2011 by mcroydon
help/en/howto/cloudfront – Cyberduck
march 2011 by mcroydon
How to set up cloudfront using your own origin server without having to use the API.
ec2
amazon
aws
cloudfront
cdn
march 2011 by mcroydon
Factual Dev Blog » Blog Archive » Gratuitous Hadoop: Stress Testing on the Cheap with Hadoop Streaming and EC2
january 2011 by mcroydon
Stress testing using Hadoop and EC2.
amazon
architecture
hadoop
ec2
testing
january 2011 by mcroydon
godber/crunch.io-dashboard - GitHub
january 2011 by mcroydon
"The Crunch.io Dashboard allows users to launch scientific computing clusters in EC2 with ease."
scientific
computing
ec2
amazon
management
dashboard
january 2011 by mcroydon
STARDEV: Cluster - Welcome to StarCluster!
january 2011 by mcroydon
A toolkit for launching EC2 instances. Aimed at scientific computing.
amazon
cluster
ec2
python
january 2011 by mcroydon
Node.js in production
january 2011 by mcroydon
A nice look at production-quality node architecture.
node
node.js
ec2
architecture
january 2011 by mcroydon
Amazon Web Services Blog: Introducing AWS Elastic Beanstalk
january 2011 by mcroydon
I can't wait to see this hit the streets for other platforms like Python.
aws
ec2
scaling
january 2011 by mcroydon
Compute Cycles - Benchmarks for the brand new Compute GPU on Amazon EC2
november 2010 by mcroydon
I think this means GPU computing is a good thing.
amazon
aws
benchmark
benchmarks
cloudcomputing
cloud
performance
hpc
ec2
november 2010 by mcroydon
Rails Development – Interface Design – iPhone/iPad/Android Apps
september 2010 by mcroydon
Web firm that communicates what they do really well.
agency
amazon
agile
business
aws
cloud
company
ec2
development
developer
design
dc
css
cool
consulting
inspiration
rails
ruby
ror
rubyonrails
scalability
social
webdev
webdesign
web2.0
web
vc
intridea
scalr
september 2010 by mcroydon
OpenStack Open Source Cloud Computing Software
july 2010 by mcroydon
OpenStack main site.
admin
cloud-computing
cloud
cloudcomputing
cluster
ec2
distributed
development
computing
code
clustering
infrastructure
open
nasa
open-source
opensource
python
source
software
service
server
scalability
rackspace
standards
storage
technology
virtualization
webdev
july 2010 by mcroydon
NoSQL vs. RDBMS: Let the flames begin! – stu.mp
march 2010 by mcroydon
Flamewar aside, it's an interesting discussion.
cost
data
database
databases
decisions
domain
ec2
sql
scaling
rdbms
performance
nosql
mysql
make
experience
simplegeo
march 2010 by mcroydon
7 easy tips to reduce your Amazon ec2 cloud costs
march 2010 by mcroydon
How to save money in the cloud.
amazon
aws
cloud
cost
dns
ec2
isv
optimisation
techniques
tips
server
reduce
provider
projects
price
webservices
march 2010 by mcroydon
Gojko Adzic » Designing applications for cloud deployment
january 2010 by mcroydon
Somewhat obvious but good thoughts on deploying in the cloud.
programming
aws
design
hosting
cloud
ec2
development
deployment
cloudcomputing
webdev
amazon
deploy
qa
server
scalability
performance
architecture
tech
january 2010 by mcroydon
Home - Ensuring Inbox Delivery - CritSend
december 2009 by mcroydon
"CritSend ensures your email reaches its appropriate inbox and will not end up in a spam box. We deliver over 2 million automated emails per day: invoices, password notifications, transactional, newsletters, email marketing and more." $1 per 1,000 emails.
amazon
aws
ec2
open
email
mail
service
spam
it
smtp
beta
via:pskomoroch
december 2009 by mcroydon
psvm - Project Hosting on Google Code
december 2009 by mcroydon
It would be interesting to see this ported to Hadoop, though I think there's an SVM implementation as part of Mahout.
programming
software
google
cloudcomputing
opensource
code
research
algorithms
network
statistics
learning
cluster
algorithm
ec2
machinelearning
machine-learning
c++
kernel-machines
open_source
svm
foss
classification
nlp
machine
parallel
parallel-computation
december 2009 by mcroydon
Crowdsourced document analysis and MP expenses
december 2009 by mcroydon
Simon's experience running two large-scale crowdsourcing efforts.
design
web
django
data
journalism
webdev
article
aws
social
interface
ec2
application
memcached
information
2009
guardian
uk
ia
crowdsourcing
lessons
impressive
light
expenses
iteration
december 2009 by mcroydon
Building a Data Intensive Web Application with Cloudera, Hadoop, Hive, Pig, and EC2 | Cloudera
november 2009 by mcroydon
A nice look at end-to-end data analysis of big datasets using things like Pig and Hive.
programming
web
data
database
tools
webdev
business
toread
howto
tutorial
amazon
dev
scalability
hadoop
architecture
aws
computing
cluster
ec2
pig
trends
hive
cloudera
cloudcomputing
analytics
datamining
mapreduce
cloud
application
november 2009 by mcroydon
AllegroGraph RDFStore Web 3.0's Database
october 2009 by mcroydon
Open source (limited to 50m triples) and commercial RDF triplestore.
web
linux
database
amazon
storage
aws
databases
graph
ec2
db
download
rdf
store
semantic
semanticweb
semweb
ontology
semantic-web
triplestore
datastore
web3.0
sparql
allegrograph
graphdb
allegro
october 2009 by mcroydon
Analyzing Human Genomes with Hadoop » Cloudera Hadoop & Big Data Blog
october 2009 by mcroydon
A fantastic writeup of absurdly fast sequencing software that can analyze a human genome in about 3 hours for less than $100 of AWS resources. Pretty darned impressive.
data
opensource
computer
amazon
algorithms
aws
hadoop
ec2
mapreduce
dna
bioinformatics
cloudera
trend
genetics
genome
foss
genomics
october 2009 by mcroydon
Thread: Does Amazon EC2 meet PCI Compliance guidelines?
august 2009 by mcroydon
While Amazon's cloud is reasonably secure, it'll never reach PCI Level 1 compliance. So don't save or store credit card information on EC2 or S3.
amazon
security
s3
ecommerce
ec2
cloud
processing
payment
PCI
august 2009 by mcroydon
Tracking Trends with Hadoop and Hive on EC2 » Cloudera Hadoop & Big Data Blog
august 2009 by mcroydon
A detailed run through of data warehousing and creating trending results for wikipedia data.
python
data
database
howto
tutorial
wikipedia
rails
scaling
hadoop
aws
resources
ec2
cloud
mapreduce
datamining
sparklines
rubyonrails
trends
hive
cloudera
bigdata
log
t
trendingtopics
august 2009 by mcroydon
Getting Good IO from Amazon's EBS
august 2009 by mcroydon
How to get good performance out of this mysterious creature.
amazon
storage
performance
startup
aws
testing
ec2
optimization
benchmark
ebs
raid
disk
io
august 2009 by mcroydon
Cloudera's Distribution for Hadoop | Cloudera
june 2009 by mcroydon
Includes lots of feature tickets that are pretty stable but not yet in a Hadoop release. It reminds me a lot of Debian unstable or Ubuntu a month or so before release. Good stuff indeed. Includes RPM and APT package management options.
software
data
linux
google
search
aws
distributed
computing
ec2
hadoop
cloud
mapreduce
cloudcomputing
distribution
clusters
packaging
cloudera
cloud-computing
rpm
apt
june 2009 by mcroydon
aws - simple access to Amazon EC2 and S3
may 2009 by mcroydon
Simple commandline access.
programming
software
web
linux
development
tools
webdev
amazon
storage
web2.0
aws
s3
ec2
management
perl
utilities
backup
cloud
tool
shell
cloudcomputing
admin
cli
access
line
script
commandline
curl
command
command-line
may 2009 by mcroydon
Some Notes on Distributed Key Stores « random($foo)
april 2009 by mcroydon
Yeah, the Tokyo stack appears to rocketh.
data
database
blog
scalability
storage
distributed
scaling
databases
ec2
mysql
cloud
dht
hash
key-value
rdbms
tokyocabinet
keyvalue
cassandra
tokyotyrant
voldemort
keystore
april 2009 by mcroydon
Amazon Web Services Developer Community : Finding Similar Items with Amazon Elastic MapReduce, Python, and Hadoop Streaming
april 2009 by mcroydon
Excellent tutorial on diving in to Hadoop streaming on AWS.
python
howto
code
amazon
aws
streaming
ec2
hadoop
netflix
mapreduce
recommendation
similarity
april 2009 by mcroydon
Cloud Compute, Cloud Server, Cloud Servers, On Demand Server @ Mosso
march 2009 by mcroydon
This rounds out the trio of cloud services from Rackspace.
web
amazon
server
dev
scalability
computing
s3
ec2
hosting
virtualization
cloud
grid
servers
tool
webservices
distribution
vps
deploy
rackspace
march 2009 by mcroydon
marajo - Google Code
february 2009 by mcroydon
Interesting. AppEngine compatible framework that runs on EC2.
python
google
amazon
opensource
aws
framework
ec2
infrastructure
project
webservices
simpledb
appengine
gae
license:gpl
license:gplv3
february 2009 by mcroydon
Amazon Web Services Blog: New AWS Public Data Sets - Economics, DBpedia, Freebase, and Wikipedia
february 2009 by mcroydon
Lots of hot new data.
programming
data
blog
amazon
research
wikipedia
statistics
aws
compsci
ec2
resources
transportation
cloud
datamining
nlp
dataset
cloudcomputing
corpus
datasets
freebase
gov
publicdata
scraping
encyclopedia
february 2009 by mcroydon
Chef: Suck on my chocolate salty balls
january 2009 by mcroydon
Like puppet, but with more South Park references.
tools
ruby
server
sysadmin
rails
aws
management
ec2
deployment
couchdb
cloud
capistrano
administration
automation
configuration
merb
rubyonrails
deploy
chef
puppet
ohai
engineyard
ezra
configuration_management
january 2009 by mcroydon
Panda - Open source video platform
september 2008 by mcroydon
Video uploading, encoding, and streaming with RESTful API? Yes, please.
programming
web
video
ruby
webdev
amazon
rails
api
flash
s3
webdesign
aws
rest
streaming
ec2
encoding
stream
opensource
flv
encode
ffmpeg
transcoding
upload
clean
panda
rubyonrails
merb
uploading
gem
september 2008 by mcroydon
Disco
september 2008 by mcroydon
I think I need to change my pants.
python
programming
software
open-source
development
data
nokia
distributed-computing
database
erlang
library
dev
map
research
scalability
computing
cluster
distributed
reduce
mapreduce
cloud
opensource
parallel
concurrency
hadoop
ec2
framework
september 2008 by mcroydon
Persistent Django on Amazon EC2 and EBS - The easy way
august 2008 by mcroydon
Yeah, it's that simple.
python
programming
web
django
development
code
howto
business
webdev
tutorial
amazon
sysadmin
work
web2.0
aws
geek
postgresql
hosting
computers
ec2
postgres
cloud
cloudcomputing
admin
ebs
webservices
persistence
august 2008 by mcroydon
Amazon Web Services Developer Connection : Running MySQL on Amazon EC2 with Elastic Block Store
august 2008 by mcroydon
This applies pretty cleanly to other database engines too.
reference
database
howto
toread
tutorial
amazon
sysadmin
storage
s3
aws
scalability
computing
ec2
databases
mysql
webhosting
cloud
article
tutorials
cloudcomputing
ebs
xfs
webservices
august 2008 by mcroydon
Eucalyptus
june 2008 by mcroydon
Roll your own in-house EC2. Nice! It's good to see ROCKS in use still.
amazon
aws
cloud
cluster
clustering
clusters
computing
ec2
firewall
grid
hosting
linux
management
open
open-source
programming
scalability
software
sysadmin
to-read
trend
xen
virtualization
june 2008 by mcroydon
Main Page - RunBlast
june 2008 by mcroydon
I wonder how far off we are from software sequencers where the hardware is "dumb" and just sends info off to an EC2 cluster. Hey, it worked for 56k modems...
bioinformatics
cluster
aws
amazon
ec2
blast
future
june 2008 by mcroydon
Exploring Amazon EC2 for Scale-out Applications
april 2008 by mcroydon
Good slide deck on EC2 and what's changing.
amazon
architecture
benchmark
aws
ec2
benchmarks
filesystem
mysql
performance
scalability
storage
scaling
xen
april 2008 by mcroydon
scalr - Google Code
march 2008 by mcroydon
Open source scaling, monitoring and load balancing via EC2.
amazon
aws
code
ec2
grid
platform
ruby
web
scaling
open-source
march 2008 by mcroydon
Amazon Web Services Blog: New EC2 Features: Static IP Addresses, Availability Zones, and User Selectable Kernels
march 2008 by mcroydon
Fantastic new features include staticable IPs and control over where instances are created. Fantastic stuff.
amazon
ec2
march 2008 by mcroydon
Too big to use utility computing ?
february 2008 by mcroydon
Is utility computing right for you?
amazon
aws
s3
ec2
utility
computing
february 2008 by mcroydon
erlaws - Google Code
february 2008 by mcroydon
"Erlaws is a collection of client implementations of Amazon's WebServices offerings. Currently there are clients for S3, SQS and SDB."
amazon
ec2
erlang
programming
simpledb
s3
sqs
aws
february 2008 by mcroydon
Re: Darwin Stream Server auto start on Debian Box (INIT.D)
january 2008 by mcroydon
Used this with a minor tweak or to for DSS on EC2.
ec2
darwin
streaming
media
server
quicktime
open-source
january 2008 by mcroydon
Amazon Web Services Developer Connection : Firefox Extension for Amazon EC2
december 2007 by mcroydon
Looks like a solid management UI for EC2.
amazon
api
aws
database
deployment
ec2
firefox
gui
javascript
plugin
scalability
scaling
tools
ui
december 2007 by mcroydon
Amazon Web Services Developer Connection : Ubuntu 7.10 Gutsy Base Install
december 2007 by mcroydon
Solid looking AMI with the script that produces it.
amazon
ec2
aws
linux
server
ubuntu
december 2007 by mcroydon
GlusterFS - GlusterDocumentation
november 2007 by mcroydon
Clustered distributed filesystem with FUSE goodness.
amazon
aws
computing
cluster
distributed
ec2
file
filesystem
linux
storage
s3
raid
system
november 2007 by mcroydon
related tags
access ⊕ admin ⊕ administration ⊕ agency ⊕ agile ⊕ algorithm ⊕ algorithms ⊕ allegro ⊕ allegrograph ⊕ amazing ⊕ amazon ⊕ analysis ⊕ analytics ⊕ api ⊕ appengine ⊕ application ⊕ apt ⊕ architecture ⊕ article ⊕ auction ⊕ automation ⊕ aws ⊕ backup ⊕ bacon ⊕ benchmark ⊕ benchmarks ⊕ beowulf ⊕ beta ⊕ bigdata ⊕ bioinformatics ⊕ blast ⊕ blog ⊕ business ⊕ c++ ⊕ capistrano ⊕ carrier ⊕ cartography ⊕ cassandra ⊕ catapult ⊕ cdn ⊕ chef ⊕ chunky ⊕ classification ⊕ clean ⊕ cli ⊕ cloud ⊕ cloud-computing ⊕ cloudcomputing ⊕ cloudera ⊕ cloudfront ⊕ cloud_computing ⊕ cluster ⊕ clustering ⊕ clusters ⊕ code ⊕ colo ⊕ command ⊕ command-line ⊕ commandline ⊕ company ⊕ compsci ⊕ computer ⊕ computers ⊕ computing ⊕ concurrency ⊕ configuration ⊕ configuration_management ⊕ console ⊕ consulting ⊕ conversion ⊕ cool ⊕ corpus ⊕ cost ⊕ couchdb ⊕ crawl ⊕ crowdsourcing ⊕ css ⊕ cuda ⊕ curl ⊕ darwin ⊕ dashboard ⊕ data ⊕ database ⊕ databases ⊕ datamining ⊕ dataset ⊕ datasets ⊕ datastore ⊕ db ⊕ dc ⊕ decisions ⊕ deploy ⊕ deployment ⊕ design ⊕ dev ⊕ developer ⊕ development ⊕ dht ⊕ disk ⊕ distributed ⊕ distributed-computing ⊕ distribution ⊕ django ⊕ dna ⊕ dns ⊕ domain ⊕ download ⊕ ebs ⊕ ec2 ⊖ ecommerce ⊕ elastic ⊕ email ⊕ encode ⊕ encoding ⊕ encyclopedia ⊕ engineering ⊕ engineyard ⊕ erlang ⊕ etech ⊕ expenses ⊕ experience ⊕ export ⊕ ezra ⊕ ffmpeg ⊕ file ⊕ filesystem ⊕ firefox ⊕ firewall ⊕ flash ⊕ flv ⊕ foss ⊕ framework ⊕ freebase ⊕ future ⊕ gae ⊕ geek ⊕ gem ⊕ genetics ⊕ genome ⊕ genomics ⊕ geo ⊕ gis ⊕ google ⊕ gov ⊕ gpu ⊕ graph ⊕ graphdb ⊕ grid ⊕ guardian ⊕ gui ⊕ hack ⊕ hacks ⊕ hadoop ⊕ hardware ⊕ hash ⊕ heroku ⊕ hive ⊕ hosting ⊕ how-to ⊕ howto ⊕ hpc ⊕ ia ⊕ import ⊕ impressive ⊕ index ⊕ information ⊕ infrastructure ⊕ inspiration ⊕ interesting ⊕ interface ⊕ interview ⊕ intridea ⊕ io ⊕ isv ⊕ it ⊕ iteration ⊕ javascript ⊕ jaylinks ⊕ journalism ⊕ kernel-machines ⊕ key-value ⊕ keystore ⊕ keyvalue ⊕ large ⊕ learning ⊕ lessons ⊕ library ⊕ license:gpl ⊕ license:gplv3 ⊕ light ⊕ line ⊕ linux ⊕ local ⊕ log ⊕ lucene ⊕ machine ⊕ machine-learning ⊕ machinelearning ⊕ mail ⊕ make ⊕ management ⊕ map ⊕ mapnik ⊕ mapping ⊕ mapreduce ⊕ maps ⊕ mashup ⊕ media ⊕ memcached ⊕ merb ⊕ mercurial ⊕ my ⊕ mysql ⊕ nasa ⊕ netflix ⊕ network ⊕ news ⊕ nlp ⊕ node ⊕ node.js ⊕ nokia ⊕ nosql ⊕ nvidia ⊕ ohai ⊕ online ⊕ ontology ⊕ open ⊕ open-source ⊕ open.source ⊕ opensource ⊕ open_data ⊕ open_source ⊕ optimisation ⊕ optimization ⊕ packaging ⊕ panda ⊕ parallel ⊕ parallel-computation ⊕ payment ⊕ PCI ⊕ performance ⊕ perl ⊕ persistence ⊕ pig ⊕ platform ⊕ plugin ⊕ postgis ⊕ postgres ⊕ postgresql ⊕ price ⊕ pricing ⊕ processing ⊕ programming ⊕ project ⊕ projects ⊕ provider ⊕ publicdata ⊕ puppet ⊕ python ⊕ qa ⊕ queue ⊕ quicktime ⊕ rackspace ⊕ raid ⊕ rails ⊕ rdbms ⊕ rdf ⊕ recommendation ⊕ reduce ⊕ reference ⊕ research ⊕ resources ⊕ rest ⊕ ror ⊕ rpm ⊕ ruby ⊕ rubyonrails ⊕ s3 ⊕ scalability ⊕ scaling ⊕ scalr ⊕ science ⊕ scientific ⊕ scraping ⊕ script ⊕ scripting ⊕ search ⊕ security ⊕ semantic ⊕ semantic-web ⊕ semanticweb ⊕ semweb ⊕ server ⊕ servers ⊕ service ⊕ services ⊕ shell ⊕ similarity ⊕ simpledb ⊕ simplegeo ⊕ slides ⊕ smtp ⊕ sneakernet ⊕ social ⊕ software ⊕ source ⊕ spam ⊕ sparklines ⊕ sparql ⊕ sql ⊕ sqs ⊕ stamen ⊕ standards ⊕ startup ⊕ statistics ⊕ storage ⊕ store ⊕ stream ⊕ streaming ⊕ subversion ⊕ svm ⊕ svn ⊕ sysadmin ⊕ system ⊕ t ⊕ tech ⊕ techniques ⊕ technology ⊕ testing ⊕ tips ⊕ to-read ⊕ tokyocabinet ⊕ tokyotyrant ⊕ tool ⊕ tools ⊕ toread ⊕ transcoding ⊕ transfer ⊕ transportation ⊕ trend ⊕ trendingtopics ⊕ trends ⊕ triplestore ⊕ tutorial ⊕ tutorials ⊕ ubuntu ⊕ ui ⊕ uk ⊕ upload ⊕ uploading ⊕ utilities ⊕ utility ⊕ vc ⊕ via:pskomoroch ⊕ video ⊕ virtualization ⊕ voldemort ⊕ vps ⊕ web ⊕ web2.0 ⊕ web3.0 ⊕ webdesign ⊕ webdev ⊕ webhosting ⊕ webservice ⊕ webservices ⊕ wikipedia ⊕ work ⊕ workflow ⊕ xen ⊕ xfs ⊕ youtube ⊕Copy this bookmark: