mcroydon + aws   116

Elastician: Creating an EBS-backed AMI from an S3-backed AMI
Creating new instances based on snapshots of EBS-backed EC2 instances.
amazon  aws  cloud  ec2  ebs 
october 2011 by mcroydon
Driving down the cost of Big-Data analytics - All Things Distributed
"The Amazon Elastic MapReduce (EMR) team announced today the ability to seamlessly use Amazon EC2 Spot Instances with their service, significantly driving down the cost of data analytics in the cloud."
analytics  aws  bigdata  data  datamining 
september 2011 by mcroydon
Architecting for the Cloud: demo and best practices, by Simone Brun...
While not particularly new, this looks like a solid overview of designing for failure in the cloud.
architecture  aws  cloud  design  hosting 
july 2011 by mcroydon
AWS Architecture Center
Designing for failure and redundancy.
amazon  architecture  aws  cloud 
april 2011 by mcroydon
The Cloud is not a Silver Bullet – stu.mp
Solid thoughts on how to do it right in the cloud.
cloud  engineering  system  amazon  aws  ec2  ebs 
april 2011 by mcroydon
When the Lights Go Out | Eucalyptus
Complex systems are complex. And Fragile.
amazon  aws  outage 
april 2011 by mcroydon
How SmugMug survived the Amazonpocalypse « SmugMug's Don MacAskill
How SmugMug survived the AWS outage. Part careful planning part luck, but ultimately due to not using EBS and only suffering a minor outage due to splash damage.
amazon  aws  ebs  ec2 
april 2011 by mcroydon
Skynet, EC2, and Zencoder « Zencoder Blog
Zencoder's reaction to the EC2 outage and how they handled it.
amazon  aws  ec2  ebs 
april 2011 by mcroydon
Why the AWS Crash is a Good Thing. | SignNow
"The cloud computing world is in crisis and its a good thing for everyone in the long term."
aws  cloud  ec2  ebs 
april 2011 by mcroydon
Post-Mortem of a Rough Day
MongoHQ's take on the EBS outage.
aws  amazon  ebs  outage  architecture 
april 2011 by mcroydon
Elastician: S3 MultiPart Upload in boto
This appears to be the only sane way to transfer decently large (>2GB) files in to S3. Knock on wood anyway. Using traditional methods will likely just broken pipe on you after a short time.
aws  python  s3 
march 2011 by mcroydon
help/en/howto/cloudfront – Cyberduck
How to set up cloudfront using your own origin server without having to use the API.
ec2  amazon  aws  cloudfront  cdn 
march 2011 by mcroydon
Amazon Web Services Blog: AWS CloudFormation - Create Your AWS Stack From a Recipe
I love that the focus of this tool is to make it easier for you to get your job done and consume the underlying AWS services.
aws  amazon  web-service  cloud 
february 2011 by mcroydon
Quora’s Technology Examined | Phil Whelan's Blog
I love architecture deep dives like this, regardless of the tech at play.
aws  programming  python  web 
february 2011 by mcroydon
Amazon Web Services Blog: Introducing AWS Elastic Beanstalk
I can't wait to see this hit the streets for other platforms like Python.
aws  ec2  scaling 
january 2011 by mcroydon
Amazon CloudFront Adds Invalidation Feature
Amazon solves one of the two truly hard concepts in Computer Science and it's free for the first 1,000 operations!
amazon  aws  cloudfront 
september 2010 by mcroydon
AWS Import/Export
A station wagon full of backup tapes now has an API.
amazon  aws  bigdata  beta  backup  cloud  cloud_computing  service  s3  large  import  export  ec2  data  cloudcomputing  storage  tools  carrier  sneakernet  transfer 
june 2010 by mcroydon
Home - Ensuring Inbox Delivery - CritSend
"CritSend ensures your email reaches its appropriate inbox and will not end up in a spam box. We deliver over 2 million automated emails per day: invoices, password notifications, transactional, newsletters, email marketing and more." $1 per 1,000 emails.
amazon  aws  ec2  open  email  mail  service  spam  it  smtp  beta  via:pskomoroch 
december 2009 by mcroydon
Elastician: Private and Streaming Distributions in CloudFront
Covers some of the new features released by Amazon today and available in boto trunk.
amazon  aws  s3  cloudfront  streaming  video  python 
december 2009 by mcroydon
Analyzing Human Genomes with Hadoop » Cloudera Hadoop & Big Data Blog
A fantastic writeup of absurdly fast sequencing software that can analyze a human genome in about 3 hours for less than $100 of AWS resources. Pretty darned impressive.
data  opensource  computer  amazon  algorithms  aws  hadoop  ec2  mapreduce  dna  bioinformatics  cloudera  trend  genetics  genome  foss  genomics 
october 2009 by mcroydon
Petabytes on a budget: How to build cheap cloud storage | Backblaze Blog
A pretty fantastic DIY solution to massive storage. I kinda wonder what the failure rate is on a configuration such as this.
design  linux  hardware  database  opensource  technology  amazon  server  diy  computer  storage  sysadmin  cool  s3  aws  debian  open  cloud  infrastructure  custom  cheap  backblaze  hard  drive  harddrives 
september 2009 by mcroydon
Getting Good IO from Amazon's EBS
How to get good performance out of this mysterious creature.
amazon  storage  performance  startup  aws  testing  ec2  optimization  benchmark  ebs  raid  disk  io 
august 2009 by mcroydon
Cloudera's Distribution for Hadoop | Cloudera
Includes lots of feature tickets that are pretty stable but not yet in a Hadoop release. It reminds me a lot of Debian unstable or Ubuntu a month or so before release. Good stuff indeed. Includes RPM and APT package management options.
software  data  linux  google  search  aws  distributed  computing  ec2  hadoop  cloud  mapreduce  cloudcomputing  distribution  clusters  packaging  cloudera  cloud-computing  rpm  apt 
june 2009 by mcroydon
Baconfile
Pretty awesome, though I don't think I'll use it until it supports ACL'd buckets instead of handing over my AWS credentials.
web  tools  amazon  s3  aws  sharing  file 
march 2009 by mcroydon
marajo - Google Code
Interesting. AppEngine compatible framework that runs on EC2.
python  google  amazon  opensource  aws  framework  ec2  infrastructure  project  webservices  simpledb  appengine  gae  license:gpl  license:gplv3 
february 2009 by mcroydon
pyaws - Revision 93: /trunk
pyamazon ported to ECS 4.0 with some minor API tweaks. ECS 3.0 is dead, so this is your option. It seems to work for me so far.
python  programming  mashup  web2.0  amazon  aws  ecs 
december 2008 by mcroydon
Panda - Open source video platform
Video uploading, encoding, and streaming with RESTful API? Yes, please.
programming  web  video  ruby  webdev  amazon  rails  api  flash  s3  webdesign  aws  rest  streaming  ec2  encoding  stream  opensource  flv  encode  ffmpeg  transcoding  upload  clean  panda  rubyonrails  merb  uploading  gem 
september 2008 by mcroydon
Eucalyptus
Roll your own in-house EC2. Nice! It's good to see ROCKS in use still.
amazon  aws  cloud  cluster  clustering  clusters  computing  ec2  firewall  grid  hosting  linux  management  open  open-source  programming  scalability  software  sysadmin  to-read  trend  xen  virtualization 
june 2008 by mcroydon
Main Page - RunBlast
I wonder how far off we are from software sequencers where the hardware is "dumb" and just sends info off to an EC2 cluster. Hey, it worked for 56k modems...
bioinformatics  cluster  aws  amazon  ec2  blast  future 
june 2008 by mcroydon
« earlier      

related tags

aa  access  admin  administration  agency  agile  ajax  algorithms  allegro  allegrograph  amazing  amazon  analysis  analytics  api  appengine  apple  application  apt  architecture  article  automation  aws  backblaze  backup  benchmark  benchmarks  beowulf  beta  bigdata  bioinformatics  blast  block  blog  business  capistrano  carrier  cartography  cassandra  catapult  cdn  cheap  chef  clean  cli  cloud  cloud-computing  cloudcomputing  cloudera  cloudfront  cloud_computing  cluster  clustering  clusters  code  codecs  colo  command  command-line  commandline  company  compression  compsci  computer  computers  computing  configuration  configuration_management  console  consulting  conversion  convert  cool  corpus  cost  couchdb  crawl  crowdsourcing  css  cuda  curl  custom  data  database  databases  datamining  dataset  datasets  datastore  db  dc  debian  debugging  demand  deploy  deployment  design  dev  developer  development  disk  dist  distributed  distributed-computing  distribution  diy  django  dna  dns  documentation  download  drive  ebs  ec2  ecs  elastic  elasticmapreduce  email  emr  encode  encoder  encoding  encyclopedia  engineering  engineyard  erlang  etech  expenses  export  ezra  failure  faq  ffmpeg  file  filesystem  firefox  firewall  flash  flv  foss  framework  freebase  fuse  future  gae  geek  gem  genetics  genome  genomics  geo  geowanking  gis  github  google  gov  gpu  graph  graphdb  grid  guardian  gui  hack  hacks  hadoop  hard  harddrives  hardware  health  hive  hosting  how-to  howto  hpc  ia  image  images  import  impressive  index  information  infrastructure  inspiration  interesting  interface  internet  interview  intridea  io  isv  it  iteration  javascript  jaylinks  journalism  large  learning  lessons  library  license:gpl  license:gplv3  light  line  linux  load  local  log  logs  lucene  mac  macfuse  mail  management  map  map-reduce  mapnik  mapping  mapreduce  maps  mashup  memcached  merb  mercurial  messages  micropayments  migration  mobile  mrjob  my  mysql  netflix  news  newsletter  nlp  nosql  notification  nvidia  ohai  on  ondemand  online  ontology  open  open-source  open.source  opensolaris  opensource  open_data  optimisation  optimization  osx  outage  packaging  panda  payment  performance  perl  persistence  pig  platform  plugin  postgis  postgres  postgresql  price  pricing  problem  programming  project  projects  provider  publicdata  pubsub  puppet  python  qa  queue  rackspace  raid  rails  rdf  recommendation  reduce  reference  research  resources  rest  ror  rpm  ruby  rubyonrails  s3  saas  scalability  scalable  scaling  scalr  science  scraping  script  scripting  search  semantic  semantic-web  semanticweb  semweb  server  servers  service  services  sharing  shell  shopping  similarity  simpledb  smtp  smush  sneakernet  sns  soa  social  software  space  spam  sparklines  sparql  sqs  stamen  startup  statistics  status  storage  store  strategy  stream  streaming  subscription  subversion  svn  sysadmin  system  t  tech  techniques  technology  testing  tips  to-read  todo  tool  tools  toread  traffic  transcoding  transfer  transportation  trend  trendingtopics  trends  triplestore  tutorial  tutorials  ubuntu  ui  uk  upload  uploading  utilities  utility  vc  vcs  versioning  via:pskomoroch  video  virtualization  web  web-service  web-services  web2.0  web3.0  webapp  webdesign  webdev  webhosting  webservice  webservices  widgets  wikipedia  work  workflow  wwdc  xen  xfs  xml  yahoo  yelp  zfs 

Copy this bookmark:



description:


tags: