mcroydon + architecture   150

Google: Achieving Rapid Response Times in Large Online Services
"Today’s large-scale web services provide rapid responses to interactive requests by applying large amounts of computational resources to massive datasets. They typically operate in warehouse-sized datacenters and run on clusters of machines that are shared across many kinds of interactive and batch jobs. As these systems distribute work to ever larger numbers of machines and sub-systems in order to provide interactive response times, it becomes increasingly difficult to tightly control latency variability across these machines, and often the 95%ile and 99%ile response times suffer in an effort to improve average response times."
dist  google  latency  performance  scaling  distributed  architecture 
19 days ago by mcroydon
The Architecture of Open Source Applications
A fantastic looking book on how various open source projects are architected.
architecture  books  opensource  programming  software 
august 2011 by mcroydon
Architecting for the Cloud: demo and best practices, by Simone Brun...
While not particularly new, this looks like a solid overview of designing for failure in the cloud.
architecture  aws  cloud  design  hosting 
july 2011 by mcroydon
AWS Architecture Center
Designing for failure and redundancy.
amazon  architecture  aws  cloud 
april 2011 by mcroydon
Post-Mortem of a Rough Day
MongoHQ's take on the EBS outage.
aws  amazon  ebs  outage  architecture 
april 2011 by mcroydon
NoSQL at Netflix
How Netflix uses various NoSQL datastores.
architecture  cassandra  database  netflix  nosql 
march 2011 by mcroydon
Node.js in production
A nice look at production-quality node architecture.
node  node.js  ec2  architecture 
january 2011 by mcroydon
OpenTSDB - A Distributed, Scalable Monitoring System
OpenTSDB is a distributed, scalable Time Series Database (TSDB) written on top of HBase. OpenTSDB was written to address a common need: store, index and serve metrics collected from computer systems (network gear, operating systems, applications) at a large scale, and make this data easily accessible and graphable.
analysis  architecture  bigdata  cloud  data  database  db  java  lgpl  hbase  hadoop  development  graph  distributed  monitoring  nosql  opensource  operations  scalability  scale  time  sysadmin  software  storage  series  opentsdb  rrd  stumbleupon  time-series  timeseries 
november 2010 by mcroydon
Information architecture for news websites
I've only skimmed these but it looks like there are a lot of nuggets.
architecture  cms  denmark  design  information  ia  tags  news  layout  journalism  informationdesign 
may 2010 by mcroydon
Principles for Standardized REST Authentication - O'Reilly Broadcast
I want to live in this fantasty world where RESTful authentication isn't so hard or repetitive.
api  architecture  auth  authentication  dev  cloud  development  restful  rest  read  programming  patterns  oauth  http  distributed  security  soa  soap  toread  webservices 
may 2010 by mcroydon
Cassandra Internals – Reading
The companion to his writing-oriented Cassandra tour.
architecture  cassandra  database  data  distributed  internals  java  nosql  sysadmin 
march 2010 by mcroydon
cloudkick | blog: 4 Months with Cassandra, a love story
A very interesting look at Cassandra with an eye toward gotchas. Cloudkick are doing some interesting stuff with aggregation over time periods.
admin  via:jacobian  administration  architecture  article  cassandra  database  databases  opensource  nosql  mysql  monitoring  django  distributed  db  datawarehouse  python  scalability  scaling  storage  toread  webdev  programming  cloudkick  neat 
march 2010 by mcroydon
Manning: Brownfield Application Development in .NET
"Most software developers have inherited a monolithic application where the day-to-day tasks involve maintenance, incremental improvements, or even cleaning up the mess another programmer left behind. These legacy or brownfield projects often have tightly coupled components, low cohesion, and poor separation of concerns, making them fragile and resistant to change."
software  development  book  toread  books  architecture  work  ebooks  check  tdd  brownfield 
january 2010 by mcroydon
justin / webmachine / wiki / Home — bitbucket.org
A RESTful framework built on top of mochiweb. Travis Swicegood got me all excited about this last night.
programming  web  software  development  tools  webdev  library  opensource  erlang  dev  server  tech  architecture  framework  http  rest  application  tool  frameworks  2009  djangocon  toolkit  bitbucket  backend  ops  webmachine  mochiweb 
december 2009 by mcroydon
Extreme Agility at Facebook | blog@CACM | Communications of the ACM
"Another aspect of the Facebook engineering team is how large the ratio of active user to developer is. Currently it stands at 1.1 million users per developer."
programming  development  howto  scalability  architecture  scaling  management  engineering  memcached  facebook  process  agile  acm  hive  scribe  oopsla  niho  cacm 
november 2009 by mcroydon
zoie - Project Hosting on Google Code
Built on top of Apache Lucene and focuses on solving several problems around real-time search and indexing performance.
programming  development  google  library  opensource  free  java  search  architecture  tech  apache  db  lucene  solr  project  indexing  realtime  index  fulltext  mq  linkedin  zoie 
november 2009 by mcroydon
Geeking with Greg: Advice from Google on large distributed systems
With links to slides from LADIS '09. This includes a refresh and update about how GFS, MapReduce, etc are working in Google's fault-filled environment.
programming  google  blog  scalability  storage  performance  architecture  distributed  advice  scaling  infrastructure  systems  datacenters 
october 2009 by mcroydon
Infomaki
Pretty awesome lightweight usability testing. This would probably be a great tool for getting feedback from early mockups.
software  tools  ruby  opensource  free  rails  statistics  ui  webdesign  usability  architecture  open  source  testing  accessibility  analytics  test  ux  ia  user-experience  infomaki  feedback  ruby_on_rails  nypl 
july 2009 by mcroydon
Coding Horror: Scaling Up vs. Scaling Out: Hidden Costs
Food for thought with the caveat that scaling out is a lot easier if you don't have any per-server software costs. Big iron costs less to operate though.
programming  hardware  business  server  scalability  coding  networking  architecture  performance  distributed  scaling  web-development  cluster  hadoop  hosting  clustering  comparison  servers  distribution  it  codinghorror  2009  stackoverflow 
june 2009 by mcroydon
« earlier      

related tags

2pc  2read  3d  3dprinting  1960s  1970s  @toread  abandoned  academic  acceptance  accessibility  acid  acm  activemq  activity  activitystreams  admin  administration  advice  aggregation  agile  ai  air  aircraft  airfield  airfields  airplanes  airport  airports  ajax  algorithm  algorithms  alife  amazon  amqp  analysis  analytics  anchoring  apache  api  api-design  apis  apl  apocalypse  apple  application  arch  architect  architecture  arm  arquitectura  art  article  articles  atom  auth  authentication  automation  availability  aviation  aws  backend  balancer  balancing  batch  bdd  behaviour  benchmark  benchmarks  bert  bestpractices  bigdata  bigpipe  bigtable  bitbucket  blender  blob  bloch  blog  blogger  blogs  book  books  bpm  britain  brownfield  browser  brutalism  buffers  business  c++  cache  caching  cacm  cad  caffeine  cap  cart  case  cassandra  cg  check  checkout  cities  city  cityengine  clojure  cloud  cloudcomputing  cloudera  cloudkick  cluster  clustering  clusters  cms  cocoa  code  coding  codinghorror  coffee  collaboration  collection  college  colossus  comment  commenting  comments  communication  community  company  compare  comparison  complexity  components  compression  compsci  computer  computers  computerscience  computing  concrete  concurrency  condor  conference  consistency  consistent  continuations  conversation  cool  corba  couchdb  cpu  craft  crafts  creativity  crowdsourcing  cs  cucumber  custom  data  database  databases  datacenter  datacenters  datamining  datastore  datastructures  dataviz  datawarehouse  db  debugging  decay  decisions  delay  delicious  demo  denmark  deploy  deployment  design  dev  developer  development  dht  differences  digest  digg  disk  dist  distributed  distribution  diy  django  djangocon  dna  dns  documentation  driven  dsl  dtn  dtnrg  dynamo  dynomite  easy  ebooks  ebs  ec2  ecommerce  editor  edu  education  electronic  electronics  email  embedded  engine  engineering  england  english  enterprise  erlang  example  examples  expectations  experience  exploration  extraction  fabrication  facebook  farmville  fb  feature  features  federation  feedback  feeds  fiction  filesystem  film  flex  flickr  flight  flockdb  flow  flying  fonts  foss  fowler  fpga  framework  frameworks  free  freebase  freeware  friendfeed  frontend  fulltext  furniture  future  ga  gamedev  games  gate  gateway  generative  generator  genetic  geneticalgorithms  geneticprogramming  genetics  genetic_algorithm  genetic_algorithms  geo  geography  geometry  gfs  gfs2  git  github  global  good  google  google-earth  google-maps  googletechtalk  graph  graph-database  graphd  graphics  graphs  graph_database  grid  gridcomputing  guide  ha  hack  hacks  hadoop  happy  hardware  hash  hateoas  haystack  hbase  highavailability  history  hive  hosting  howto  hpc  htc  html  http  httpd  humour  hypertable  ia  ideas  ietf  image  images  implementation  important  index  indexing  info  infomaki  information  information-extraction  informationdesign  information_extraction  infrastructure  innovation  inspiration  instagram  instapaper  integration  interactiondesign  interesting  interface  internals  internet  introduction  ip  ipv6  irvine  issues  it  ixd  java  javascript  journalism  js  json  jta  justin  justin.tv  jython  kansas  kaye  kellan  key-value  keystore  keyvalue  kml  knowledge  kvs  kvstore  landscape  language  laser  last.fm  latency  laughingmeme  lawrence  layout  lgpl  libraries  library  lifestream  linguistics  linkedin  links  linux  lisp  list  lists  little-known  live  load  load-balancing  loadbalancing  load_balancing  local  lucene  mac  macintosh  mail  mailinator  make  management  manufacturing  map  map-reduce  mapping  mapreduce  maps  martin  martin-fowler  martinfowler  math  math.optimization  mathematica  maturity  maturitymodel  mda  mechanisms  memcache  memcached  message  messagequeue  messages  messaging  metaweb  methodology  microcontroller  microcontrollers  microsoft  middleware  military  mining  misc  mochiweb  mod  model  modeling  modelling  models  modernism  module  mod_backhand  mogilefs  mongo  mongodb  mongrel  monitoring  mp3  mq  munin  museum  mustuse  mysql  natural  natural_language  neat  neo4j  netflix  netnewswire  network  networking  networks  news  nfs  niho  nlp  node  node.js  nodejs  nosql  notes  nypl  oauth  object  omg  online  ontology  oop  oopsla  open  open-source  opensource  opentsdb  operations  ops  optimisation  optimization  oregon  os  osx  outage  overview  p2p  paper  papers  parallel  parsing  partition  pattern  patterns  paxos  pcb  peep  performance  philosophy  photo  photography  photos  php  pictures  pig  pinboard  ping.fm  pipelining  podcast  podcasting  ponoko  portal  post  postgres  postgresql  presentation  print  printer  printing  procedural  process  processing  processors  product  production  programming  programming-languages  project  projects  protocol  protocolbuffers  protocols  prototype  prototyping  proxy  pubsub  pubsubhubbub  puppet  python  qa  queue  queues  rabbitmq  raid  rails  ranking  rapid  rapidprototyping  rating  ratings  rdbms  rdf  read  reading  readlater  realtime  reddit  redis  reference  relationaldb  relationship  replication  research  resource  resources  rest  restful  retro  review  rrd  rspec  rss  ruby  rubyonrails  ruby_on_rails  ruins  s3  salmon  samples  scalability  scalable  scalaris  scale  scaling  schema  schema-less  schemaless  school  sci-fi  science  science-fiction  scribe  sculpture  search  security  semantic  semanticweb  semweb  serialization  series  server  servers  service  services  shard  sharded  sharding  shards  shop  shopping  sign  signs  simpledb  simplegeo  simulation  sketchup  slide  slider  slides  slideshare  slideshow  smalltalk  soa  soap  social  socialmedia  socialnetworking  socialsoftware  socialweb  social_networking  socket  sockets  software  softwareengineering  solr  source  space  speed  sql  sqs  ssd  ssh  stackoverflow  standard  standards  startup  statistics  stats  storage  store  stories  strategy  streaming  stumbleupon  style  summer  sun  switzerland  sysadmin  system  systems  tags  talk  talkinator  tcp  tdd  tea  tech  technology  techtalk  television  test  testing  text  text-mining  textmining  theme  theorem  theory  thrift  tillamook  time  time-series  timeseries  tips  to-read  todo  tolerant  tool  toolkit  tools  toread  towatch  toys  to_read  train  transaction  transaction-processing  transactions  transcoding  transportation  travel  trends  triplestore  tube  tumblr  tuple  tuples  tuplespace  tutorial  tutorials  tv  twitter  type  typography  ui  uk  uml  underground  uni  unicorn  unix  urban  urbanism  uri  url  usa  usability  usecases  user  user-experience  userstories  utility  utopia  ux  verilog  versioning  vfx  vhdl  via:jacobian  via:pskomoroch  video  video2watch  videos  virtualization  visualization  voldemort  vps  vs  web  web-development  web-services  web2.0  webapp  webdesign  webdev  webdevelopment  webmachine  webserver  webservice  webservices  website  websites  wiki  wikipedia  windows  wishlist  wolfram  work  writing  xbox  xen  xml  xrd  yam  youtube  zoie  zynga 

Copy this bookmark:



description:


tags: