mcroydon + scalability   165

MemoryImage
Something that Martin Fowler said.
data  memory  database  performance  scalability 
september 2011 by mcroydon
Mu Dynamics Blog » Speed Limit of PaaS – 64K TCP Ports
Multi-homing is the way to get around connection limits.
node  ops  paas  scalability 
august 2011 by mcroydon
Pressflow makes Drupal scale | Four Kitchens: the Drupal experts
"Pressflow is a distribution of Drupal with integrated performance, scalability, availability, and testing enhancements."
drupal  performance  scalability  optimization  cms 
december 2010 by mcroydon
OpenTSDB - A Distributed, Scalable Monitoring System
OpenTSDB is a distributed, scalable Time Series Database (TSDB) written on top of HBase. OpenTSDB was written to address a common need: store, index and serve metrics collected from computer systems (network gear, operating systems, applications) at a large scale, and make this data easily accessible and graphable.
analysis  architecture  bigdata  cloud  data  database  db  java  lgpl  hbase  hadoop  development  graph  distributed  monitoring  nosql  opensource  operations  scalability  scale  time  sysadmin  software  storage  series  opentsdb  rrd  stumbleupon  time-series  timeseries 
november 2010 by mcroydon
s4: distributed stream computing platform
"S4 is a general-purpose, distributed, scalable, partially fault-tolerant, pluggable platform that allows programmers to easily develop applications for processing continuous unbounded streams of data."
apache  bigdata  cloud  cloudcomputing  cluster  computing  mapreduce  map  java  hadoop  framework  distributed  data  opensource  processing  platform  programming  real-time  streaming  stream  software  scalability  reduce  realtime  streamprocessing  yahoo  tool  s4  streams 
november 2010 by mcroydon
SHARD Triple-Store
"SHARD is a proof-of-concept use of high-performance, low-cost distributed computing technology to develop a highly scalable triple-store. SHARD is released as an open-source project on the BSD license."
database  db  cloud  distributed  hadoop  lubm  mapreduce  rdf  store  sparql  storage  shard  semweb  semanticweb  scalability  triple-store 
october 2010 by mcroydon
cloudkick | blog: 4 Months with Cassandra, a love story
A very interesting look at Cassandra with an eye toward gotchas. Cloudkick are doing some interesting stuff with aggregation over time periods.
admin  via:jacobian  administration  architecture  article  cassandra  database  databases  opensource  nosql  mysql  monitoring  django  distributed  db  datawarehouse  python  scalability  scaling  storage  toread  webdev  programming  cloudkick  neat 
march 2010 by mcroydon
The Basho Blog: Why Vector Clocks are Easy
Straightforward but very powerful message/value versioning conflict avoidance. This reminds me of git in a way since to avoid conflicts each message bust contain all predecessors in its vector mask.
programming  toread  tutorial  scalability  distributed  algorithm  concurrency  event  nosql  vector  versioning  via:chl  clock  dist  riak  basho  vectorclocks  distributed_systems  vector-clocks  clocks  vectorclock 
january 2010 by mcroydon
round-robin django setup with nginx - small py
Interesting tactic where multiple backends can be tried before returning an error if you set the timeout low enough.
python  web  django  server  scalability  performance  sysadmin  scaling  coding  http  deployment  infrastructure  traffic  webserver  nginx  config  load_balancing  roundrobin 
december 2009 by mcroydon
Extreme Agility at Facebook | blog@CACM | Communications of the ACM
"Another aspect of the Facebook engineering team is how large the ratio of active user to developer is. Currently it stands at 1.1 million users per developer."
programming  development  howto  scalability  architecture  scaling  management  engineering  memcached  facebook  process  agile  acm  hive  scribe  oopsla  niho  cacm 
november 2009 by mcroydon
Journal of Eivind Uggedal: NoSQL East 2009 - Summary of Day 1
Some interesting bits and more of the same but I really like the dark-launch approach that Scribe allows.
data  database  toread  blog  scalability  internet  distributed  article  hadoop  scaling  db  cloud  couchdb  conference  papers  keyvalue  nosql  links  cassandra  2009  mongodb  dynomite  riak 
november 2009 by mcroydon
Traffic Server is finally here | Ogre.com
Yahoo! open sourced tech originally acquired from Inktomi. It's a caching proxy with some pretty advanced features.
web  software  opensource  server  scalability  internet  performance  sysadmin  todo  http  apache  cache  yahoo  nginx  proxy  trafficserver  squid 
october 2009 by mcroydon
LucidDB Home Page
"LucidDB is the first and only open-source RDBMS purpose-built entirely for data warehousing and business intelligence. It is based on architectural cornerstones such as column-store, bitmap indexing, hash join/aggregation, and page-level multiversioning."
programming  software  development  database  data  business  opensource  java  scalability  storage  distributed  cluster  databases  sql  db  datamining  olap  columndb  bi  datawarehouse  dbms  reporting  rdbms  luciddb  column  warehousing  column-store  data_warehouse  column-oriented  dwh 
october 2009 by mcroydon
Geeking with Greg: Advice from Google on large distributed systems
With links to slides from LADIS '09. This includes a refresh and update about how GFS, MapReduce, etc are working in Google's fault-filled environment.
programming  google  blog  scalability  storage  performance  architecture  distributed  advice  scaling  infrastructure  systems  datacenters 
october 2009 by mcroydon
Riak - A Decentralized Database
"Riak combines a decentralized key-value store, a flexible map/reduce engine, and a friendly HTTP/JSON query interface to provide a database ideally suited for Web applications." Erlang under the hood.
programming  web  development  key-value  database  webdev  opensource  erlang  storage  scalability  distributed  rest  databases  http  mapreduce  json  db  couchdb  store  kvstore  datastore  keyvalue  nosql  document  cloudcomputing  riak  decentralized  basho  documentoriented  key-value-store 
october 2009 by mcroydon
4store - Scalable RDF storage
"At times holding and running queries over databases of 15GT, supporting a Web application used by thousands of people."
programming  web  software  open-source  development  data  database  opensource  scalability  storage  databases  gpl  rdf  store  db  c  semantic  semanticweb  repository  ontology  semweb  semantic-web  triplestore  sparql  garlik  4store  triple-store  rdfstore  triple  websemantique 
august 2009 by mcroydon
Coding Horror: Scaling Up vs. Scaling Out: Hidden Costs
Food for thought with the caveat that scaling out is a lot easier if you don't have any per-server software costs. Big iron costs less to operate though.
programming  hardware  business  server  scalability  coding  networking  architecture  performance  distributed  scaling  web-development  cluster  hadoop  hosting  clustering  comparison  servers  distribution  it  codinghorror  2009  stackoverflow 
june 2009 by mcroydon
Neo4j - a Graph Database that Kicks Buttox | High Scalability
The most common complaint about existing graph databases is performance. Hopefully a stable of good, performant graph databases will change that.
data  database  toread  visualization  java  opensource  network  scalability  cool  architecture  performance  graph  hadoop  databases  db  graphs  2009  arch  socialnetworking  socialmedia  dataviz  neo4j  graph_database  graph-database  relationship 
june 2009 by mcroydon
katta - distributed lucene
"Katta serves large, replicated, Lucene indexes as shards to serve high loads and very large data sets."
software  development  java  search  scalability  performance  scaling  distributed  apache  hadoop  clustering  cloud  grid  lucene  tool  indexing  project  ir  searchengine  information-retrieval  dist  package  hdfs  katta 
june 2009 by mcroydon
« earlier      

related tags

2read  4store  @toread  academia  academic  acm  activemq  activity  activitystreams  ad  admin  administration  ads  advice  agency  aggregator  agile  ajax  algorithm  algorithms  alternative  amazing  amazon  ampq  amqp  analysis  analytics  android  apache  api  app  appengine  application  arch  architecture  arquitectura  article  articles  async  asynchronous  authentication  autocomplete  availability  aws  backfill  backfilling  backup  balancer  balancing  basho  batch  beanstalk  beanstalkd  benchmark  benchmarks  berkeley  bert  bestpractices  bi  bigdata  bigpipe  bigtable  bin  binary  bizgres  blob  blog  book  business  businessintelligence  c  c1m  c10k  cache  caching  cacm  caffeine  cap  cascading  casestudy  cassandra  catapult  cdn  celery  center  certificate  certificates  chart  classes  click  client  clientside  clock  clocks  cloud  cloud-computing  cloudcomputing  cloudera  cloudkick  cluster  clustering  clusters  cms  code  codecs  coding  codinghorror  collaboration  collection  colossus  column  column-oriented  column-store  columndb  comet  comment  commercial  communication  communications  company  compare  comparison  components  compression  compsci  computer  computer-science  computers  computerscience  computing  concurrence  concurrency  concurrent  condor  conference  config  consistency  consistent  console  consulting  container  conversion  convert  cool  cooling  cost  couchdb  course  courses  craigslist  cron  crypto  cryptography  cs  css  danga  data  data-warehousing  database  databases  datacenter  datacenters  datamining  dataset  datastore  datastructures  dataviz  datawarehouse  data_warehouse  db  dbms  dc  debian  debug  debugging  decentralized  demand  deploy  deployment  design  dev  develop  developer  development  dht  dictionary  differences  digg  dist  distributed  distributed-computing  distributedcomputing  distributed_systems  distribution  django  django-apps  djangocon  document  documentation  documentoriented  drupal  dw  dwh  dynamo  dynomite  ebay  ebs  ec2  education  elastic  email  encode  encoder  encoding  encryption  energy  engineering  engineyard  english  enterprise  epoll  erlang  eval  evaluation  event  example  expectations  experience  facebook  farmville  fast  fb  federation  feed  ffmpeg  file  filesystem  fileupload  firefox  firewall  flash  flickr  flockdb  flv  form  formidable  forms  foss  framework  frameworks  freebase  friendfeed  frontend  future  gae  gamedev  games  gaming  garlik  geek  gfs  gfs2  git  github  gmail  google  gpl  graph  graph-database  graphdb  graphs  graph_database  greenplum  grid  gridcomputing  gui  ha  hacking  hadoop  hadoopdb  happy  hardware  hash  hashing  haystack  hbase  hdfs  high-availability  highavailability  hive  hosting  howto  hpc  htc  html  html5  http  httpd  https  hypertable  ideas  image  images  imported  index  indexing  information  information-retrieval  infrastructure  inspiration  intelligence  interesting  internet  interview  intridea  introduction  iphone  ir  irb  irc  issues  it  java  javascript  jaylinks  jms  job  jobs  js  json  justin  justin.tv  jvm  jython  katta  kellan  kestrel  key  key-value  key-value-store  keystore  keyvalue  kvs  kvstore  language  large  last.fm  latency  laughingmeme  law  lehigh  lesen  lgpl  lib  libevent  library  lifestream  lightcloud  lighttpd  linkedin  links  linux  list  lists  live  load  load-balancing  loadbalancing  load_balancing  longpolling  lua  lubm  lucene  luciddb  machine-learning  machinelearning  mail  mailinator  management  map  map-reduce  mapreduce  mathematics  memcache  memcached  memory  message  messagequeue  messages  messaging  metadata  metaweb  metrics  migration  misc  mobile  mod  model  module  mod_backhand  mod_python  mod_ssl  mogilefs  mongo  mongodb  mongosf  mongrel  monitor  monitoring  mq  multipart  munin  mustuse  mysql  nasa  neat  neo4j  network  networking  networks  news  nfs  nginx  niho  nio  nlp  node  node.js  nodejs  nokia  nosql  notes  olap  on  ondemand  online  ontology  oopsla  open  open-source  opensource  openssl  opentsdb  open_source  operations  ops  optimisation  optimization  os  oss  overclocking  overview  owl  p2p  paas  package  paper  papers  parallel  parse  parser  parsing  partition  pattern  patterns  paxos  peep  performance  perlbal  persistence  photo  photos  php  pictures  pig  ping.fm  pipelining  platform  plugin  plurk  poker  post  postgres  postgresql  power  presentation  presentations  process  processing  production  profile  profiler  programming  project  protocol  proxy  puppet  push  py-amqplib  pycon  python  qa  quality  query  queue  queues  queuing  rabbitmq  rack  rackspace  rails  rdbms  rdf  rdfstore  read  reading  readlater  real-time  realtime  recommendations  reddit  redis  reduce  reference  regex  relational  relationaldb  relationship  replication  reporting  repository  research  resource  resources  rest  reverse-proxy  review  riak  ringo  ror  roundrobin  rrd  ruby  ruby-on-rails  rubyonrails  s3  s4  saas  samples  scala  scalability  scalable  scalaris  scale  scaling  scalr  schema  schema-less  schemaless  school  screencast  scribe  scripting  search  searchengine  security  semantic  semantic-web  semanticweb  semantic_web  semweb  seo  series  server  servers  service  services  sesame  shard  sharded  sharding  shards  simpledb  simulation  skype  slide  slides  slideshare  slideshow  social  socialmedia  socialnetworking  socialsoftware  social_networking  sockets  software  softwareengineering  solr  solution  someday  source  sparql  speed  sphinx  sql  sqs  squid  ssh  ssjs  ssl  stack  stackless  stackoverflow  standards  stanford  starling  startup  startups  statistics  stats  storage  store  strategy  stream  streaming  streamprocessing  streams  stumbleupon  sysadmin  system  systems  talkinator  talks  task  tasks  tcp  tech  technology  test  testing  theorem  threading  time  time-series  timeseries  tips  tls  to-read  todo  tokyo-cabinet  tokyo-tyrant  tokyocabinet  tokyotyrant  tomcat  tool  tools  toread  tornado  tour  to_read  tracking  traffic  trafficserver  transactions  transcoding  trend  trends  triple  triple-store  triplestore  tumblr  tuning  turbogears  tutorial  tutorials  tv  twisted  twitter  ui  unicorn  university  unix  unread  upload  uploads  urbanairship  usability  utilities  utility  ux  validation  value  vc  vector  vector-clocks  vectorclock  vectorclocks  versioning  via:chl  via:jacobian  via:pskomoroch  video  videos  virtualization  visualization  vldb  voldemort  vps  vs  w3c  warehouse  warehousing  watch  web  web-development  web-server  web-services  web2.0  webapp  webdesign  webdev  webdevelopment  webhosting  websemantique  webserver  webservice  webservices  website  websites  wiki  wikipedia  windows  wishlist  work  wsgi  xen  xfs  xml  yahoo  yale  yam  youtube  yui  zynga 

Copy this bookmark:



description:


tags: