Vaguery + infrastructure 39
[1109.5229] Distributed Algorithms for Optimal Power Flow Problem
december 2011 by Vaguery
"Optimal power flow (OPF) is an important problem for power generation and it is in general non-convex. With the employment of renewable energy, it will be desirable if OPF can be solved very efficiently so its solution can be used in real time. With some special network structure, e.g. trees, the problem has been shown to have a zero duality gap and the convex dual problem yields the optimal solution. In this paper, we propose a primal and a dual algorithm to coordinate the smaller subproblems decomposed from the convexified OPF. We can arrange the subproblems to be solved sequentially and cumulatively in a central node or solved in parallel in distributed nodes. We test the algorithms on IEEE radial distribution test feeders, some random tree-structured networks, and the IEEE transmission system benchmarks. Simulation results show that the computation time can be improved dramatically with our algorithms over the centralized approach of solving the problem without decomposition, especially in tree-structured problems. The computation time grows linearly with the problem size with the cumulative approach while the distributed one can have size-independent computation time."
operations-research
algorithms
network-theory
infrastructure
composition
nudge-targets
december 2011 by Vaguery
[1109.5641] Energy-Aware Load Balancing in Content Delivery Networks
december 2011 by Vaguery
"Internet-scale distributed systems such as content delivery networks (CDNs) operate hundreds of thousands of servers deployed in thousands of data center locations around the globe. Since the energy costs of operating such a large IT infrastructure are a significant fraction of the total operating costs, we argue for redesigning CDNs to incorporate energy optimizations as a first-order principle. We propose techniques to turn off CDN servers during periods of low load while seeking to balance three key design goals: maximize energy reduction, minimize the impact on client-perceived service availability (SLAs), and limit the frequency of on-off server transitions to reduce wear-and-tear and its impact on hardware reliability. We propose an optimal offline algorithm and an online algorithm to extract energy savings both at the level of local load balancing within a data center and global load balancing across data centers. We evaluate our algorithms using real production workload traces from a large commercial CDN. Our results show that it is possible to reduce the energy consumption of a CDN by more than 55% while ensuring a high level of availability that meets customer SLA requirements and incurring an average of one on-off transition per server per day. Further, we show that keeping even 10% of the servers as hot spares helps absorb load spikes due to global flash crowds with little impact on availability SLAs. Finally, we show that redistributing load across proximal data centers can enhance service availability significantly, but has only a modest impact on energy savings."
algorithms
load-balancing
infrastructure
nudge-targets
operations-research
december 2011 by Vaguery
The Free Freeways | Quiet Babylon
november 2011 by Vaguery
"To attempt to draw a political map of the reconstituted North America is to confront these contradictions head-on. What counts as a nation? How to capture the overlapping spheres of responsibility? What about the areas all but abandoned to wilderness? Does membership confer citizen-hood?"
Civil-War
disintermediation-in-action
dystopian-national-anthem
infrastructure
via:justtin-pickard
november 2011 by Vaguery
Why train departure information is not currently open data « Placr News
may 2011 by Vaguery
Going back in history, until February 2009 ATOC licensed train departure information under commercial terms to a very small number of organisations, mostly within the rail industry. Kizoom published the only smartphone app at that time, the free MyRailLite for iPhone. Then a dispute arose between ATOC and Kizoom, and ATOC withdrew Kizoom’s licence to use the train departure information. Kizoom complained to the ORR, who conducted an investigation (PDF) into whether ATOC had abused a dominant position under competition law. ORR decided that ATOC did have a dominant position in the supply of train departure information, but they “found no evidence that ATOC’s conduct in granting access to Darwin had prevented a new product from coming to market or hampered the emergence of new technology” in November 2009. When the free MyRailLite from Kizoom was taken off the market, it was immediately replaced by a £5 iPhone app from Agant which was marketed under the National Rail Enquiries brand.
enclosures
open-access
raw-data-now
infrastructure
government2.0
may 2011 by Vaguery
Technology Review: A New Kind of Logic Chip
august 2010 by Vaguery
"Whereas a conventional NAND gate outputs a "1" if neither of its inputs match, the output of a Bayesian NAND gate represents the odds that the two input probabilities match. This makes it possible to perform calculations that use probabilities as their input and output."
engineering-design
probability-theory
hardware
innovation
computing
infrastructure
want-want
nudge-targets
august 2010 by Vaguery
[1008.2160] An early warning method for crush
august 2010 by Vaguery
"Fatal crush conditions occur in crowds with tragic frequency. Event organisers and architects are often criticised for failing to consider the causes and implications of crush, but the reality is that the prediction and mitigation of such conditions offers a significant technical challenge. Full treatment of physical force within crowd simulations is precise but computationally expensive; the more common method of human interpretation of results is computationally "cheap" but subjective and time-consuming. In this paper we propose an alternative method for the analysis of crowd behaviour, which uses information theory to measure crowd disorder. We show how this technique may be easily incorporated into an existing simulation framework, and validate it against an historical event. Our results show that this method offers an effective and efficient route towards automatic detection of crush."
safety
engineering-design
infrastructure
algorithms
agent-based
nudge-targets
august 2010 by Vaguery
[1006.4627] Topological analysis of the power grid and mitigation strategies against cascading failures
june 2010 by Vaguery
"This paper presents a complex systems overview of a power grid network. In recent years, concerns about the robustness of the power grid have grown because of several cascading outages in different parts of the world. In this paper, cascading effect has been simulated on three different networks, the IEEE 300 bus test system, the IEEE 118 bus test system, and the WSCC 179 bus equivalent model, using the DC Power Flow Model. Power Degradation has been discussed as a measure to estimate the damage to the network, in terms of load loss and node loss. A network generator has been developed to generate graphs with characteristics similar to the IEEE standard networks and the generated graphs are then … have been suggested."
nudge-targets
infrastructure
robustness
network-theory
complexology
systems-engineering
electricity
utilities
june 2010 by Vaguery
[1006.4342] Formal Derivation of Concurrent Garbage Collectors
june 2010 by Vaguery
"…Even though we cannot present all the algorithms in full detail, we can at least show “in princi- ple”, how a whole variety of important and practical algorithms come out from our refinement process. These include above all the (DLG) algorithm of Doligez, Leroy and Gonthier [9] – which sometimes is considered the culmination of concurrent collector development [1] – and its descendants."
computer-science
infrastructure
interpreters
software-architecture
nudge-targets
june 2010 by Vaguery
[1006.3334] Optimal whitespace synchronization strategies
june 2010 by Vaguery
"To our knowledge, the two most prominent aspects of our setting, the presence of asymmetric information and the stationarity requirement (stemming from unknown start times) have not been considered in the literature. For example, the Anderson-Weber strategy for the telephone problem is not stationary — it has a period of n − 1. It would be interesting to see what can be said about the optimal stationary strategies for this and other rendezvous problems. The interested reader is referred to [2,3] and the references therein for more information on rendezvous search games."
nudge-targets
wireless
communication
mechanism-design
planning
infrastructure
june 2010 by Vaguery
[1005.3835] A Better Memoryless Online Algorithm for FIFO Buffering Packets with Two Values
may 2010 by Vaguery
"We consider scheduling weighted packets in a capacity-bounded buffer. In this model, there is a buffer with a limited capacity B such that at any time, the buffer cannot accommodate more than B packets. Packets arrive over time. Each packet has a non-negative real value. Packets do not expire and they leave the buffer only because either we send them or we drop them. The packets that have left the buffer will not be reconsidered for delivery any more. In each time step, at most one packet in the buffer can be sent. The order in which the packets are sent should comply with the order of their arriving time. The objective is to maximize the total value of the packets sent in an online manner.…"
nudge-targets
engineering-design
algorithms
network-design
infrastructure
optimization
queueing
may 2010 by Vaguery
cloudkick | blog: 4 Months with Cassandra, a love story
march 2010 by Vaguery
"Write performance in Cassandra is excellent. The internals are specifically geared towards a heavy-write system. It writes to a memory table and a serial commit log, and every so often the memory table is flushed to disk in what the Big Table paper describes as a sorted strings table, often called an SSTable — an immutable data structure. There is a lot more happening behind the scenes, but the performance characteristics are clear: there is nothing slow in the write path. The Cassandra wiki page on Architecture Internals provides more details."
infrastructure
distributed-processing
cloud-computing
databases
architecture
administration
opensource
scalability
storage
march 2010 by Vaguery
Ascription is an Anathema to any Enthusiasm › Into the Woods
february 2010 by Vaguery
"These are provocative ideas. Very analogous to the ideas found in the ping hub discussions and the peer to peer discussions. It would be fun to try and build a heuristic prefeching/pushing privacy respecting http proxy server swarm along these lines. No doubt somebody already has."
infrastructure
internet
networked-computing
networking
lecture
future
february 2010 by Vaguery
Technology Review: A 50-Watt Cellular Network
february 2010 by Vaguery
"Over the past year, VNL, based in Haryana, India, has reengineered the traditional technology of the dominant cellular standard, called GSM, in order to create base stations that only require between 50 and 150 watts of power, supplied by a solar-charged battery. The components can be assembled and booted up by two people and mounted on a rooftop in six hours."
engineering
infrastructure
cell-network
developing-countries
disintermediation-in-action
innovation
adhockery
february 2010 by Vaguery
Feature Tour: tgethr
january 2010 by Vaguery
"Email is still the easiest way to collaborate with a group of people.
We built tgethr in response to the increasingly complex world of online collaboration. Why set up a project management site or an entire social network when all you need is to correspond by email more efficiently?"
maybe
collaboration
teams
project-management
infrastructure
distributed-teams
We built tgethr in response to the increasingly complex world of online collaboration. Why set up a project management site or an entire social network when all you need is to correspond by email more efficiently?"
january 2010 by Vaguery
The Secret Diary of Steve Jobs : A not-so-brief chat with Randall Stephenson of AT&T
december 2009 by Vaguery
"You, Randall Stephenson, and your lazy stupid company — you are the problem. You are what’s wrong with this country."
infrastructure
telephone
AT&T
iPgibw
Apple
economy
financial-crisis
cultural-norms
business-model-failure
december 2009 by Vaguery
MPAA shuts down entire town's muni WiFi over a single download - Boing Boing
november 2009 by Vaguery
"The MPAA has successfully shut down an entire town's municipal WiFi because a single user was found to be downloading a copyrighted movie. Rather than being embarrassed by this gross example of collective punishment (a practice outlawed in the Geneva conventions) against Coshocton, OH, the MPAA's spokeslizard took the opportunity to cry poor (even though the studios are bringing in record box-office and aftermarket receipts)."
RIAA
intellectual-property
rights
copyright
stupidity
WiFi
open-access
infrastructure
community
command-and-control
november 2009 by Vaguery
You're An Idiot For Not Using Heroku // RailsTips by John Nunemaker
november 2009 by Vaguery
"It is true. You are. Go try it now. That is an order. I can wait for you to come back and finish reading this post. I could end the post now, but I suppose I’ll go on and tell you a bit about my experience with Heroku yesterday."
ruby
web2.0
cloud-computing
deployment
software-development
infrastructure
rails
production
november 2009 by Vaguery
CRAN Task View: Empirical Finance
november 2009 by Vaguery
[R tools for financial time-series analysis, among other things]
statistics
library
programming
infrastructure
finance
models
Nudge
simulation
learning-from-data
when-in-Roma
november 2009 by Vaguery
Open Source Science? Or Distributed Science? : Common Knowledge
november 2009 by Vaguery
"Open source, if we view it through a different lens, is really more about a distributed methodology for software development. The burden of creation is widely distributed across a massive community with more-or-less equal access to tools and systems. In this context, the role of the legal tool is more akin to an enzyme. It was an essential piece of a puzzle, but it was not the only piece. In fact, without the rest of the infrastructure (connectivity, tools, and people) the legal tool on its own would not have led us to GNU/Linux."
openness
distributed
crowdsourcing
science
science2.0
community
collaboration
infrastructure
academia
academic-culture
november 2009 by Vaguery
Bullet Trains for America?
november 2009 by Vaguery
"High-speed rail doesn’t simply proceed from point A to point B; it has the potential to energize the cities and towns where it stops in between. The normal practice is to locate intermediate stations in populated areas roughly 50 miles apart. In Europe, high-speed railroads have generated the most growth in provincial cities, as once remote districts benefit from their newfound closeness to hubs such as Paris and Berlin. In a century that will demand more compact, energy-efficient development, high-speed rail has the potential to establish a new superstructure for growth."
rail
transportation
infrastructure
trains
public-policy
planning
november 2009 by Vaguery
Global Guerrillas: BASIC SYSTEMS DISRUPTION
november 2009 by Vaguery
"System disruption leverages network structure and dynamics to turn small attacks into large events. Selection of the best point to attack is based on an analysis of the network's design and flows. The term to describe this point is: the systempunkt. Essentially, the systempunkt is the point in the network, that if attacked, will yield the maximal possible impact."
networks
social-networks
infrastructure
war
terrorism
military
disruption
defensive-networking
diversity-as-defense
november 2009 by Vaguery
Emphasized Insanity: Rails Developers workstations revealed
october 2009 by Vaguery
"For a while i was interested to see how many of the rails developers i know, use macs. After talking about this urge of mine with the awesome @hakunin we have decided to collect a bunch of our colleagues desktop portraits. almost everyone is on a mac (duh!).
Foolishly, i forgot to notate some of the pictures people sent me with the name of the developer, so if you recognize yours and want to link the image/title to somewhere, lemme know."
workplace
desk
infrastructure
makers
programming
monitors-out-the-wazoo
Foolishly, i forgot to notate some of the pictures people sent me with the name of the developer, so if you recognize yours and want to link the image/title to somewhere, lemme know."
october 2009 by Vaguery
RSS never blocks you or goes down: why social networks need to be decentralized - O'Reilly Radar
september 2009 by Vaguery
"rssCloud is meant to carry more frequent traffic and more content than the original RSS and Atom. It maintains an XML format (making it relatively verbose for SMS, although Winer tries to separate out the rich, enhanced data). Perhaps because of the increased traffic it would cause, it's less decentralized than RSS, storing updates in Amazon S2."
peer-to-peer
community
infrastructure
rssCloud
centralization
protocols
p2p
collaboration
social-networks
via:timoreilly
september 2009 by Vaguery
Sociological Images » AFTER THE OIL BOOM: IMAGES OF AN OIL BUST
january 2009 by Vaguery
Consider replacing "oil" with "auto".
"But with any energy boom eventually comes the energy bust. Here are some photos I took showing what a community looks like if its economy is disproportionately based on oil and the oil companies leave. I’m not a particularly good photographer, so these aren’t artistically impressive, but they capture what the area looks like now."
economics
infrastructure
community
economic-crisis
localism
abandonment
industry
monoculture
culture
"But with any energy boom eventually comes the energy bust. Here are some photos I took showing what a community looks like if its economy is disproportionately based on oil and the oil companies leave. I’m not a particularly good photographer, so these aren’t artistically impressive, but they capture what the area looks like now."
january 2009 by Vaguery
The Day The Web Went Dead - Forbes.com
december 2008 by Vaguery
"The recent disruption marked the final blowup in a year-long game of chicken played by Sprint Nextel and Cogent and brought to light an uncomfortable reality: The Internet is held together by collection of secret contracts struck between private companies, free from government oversight and regulation."
infrastructure
Internet
backbone
utility
commons
regulation
net-neutrality
bad
december 2008 by Vaguery
Publicly Owned Broadband | Re/Creating Tampa
october 2008 by Vaguery
"This decision has confirmed what was already obvious from a plain reading of the statutes, that Minnesota cities can use their bonding authority for deploying the essential infrastructure of the next century."
infrastructure
public-policy
innovation
open-access
public-good
commons
government
local
october 2008 by Vaguery
On the Rails Again -- and Off
january 2008 by Vaguery
"...overtime is any time when you wish you weren't at the office"
XP
retrospective
extreme-programming
Ron-Jeffries
Chet-Hendrickson
Rails
RoR
infrastructure
development
january 2008 by Vaguery
related tags
abandonment ⊕ academia ⊕ academic-culture ⊕ adhockery ⊕ administration ⊕ aeronautics ⊕ agent-based ⊕ airports ⊕ algorithms ⊕ animation ⊕ Apple ⊕ architecture ⊕ AT&T ⊕ auth&auth ⊕ authorization ⊕ backbone ⊕ bad ⊕ batteries ⊕ business-model-failure ⊕ cell-network ⊕ centralization ⊕ CGI ⊕ Chet-Hendrickson ⊕ Civil-War ⊕ cloud-computing ⊕ collaboration ⊕ command-and-control ⊕ commons ⊕ communication ⊕ community ⊕ complexology ⊕ composition ⊕ computer-science ⊕ computing ⊕ concurrency ⊕ conferences ⊕ copyright ⊕ crowdsourcing ⊕ cultural-norms ⊕ culture ⊕ customer-relations ⊕ data ⊕ data-analysis ⊕ data-centers ⊕ databases ⊕ datasets ⊕ defensive-networking ⊕ deployment ⊕ desk ⊕ developing-countries ⊕ development ⊕ disintermediation ⊕ disintermediation-in-action ⊕ disruption ⊕ distributed ⊕ distributed-processing ⊕ distributed-teams ⊕ diversity-as-defense ⊕ dystopian-national-anthem ⊕ economic-crisis ⊕ economics ⊕ economy ⊕ electricity ⊕ emergency-preparedness ⊕ enclosures ⊕ energy ⊕ energy-efficiency ⊕ energy-storage ⊕ engineering ⊕ engineering-design ⊕ extreme-programming ⊕ filmmaking ⊕ finance ⊕ financial-crisis ⊕ future ⊕ government ⊕ government2.0 ⊕ grid-computing ⊕ guide ⊕ ham-radio ⊕ hardware ⊕ history ⊕ images ⊕ industry ⊕ infrastructure ⊖ innovation ⊕ intellectual-property ⊕ internet ⊕ interpreters ⊕ iPgibw ⊕ landscape-architecture ⊕ layered-history ⊕ learning-from-data ⊕ lecture ⊕ library ⊕ load-balancing ⊕ local ⊕ localism ⊕ lost ⊕ makers ⊕ maps ⊕ maybe ⊕ mechanism-design ⊕ metadata ⊕ middleware ⊕ military ⊕ models ⊕ monitors-out-the-wazoo ⊕ monoculture ⊕ nanohistory ⊕ net-neutrality ⊕ network-design ⊕ network-theory ⊕ networked-computing ⊕ networking ⊕ networks ⊕ nudge ⊕ nudge-targets ⊕ open-access ⊕ openness ⊕ opensource ⊕ operations-research ⊕ optimization ⊕ p2p ⊕ peer-to-peer ⊕ performance ⊕ photography ⊕ planning ⊕ power-distribution ⊕ privacy ⊕ probability-theory ⊕ production ⊕ programming ⊕ project-management ⊕ protocols ⊕ public-domain ⊕ public-good ⊕ public-planning ⊕ public-policy ⊕ queueing ⊕ rail ⊕ rails ⊕ raw-data-now ⊕ regulation ⊕ REST ⊕ retrospective ⊕ RIAA ⊕ rights ⊕ robustness ⊕ Ron-Jeffries ⊕ RoR ⊕ rssCloud ⊕ ruby ⊕ ruins ⊕ safety ⊕ scalability ⊕ scaling ⊕ science ⊕ science2.0 ⊕ security ⊕ semantic ⊕ server-farm ⊕ simulation ⊕ social ⊕ social-networks ⊕ software ⊕ software-architecture ⊕ software-development ⊕ sprawlette ⊕ statistics ⊕ storage ⊕ stupidity ⊕ sustainability ⊕ systems-engineering ⊕ tagging ⊕ targets ⊕ teams ⊕ telecommunications ⊕ telephone ⊕ terrorism ⊕ trains ⊕ transportation ⊕ utilities ⊕ utility ⊕ via:bkerr ⊕ via:iamsidd2k7 ⊕ via:justtin-pickard ⊕ via:nielsen ⊕ via:spangledrongo ⊕ via:timoreilly ⊕ via:vielmetti ⊕ video ⊕ walled-gardens ⊕ want-want ⊕ war ⊕ water ⊕ weather ⊕ web-design ⊕ web2.0 ⊕ when-in-Roma ⊕ WiFi ⊕ wireless ⊕ workplace ⊕ XP ⊕Copy this bookmark: