cshalizi + to_teach:complexity-and-inference   127

[1205.3208] A New Family of Generalized 3D Cat Maps
"Since the 1990s chaotic cat maps are widely used in data encryption, for their very complicated dynamics within a simple model and desired characteristics related to requirements of cryptography. The number of cat map parameters and the map period length after discretization are two major concerns in many applications for security reasons. In this paper, we propose a new family of 36 distinctive 3D cat maps with different spatial configurations taking existing 3D cat maps [1]-[4] as special cases. Our analysis and comparisons show that this new 3D cat maps family has more independent map parameters and much longer averaged period lengths than existing 3D cat maps. The presented cat map family can be extended to higher dimensional cases."

(to_teach tags for clsses which use the cat map as an example)
to:NB  cat_map  dynamical_systems  cryptography  to_teach:complexity-and-inference  to_teach:statcomp  to_teach:undergrad-ADA 
12 days ago by cshalizi
Constructing summary statistics for approximate Bayesian computation: semi-automatic approximate Bayesian computation - Fearnhead - 2012 - Journal of the Royal Statistical Society: Series B (Statistical Methodology) - Wiley Online Library
"Many modern statistical applications involve inference for complex stochastic models, where it is easy to simulate from the models, but impossible to calculate likelihoods. Approximate Bayesian computation (ABC) is a method of inference for such models. It replaces calculation of the likelihood by a step which involves simulating artificial data for different parameter values, and comparing summary statistics of the simulated data with summary statistics of the observed data. Here we show how to construct appropriate summary statistics for ABC in a semi-automatic manner. We aim for summary statistics which will enable inference about certain parameters of interest to be as accurate as possible. Theoretical results show that optimal summary statistics are the posterior means of the parameters. Although these cannot be calculated analytically, we use an extra stage of simulation to estimate how the posterior means vary as a function of the data; and we then use these estimates of our summary statistics within ABC. Empirical results show that our approach is a robust method for choosing summary statistics that can result in substantially more accurate ABC analyses than the ad hoc choices of summary statistics that have been proposed in the literature. We also demonstrate advantages over two alternative methods of simulation-based inference."
to:NB  indirect_inference  estimation  statistics  approximate_bayesian_computation  computational_statistics  to_teach:complexity-and-inference  re:stacs 
13 days ago by cshalizi
Periodic stripe formation by a Turing mechanism operating at growth zones in the mammalian palate : Nature Genetics : Nature Publishing Group
"We present direct evidence of an activator-inhibitor system in the generation of the regularly spaced transverse ridges of the palate. We show that new ridges, called rugae, that are marked by stripes of expression of Shh (encoding Sonic hedgehog), appear at two growth zones where the space between previously laid rugae increases. However, inter-rugal growth is not absolutely required: new stripes of Shh expression still appeared when growth was inhibited. Furthermore, when a ruga was excised, new Shh expression appeared not at the cut edge but as bifurcating stripes branching from the neighboring stripe of Shh expression, diagnostic of a Turing-type reaction-diffusion mechanism. Genetic and inhibitor experiments identified fibroblast growth factor (FGF) and Shh as components of an activator-inhibitor pair in this system. These findings demonstrate a reaction-diffusion mechanism that is likely to be widely relevant in vertebrate development."
to_read  to:NB  pattern_formation  biology  morphogenesis  reaction-diffusion  turing_mechanism  via:aks  to_teach:complexity-and-inference  re:stacs  experimental_biology  to:blog 
12 weeks ago by cshalizi
Segregation That No One Seeks [JSTOR: Philosophy of Science, Vol. 79, No. 1 (January 2012), pp. 38-62]
"This article examines a series of Schelling-like models of residential segregation, in which agents prefer to be in the minority. We demonstrate that as long as agents care about the characteristics of their wider community, they tend to end up in a segregated state. We then investigate the process that causes this and conclude that the result hinges on the similarity of informational states among agents of the same type. This is quite different from Schelling-like behavior and suggests (in his terms) that segregation is an instance of macrobehavior that can arise from a wide variety of micromotives."
to:NB  schelling_model  to_teach:complexity-and-inference 
february 2012 by cshalizi
Mechanisms, Types, and Abstractions
"Machamer, Darden, and Craver’s account of the nature and role of mechanisms in the special sciences has been very influential. Unfortunately, a confusing array of ontic, epistemic, and pragmatic distinctions is required to individuate their mechanisms, mechanism schemata, and mechanism sketches. I diagnose this as a conflation of token-level causal relations with type-level relations. I propose instead that a mechanism is an abstraction that relates entity types and activity types on the model of a directed graph. Mechanisms have an ontic status distinct from the causal chains of token entities and token activities that instantiate them."
to:NB  explanation_by_mechanisms  causal_inference  philosophy_of_science  to_teach:complexity-and-inference 
january 2012 by cshalizi
Heavy tail phenomenon and convergence to stable laws for iterated Lipschitz maps
To many math symbols to copy the abstract. Shorter: iterating randomly chosen Lipschitz maps can lead to time-averges converging to a heavy-tailed distribution.
to:NB  to_read  heavy_tails  stochastic_processes  dynamical_systems  to_teach:complexity-and-inference 
november 2011 by cshalizi
Phys. Rev. E 84, 016223 (2011): Optimal reconstruction of dynamical systems: A noise amplification approach
"In this work we propose an objective function to guide the search for a state space reconstruction of a dynamical system from a time series of measurements. These statistics can be evaluated on any reconstructed attractor, thereby allowing a direct comparison among different approaches: (uniform or nonuniform) delay vectors, PCA, Legendre coordinates, etc. It can also be used to select the most appropriate parameters of a reconstruction strategy. In the case of delay coordinates this translates into finding the optimal delay time and embedding dimension from the absolute minimum of the advocated cost function. Its definition is based on theoretical arguments on noise amplification, the complexity of the reconstructed attractor, and a direct measure of local stretch which constitutes an irrelevance measure. The proposed method is demonstrated on synthetic and experimental time series."
attractor_reconstruction  dynamical_systems  statistics  to:NB  re:stacs  to_teach:complexity-and-inference  to_read 
july 2011 by cshalizi
Network structure of production
"Complex social networks have received increasing attention from researchers. Recent work has focused on mechanisms that produce scale-free networks. We theoretically and empirically characterize the buyer–supplier network of the US economy and find that purely scale-free models have trouble matching key attributes of the network. We construct an alternative model that incorporates realistic features of firms’ buyer–supplier relationships and estimate the model’s parameters using microdata on firms’ self-reported customers. This alternative framework is better able to match the attributes of the actual economic network and aids in further understanding several important economic phenomena."
to_read  networks  economics  to_teach:complexity-and-inference  heavy_tails 
march 2011 by cshalizi
Serotonin Mediates Behavioral Gregarization Underlying Swarm Formation in Desert Locusts
"Desert locusts, Schistocerca gregaria, show extreme phenotypic plasticity, transforming between a little-seen solitarious phase and the notorious swarming gregarious phase depending on population density. An essential tipping point in the process of swarm formation is the initial switch from strong mutual aversion in solitarious locusts to coherent group formation and greater activity in gregarious locusts. We show here that serotonin, an evolutionarily conserved mediator of neuronal plasticity, is responsible for this behavioral transformation, being both necessary if behavioral gregarization is to occur and sufficient to induce it. Our data demonstrate a neurochemical mechanism linking interactions between individuals to large-scale changes in population structure and the onset of mass migration."
locusts  insects  neuroscience  endocrinology  social_neuroscience  to_teach:complexity-and-inference  to:NB  serotonin  self-organization  reductionism 
march 2011 by cshalizi
[1102.1182] Phase transition in the detection of modules in sparse networks
"We present an asymptotically exact analysis of the problem of detecting communities in sparse random networks. Our results are also applicable to detection of functional modules, partitions, and colorings in noisy planted models. Using a cavity method analysis, we unveil a phase transition from a region where the original group assignment is undetectable to one where detection is possible. In some cases, the detectable region splits into an algorithmically hard region and an easy one. Our approach naturally translates into a practical algorithm for detecting modules in sparse networks, and learning the parameters of the underlying model." --- This is really an EM algorithm, not a Bayesian method.
community_discovery  have_read  kith_and_kin  phase_transitions  network_data_analysis  moore.cris  belief_propagation  re:stacs  to_teach:complexity-and-inference 
february 2011 by cshalizi
[1101.5591] Physical, transparent derivation of the contagion condition for spreading processes on generalized random networks
"For a broad range single-seed contagion processes acting on generalized random networks, we derive a unifying analytic expression for the possibility of global spreading events in a straightforward, physically intuitive fashion. Our reasoning lays bare a direct mechanical understanding of an archetypal spreading phenomena that is not evident in circuitous extant mathematical approaches."  (Are they really that circuitous?)
networks  epidemic_models  to_teach:complexity-and-inference  to_read  re:social-networks-as-sensor-networks 
february 2011 by cshalizi
Propagation of innovations in networked groups.
"A novel paradigm was developed to study the behavior of groups of networked people searching a problem space. The authors examined how different network structures affect the propagation of information in laboratory-created groups. Participants made numerical guesses and received scores that were also made available to their neighbors in the network. The networks were compared on speed of discovery and convergence on the optimal solution. One experiment showed that individuals within a group tend to converge on similar solutions even when there is an equally valid alternative solution. Two additional studies demonstrated that the optimal network structure depends on the problem space being explored, with networks that incorporate spatially based cliques having an advantage for problems that benefit from broad exploration, and networks with greater long-range connectivity having an advantage for problems requiring less exploration."
social_networks  experimental_psychology  collective_cognition  social_life_of_the_mind  re:do-institutions-evolve  kith_and_kin  heard_the_talk  have_read  to_teach:complexity-and-inference  to:blog  mason.winter  re:democratic_cognition 
december 2010 by cshalizi
[1011.2998] A compact statistical model of the song syntax in Bengalese finch
"Songs of many songbird species consist of variable sequences of a finite number of syllables. A common approach for characterizing the syntax of these ... sequences is to use transition probabilities between the syllables. This is equivalent to the Markov model, in which each syllable is associated with one state, and the transition probabilities between the states do not depend on the state transition history. ... analyze the song syntax in a Bengalese finch. ... the Markov model fails ... Instead, ... include adaptation of the self-transition probabilities when states are repeatedly revisited ... more than one state to the same syllable. ... Mathematically, the model is a partially observable Markov model with adaptation (POMMA). ... supports the branching chain network hypothesis of how syntax is controlled within the premotor song nucleus HVC ..."
birds  grammar_induction  markov_models  time_series  to_teach:complexity-and-inference  to_read  in_NB 
november 2010 by cshalizi
[0811.3538] Stochastic evolutionary game dynamics
"In this review, we summarize recent developments in stochastic evolutionary game dynamics of finite populations." Looks decent, at first scan.
evolutionary_game_theory  stochastic_processes  to_teach:complexity-and-inference  to:NB 
november 2010 by cshalizi
[1011.0175] A Comparison of Methods for Computing Autocorrelation Time
"This paper describes four methods for estimating autocorrelation time and evaluates these methods with a test set of seven series. Fitting an autoregressive process appears to be the most accurate method of the four. An R package is provided for extending the comparison to more methods and test series."
time_series  correlation_time  estimation  to_teach:complexity-and-inference 
november 2010 by cshalizi
depmixS4: An R Package for Hidden Markov Models
"depmixS4 implements a general framework for defining and estimating dependent mixture models in the R programming language. This includes standard Markov models, latent/hidden Markov models, and latent class and finite mixture distribution models. The models can be fitted on mixed multivariate data with distributions from the glm family, the (logistic) multinomial, or the multivariate normal distribution. Other distributions can be added easily, and an example is provided with the exgaus distribution. Parameters are estimated by the expectation-maximization (EM) algorithm or, when (linear) constraints are imposed on the parameters, by direct numerical optimization with the Rsolnp or Rdonlp2 routines."
statistics  computational_statistics  R  markov_models  mixture_models  to_teach:data-mining  to_teach:complexity-and-inference  to_teach:undergrad-ADA 
august 2010 by cshalizi
Phys. Rev. E 82, 011909 (2010): cAMP diffusion in Dictyostelium discoideum: A Green’s function method
"A Green’s function method is developed to approach the spatiotemporal equations describing the cAMP production in Dictyostelium discoideum, markedly reducing numerical calculations times: cAMP concentrations and gradients are calculated just at the amoeba locations. A single set of parameters is capable of reproducing the different observed behaviors, from cAMP synchronization, spiral waves and reaction-diffusion patterns to streaming and mound formation. After aggregation, the emergence of a circular motion of amoebas, breaking the radial cAMP field symmetry, is observed."
pattern_formation  slime_molds  to_teach:complexity-and-inference 
july 2010 by cshalizi
Murder by Structure
"sociological theories consider murder an outcome of the differential distribution of individual, neighborhood, or social characteristics ... explain variation in aggregate homicide rates [but not] the social order of murder [:] who kills whom, when, where, and for what reason. ... gang murder is best understood not by ... its individual determinants but by ... the social networks of action and reaction that create it. ... the social structure of gang murder is defined by the manner in which social networks are constructed and by people's placement in them. ... uses a network approach and incident‐level homicide records to recreate and analyze the structure of gang murders in Chicago. ... individual murders between gangs create an institutionalized network of group conflict, net of any individual's participation or motive. Within this network, murders spread through an epidemic‐like process of social contagion ...."
via:mindhacks  to_teach:complexity-and-inference  violence  social_networks  transaction_networks  to_read  chicago  sociology  gangs  social_organization 
october 2009 by cshalizi
[cond-mat/0009219] Renormalization Group and Probability Theory
Understanding phase transitions probabilistically, as places where the failure of mixing makes the ordinary central limit theorem break down, and non-Gaussian, heavy-tailed distributions appear for macroscopic averages. (I think I bookmarked this in 2000 and then forgot about it... and making me find it again is the only good thing about refereeing this **** paper, grumble.)
probability  heavy_tails  phase_transitions  renormalization  limit_theorems  random_fields  statistical_mechanics  to_teach:complexity-and-inference  have_read 
august 2009 by cshalizi
When Zombies Attack! Mathematical Modeling of an Outbreak of Zombie Infection
Re-purposing standard epidemic models (SIR, etc.) as descriptions of zombie outbreaks. (Conclusion: we're DOOMED!)
funny:geeky  epidemic_models  via:dpfeldman  zombies  to_teach:complexity-and-inference  differential_equations 
august 2009 by cshalizi
Random Graphs with Clustering
"We offer a solution to a long-standing problem in the theory of networks, the creation of a plausible, solvable model of a network that displays clustering or transitivity—the propensity for two neighbors of a network node also to be neighbors of one another. We show how standard random-graph models can be generalized to incorporate clustering and give exact solutions for various properties of the resulting networks, including sizes of network components, size of the giant component if there is one, position of the phase transition at which the giant component forms, and position of the phase transition for percolation on the network."
networks  random_graphs  newman.mark  kith_and_kin  to:NB  to_teach:complexity-and-inference 
august 2009 by cshalizi
Social Interactions and Schooling Decisions
"The aim of this paper is to study whether a child's schooling choices are affected by the schooling choices of other children. Identification is based on a randomized targeted intervention that grants a cash subsidy conditional on school attendance to a subgroup of eligible children within small rural villages in Mexico (PROGRESA). This policy change spills over to ineligible children if social interactions are relevant. Results indicate that the eligible children tend to attend school more frequently, and the ineligible children acquire more schooling when the subsidy is introduced in their local village. Moreover, the overall effect of PROGRESA on eligible children is the sum of a direct effect due to cash transfers and an indirect effect due to changes in peer group schooling. Interestingly, the social interactions effect is almost as important as the direct effect."
social_networks  contagion  causal_inference  education  experimental_sociology  in_NB  to_teach:complexity-and-inference 
july 2009 by cshalizi
Multiplicative Noise and Second Order Phase Transitions
"The scale-free distribution of cluster sizes in continuous phase transitions is linked to the law of proportional effect. A numerical study of a two-dimensional Ising model suggests that a cluster size undergoes a multiplicative birth-death process. At the transition the ratio between birth and death rates approaches unity for large clusters, and the resulting steady state shows a power-law behavior. The percolation dynamic, on the other hand, yields a geometric phase transition without ergodicity breaking, where large-scale merging and splitting of clusters dominate the distribution. Instead of short-range birth-death jumps, the percolation transition is characterized by Lévi [sic] flights along the cluster-size axis."
phase_transitions  statistical_mechanics  stochastic_processes  heavy_tails  to_teach:complexity-and-inference  re:almost_none 
july 2009 by cshalizi
Inverse problems as statistics (Evans and Stark, 2001)
"For a statistician, an inverse problem is an inference or estimation problem. The data are finite in number and contain errors, as they do in classical ... problems, and the unknown typically is infinite-dimensional, as it is in nonparametric regression. The additional complication in an inverse problem is that the data are only indirectly related to the unknown. Canonical abstract formulations of statistical estimation problems subsume this complication by allowing probability distributions to be indexed in more-or-less arbitrary ways by parameters, which can be infinite-dimensional. Standard statistical concepts, questions, and considerations such as bias, variance, mean-squared error, identifiability, consistency, efficiency, and various forms of optimality, apply to inverse problems. This article discusses inverse problems as statistical estimation and inference problems, and points to the literature for a variety of techniques and results."
inverse_problems  statistics  nonparametrics  estimation  latent_variables  to_read  to_teach:complexity-and-inference 
june 2009 by cshalizi
R Fundamentals and Programming Techniques (Lumley)
Very reasonable set of slides from Thomas Lumley. I wouldn't plan on actually using them in a course --- they don't quite fit my style --- but I would put them on a list of pointers for students.
statistics  programming  R  to_teach:data-mining  to_teach:complexity-and-inference  via:jhofman  to_teach:undergrad-ADA 
may 2009 by cshalizi
Oozing Through Texas Soil, a Team of Amoebas Billions Strong - NYTimes.com
Cool!
(But, note to the Times online people: why would you include a link to your archive of stories on _human_ suicide, but no link to the paper?!?)
slime_molds  to_teach:complexity-and-inference  texas 
march 2009 by cshalizi
[0903.2533] An evolutionary model of long tailed distributions in the social sciences
This is the Yule-Simon model with a limited memory effect. The rank-size plots (i.e., empirical CDFs) they show make me pretty sure they're not producing power laws, though they may be power laws with exponential truncation; since their stats are bad, it's hard to say. Should make good take-home-final fodder, however.
heavy_tails  shot_after_a_fair_trial  to_teach:complexity-and-inference  statistics  to:blog  have_read 
march 2009 by cshalizi
« earlier      

related tags

adaptive_behavior  agent-based_models  aligheri.dante  american_history  ancel_meyers.lauren  anderson.norm  animals  approximate_bayesian_computation  artificial_life  attractor_reconstruction  bartlett.m.s.  beautiful  belief_propagation  bergstrom.carl  bibliometry  biochemical_networks  biology  birds  books:noted  books:recommended  book_reviews  bootstrap  bowles.samuel  branching_processes  brillinger.david  bub.gil  bubonic_plague  burns.patrick  carnegie_mellon  cartoons  cats  cat_map  causal_inference  cellular_automata  central_asia  chaos  chicago  choi.jung-kyoo  citation_networks  classifiers  clauset.aaron  climate_change  clustering  collaborative_filtering  collective_cognition  community_discovery  complexity  complexity_measures  computation  computational_statistics  confounding  contagion  control_of_chaos  correlation_time  cryptography  cultural_diversity  cumulative_advantage  data_sets  decision-making  decision_theory  density_estimation  diagonalization  differential_equations  dimension_estimation  distributed_systems  diversity  dodds.peter  dynamical_systems  eagle.nathan  eames.charles  eames.ray  ecology  economics  education  elster.jon  endocrinology  ensemble_methods  epidemic_models  epidemiology  ergodic_theory  estimation  estimation_of_dynamical_systems  evisceration  evolutionary_biology  evolutionary_computation  evolutionary_game_theory  evolutionary_psychology  evolution_of_cooperation  excitable_media  experimental_biology  experimental_design  experimental_psychology  experimental_sociology  explanation_by_mechanisms  exponential_families  exponential_family_random_graphs  feedback  feith.douglas  filtering  fisher_information  flake.gary_william  flocks_and_swarms  food  food_webs  foundations_of_statistics  fractals  fraser.andrew  freckleton.robert_p  funny:academic  funny:geeky  funny:malicious  g20  gabaix.xavier  gangs  gekko.gordon  genetic_algorithms  gerbils  glass.leon  godels_theorem  goodness-of-fit  grammar_induction  graphical_models  greenland.sander  guttorp.peter  handcock.mark  hansen.bruce  have_read  heard_the_talk  heavy_tails  herding  hierarchical_structure  historical_linguistics  homophily  human_evolution  hypothesis_testing  indirect_inference  inequality  information_cascades  information_theory  insects  institutions  internet  inverse_problems  in_NB  kernel_estimators  kith_and_kin  kossinets.gueorgi  krivitsky.pavel  landscape  latent_variables  lazer.david  levy_processes  limit_theorems  linear_regression  literary_communities  literary_homage  local_rules_for_global_problems  locusts  machine_learning  macroeconomics  maps  markov_models  mars  mason.joshua_w.  mason.winter  mathematics  mcpherson.miller  medieval_european_history  memory  methodological_advice  miller.john  minimum_description_length  mixture_models  modeling  money  moore.cris  morphogenesis  morris.martina  movies  music  natural_history_of_truthiness  networks  network_data_analysis  network_formation  neuroscience  neville.jennifer  newman.mark  neyman.jerzy  neyman_smooth_tests  nonparametrics  optimization  page.scott  path_dependence  pattern_formation  pearl.judea  pecora.louis  peer_production  pentland.alex  percolation  perlstein.rick  phase_transitions  philosophy_of_science  photos  pittsburgh  plague  plagues_and_peoples  poetry  point_processes  political_economy  political_science  practices_relating_to_the_transmission_of_genetic_information  prairie_dogs  prediction  preferential_attachment  pretty_pictures  probability  programming  R  racism  random_fields  random_graphs  random_walks  re:almost_none  re:democratic_cognition  re:do-institutions-evolve  re:homophily_and_confounding  re:network_differences  re:social-networks-as-sensor-networks  re:stacs  re:your_favorite_ergm_sucks  reaction-diffusion  recipes  recursion  recursive_estimation  reductionism  relative_distributions  renormalization  robins.james  rosvall.martin  running_dogs_of_reaction  salganik.matthew  schelling_model  scientific_computing  self-organization  self-reinforcing_processes  serotonin  shanteau.james  shot_after_a_fair_trial  shrier.alvin  simulation  simulation:instructional  slee.tom  sleep  slime_molds  snijders.tom  social_contagion  social_influence  social_life_of_the_mind  social_media  social_networks  social_neuroscience  social_organization  social_science_methodology  sociology  software  sole.ricard  space_exploration  state-space_models  state_estimation  statistical_inference_for_stochastic_processes  statistical_mechanics  statistics  stochastic_models  stochastic_processes  stone.oliver  sublime  sutherland.william_j  swartz.aaron  tassier.troy  texas  theoretical_biology  the_american_dilemma  the_continuing_crises  time_series  to:blog  to:NB  to_be_shot_after_a_fair_trial  to_read  to_teach  to_teach:complexity-and-inference  to_teach:data-mining  to_teach:statcomp  to_teach:undergrad-ADA  transaction_networks  turbulence  turing_mechanism  tutorials  uncomputability  utter_stupidity  via:aks  via:arthegall  via:britta  via:dpfeldman  via:dsparks  via:gelman  via:guslacerda  via:henry_farrell  via:io9  via:jhofman  via:mindhacks  via:moritz-heene  via:nick-watkins  via:paul_mcauley  via:shreejoy  violence  visual_display_of_quantitative_information  voter_model  war  watts.duncan  why_oh_why_cant_we_have_a_better_academic_publishing_system  why_oh_why_cant_we_have_a_better_press_corps  wurmser.david  zombies 

Copy this bookmark:



description:


tags: