Pinboard: bookmarks for arthegall tagged 'statistics'

"Below are descriptions of my research on various aspects of statistical disclosure limitation, including assessing risk and utility, synthetic data methods, remote access servers, and secure analyses of distributed data. I also have included papers with links."

via:andrew-gelman privacy database computing statistics imputed-data
10 weeks ago by arthegall

copy to mine

Bret Victor - Inventing on Principle on Vimeo

Yessss.... you know what should work like this? R, obviously.

R data visualization graphics statistics interactivity video vimeo via:andy
february 2012 by arthegall

copy to mine

Zhi, Chen "Statistical Guidance for Experimental Design and Data Analysis of Mutation Detection in Rare Monogenic Mendelian Diseases by Exome Sequencing" (PLoS ONE)

"... we present a statistical modeling framework to calculate the power, the probability of identifying truly disease-causing genes, under various inheritance models and experimental conditions, providing guidance for both proper experimental design and data analysis."

sequencing plos research-article genomics mendelian-disease statistics to-read
february 2012 by arthegall

copy to mine

Alekh Agarwal
via:cshalizi researcher homepage big-data statistics online-optimization learning machinelearning convex-optimization
february 2012 by arthegall

copy to mine

RStudio

Open-source R IDE. Worth looking in to.

R programming ide statistics
january 2012 by arthegall

copy to mine

[1109.2938] State-of-the-Art in Sequential Change-Point Detection
change-point statistics arxiv research-article thesis signal-processing
december 2011 by arthegall

copy to mine

[1109.1880] Fundamentals of Stein's method
via:cshalizi steins-method arxiv research-article statistics
december 2011 by arthegall

copy to mine

PostgreSQL Database Capacity Planning 1 – Disk Space – IAmA DBA AMA
via:marcua postgres statistics ops database
june 2011 by arthegall

copy to mine

Regression shrinkage and selection via the lasso: a retrospective - Tibshirani - 2011 - Journal of the Royal Statistical Society: Series B (Statistical Methodology) - Wiley Online Library
to-read lasso statistics linear-regression subset-selection
april 2011 by arthegall

copy to mine

Statistical Applications in Genetics and Molecular Biology
statistics genetics molecular-biology journal
april 2011 by arthegall

copy to mine

German tank problem - Wikipedia

Estimating population sizes based on observations of (say) serial numbers of samples. I'm forgetting where I picked up this link, but I have the feeling that this could be used explicitly in some bioinformatics/sequencing applications.

statistics estimation idea wikipedia populations from delicious
january 2011 by arthegall

copy to mine

Papers by Radford Neal Available On-Line
radford-neal publications list researcher homepage statistics machinelearning slice-sampling mcmc
january 2011 by arthegall

copy to mine

Iyengar , Greenhouse, "Selection Models and the File Drawer Problem" (Statist. Sci. 1988)
file-drawer-problem statistics science publication-bias publishing meta-analysis
december 2010 by arthegall

copy to mine

"The pre-season AP poll is great." (the kenpom.com blog)

"It’s informed groupthink at its finest." -- A great quote, but I really like the whole discussion.

sports polling bias groupthink wisdom-of-crowds averaging statistics
november 2010 by arthegall

copy to mine

Bento, Ibrahimi, Montanari, "Learning Networks of Stochastic Differential Equations" (arXiv)

"We consider linear models for stochastic dynamics. To any such model can be associated a network (namely a directed graph) describing which degrees of freedom interact under the dynamics. We tackle the problem of learning such a network from observation of the system trajectory over a time interval $T$."

symbolic-methods stochastic-processes differential-equations graphs research-article learning arxiv nips statistics information-theory via:ded_maxim
november 2010 by arthegall

copy to mine

Computational Information Geometry Wonderland : Information geometry and beyond: books!

want.

want books algebraic-geometry information statistics information-geometry list
september 2010 by arthegall

copy to mine

[1008.5325] Linear Characteristic Graphical Models: Representation, Inference and Applications
arxiv graphical-models inference statistics research-article via:cshalizi heavy-tailed-distributions
september 2010 by arthegall

copy to mine

Stats 329 - Winter 2009/2010

"Large Scale Simultaneous Inference"

class statistics genomics inference significance-testing hypothesis-testing course notes
september 2010 by arthegall

copy to mine

Gelman, Robert "'Not only defended but also applied': A look back at Feller's take on Bayesian inference" (arXiv)

Gelman vs. Feller.

william-feller andrew-gelman statistics history bayesian-methods arxiv
september 2010 by arthegall

copy to mine

"SNPwatch: Uncertainty Surrounds Longevity GWAS" (The Spittoon)

The Spittoon (the blog from 23andme) does the follow-up on that fishy-smelling "here are a bunch of genetic variants associated with longevity" study that got all that press a few months ago.

23andme spittoon review longevity gwas statistics uncertainty genomics genetics science news
august 2010 by arthegall

copy to mine

Špaček: Statistical Estimation of Semantic Provability
semantics via:cshalizi neyman-pearson statistics estimation proof ontology to-read
august 2010 by arthegall

copy to mine

[1004.3476] Approximate Methods for State-Space Models
by:cshalizi state-space-models statistics arxiv research-article
august 2010 by arthegall

copy to mine

Mariadassou, Robin, Vacher: Uncovering latent structure in valued graphs: A variational approach
research-article statistics graphical-models machinelearning
august 2010 by arthegall

copy to mine

Deborah G. Mayo, Aris Spanos (eds.) - Error and Inference: Recent Exchanges on Experimental Reasoning, Reliability, and the Objectivity and Rationality of Science - Reviewed by Adam La Caze

More Mayo that I must own.

deborah-mayo error learning statistics testing discussion book book-review
august 2010 by arthegall

copy to mine

"Megan McArdle’s Hack Post on Elizabeth Warren’s Scholarship" (Rortybomb)

"If you made it this far, I feel terrible for you. I feel like Virgil leading you through a Glibertarian Inferno." -- I'm glad that Konczal is writing about this, because otherwise I'd have to read Levenson's post, which would make me want to claw my own eyes out.

mike-konczal megan-mcardle elizabeth-warren bankruptcy statistics research politics
july 2010 by arthegall

copy to mine

Leibler, Kussell, "Individual histories and selection in heterogeneous populations" PNAS

"Using “individual histories”—temporal sequences of all reproduction events and phenotypic changes of individuals and their ancestors—we present an alternative approach to quantifying selection in diverse experimental settings..."

via:cshalizi pnas selection history population-effects genomics research-article statistics
july 2010 by arthegall

copy to mine

Robins, Richardson "Alternative Graphical Causal Models and the Identification of Direct Effects." (PDF)

"There are two common approaches to the construction of causal models. The first ap- proach posits unobserved fixed ‘potential’ or ‘counterfactual’ outcomes for each unit under different possible joint treatments or exposures. The second approach posits relationships between the population distribution of outcomes under experimental interventions (with full compliance) to the set of (conditional) distributions that would be observed under passive observation (i.e., from observational data). We will refer to the former as ‘counterfactual’ causal models and the latter as ‘agnostic’ causal models (Spirtes et al., 1993), as the second approach is agnostic as to whether unit-specific counterfactual outcomes exist, be they fixed or stochastic.
The primary difference between the two approaches is ontological..."

causality ontology graphical-models direct-effects pdf research-article statistics social-science
july 2010 by arthegall

copy to mine

Imai, King, Stuart, "Misunderstandings between experimentalists and observationalists about causal inference" Journal of the Royal Statistical Society: Series A (2008)
causality research-article gary-king inference statistics experimentation review-article
july 2010 by arthegall

copy to mine

Cleveland and Grosse, "Computational Methods for Local Regression," Statistics and Computing (1991)
statistics nonparametric-methods regression loess journal-article kd-trees semi-parametric-methods
july 2010 by arthegall

copy to mine

Picci, "Some connections between the theory of sufficient statistics and the identifiability problem," SIAM J. APPL. MATH. (1977)

JSTOR: SIAM Journal on Applied Mathematics, Vol. 33, No. 3 (Nov., 1977), pp. 383-398

identifiability statistics sufficient-statistics jstor journal-article
july 2010 by arthegall

copy to mine

Halmos, Savage. "Application of the Radon-Nikodym Theorem to the Theory of Sufficient Statistics." Ann. Math. Statist. (1949)

"The purpose of generality here is not to solve immediate practical problems, but rather to capture the logical essence of an important concept (sufficient statistic), and in particular to disentangle that concept from such ideas as Euclidean space, dimensionality, partial differentiation, and the distinction between continuous and discrete distributions, which seem to us extraneous."

paul-halmos leonard-savage statistics mathematics sufficient-statistics geometry radon-nikodym-theorem history
july 2010 by arthegall

copy to mine

"Number of Birds Killed" (Marginal Revolution)

Cowen Index: 4.

disaster statistics counting sea-otters oil british-petroleum wildlife
july 2010 by arthegall

copy to mine

David Blackwell has passed away « An Ergodic Walk

"I’ll always remember what [Blackwell] told me when I handed him a draft of my thesis. “The best thing about Bayesians is that they’re always right.”"

humor bayesian-methods david-blackwell quote statistics
july 2010 by arthegall

copy to mine

NHANES - National Health and Nutrition Examination Survey Homepage
health nutrition data statistics cdc food
july 2010 by arthegall

copy to mine

"Psychic Octopus picks Germany to beat Argentina" (Washington Post)

Awesome in so many ways. At least they're publishing the next prediction! (Via Tom L. on Twitter.)

out-of-sample-error statistics humor stopped-clock psychic-octopus soccer sports prediction
june 2010 by arthegall

copy to mine

Praxis and Ideology in Bayesian Data Analysis

"Edward Prescott forms a noteworthy exception: under the rubric of "calibration", he has elevated his conviction that his prior guesses are never wrong into a new principle of statistical estimation." -- Cosma's snark about statisticians and economists is the funniest snark around. We could all aspire to have wits that were as subtle and dry as his... (seriously).

by:cshalizi bayesian-methods andrew-gelman statistics econometrics edward-prescott humor
june 2010 by arthegall

copy to mine

Ehm, Kornmeier, Heinrich, "Multiple testing along a tree" (Electron. J. Statist. 2010)
statistics hypothesis-testing trees multiple-testing research-article via:cshalizi
june 2010 by arthegall

copy to mine

Allman et al. "Parameter identifiability in a class of random graph mixture models" (arXiv)

"We prove identifiability of parameters for a broad class of random graph mixture models. These models are characterized by a partition of the set of graph nodes into latent (unobservable) groups. The connectivities between nodes are independent random variables when conditioned on the groups of the nodes being connected. In the binary random graph case, in which edges are either present or absent, these models are known as stochastic blockmodels and have been widely used in the social sciences and, more recently, in biology. " -- To read, in the context of the blockmodeling paper from a few weeks back.

blockmodeling graph statistics arxiv research-article parameters identifiability via:cshalizi
june 2010 by arthegall

copy to mine

Huang, Guestrin, "Uncovering the Riffled Independence Structure of Rankings" (arxiv)
ranking machinelearning statistics permutations arxiv research-article independence
june 2010 by arthegall

copy to mine

"The problem of overestimation of group-level variance parameters" (Andrew Gelman)

"... and many statisticians are uncomfortable with shrinkage." -- (C'mon, Gelman, go for the easy joke!)

puerile-humor your-mom-jokes shrinkage statistics bayesian-methods hierarchical-models variation
june 2010 by arthegall

copy to mine

Lv & Liu,"Model Selection Principles in Misspecified Models" (arXiv)

That's Jun Liu, and therefore, worth reading.

via:cshalizi aic statistics model-selection arxiv research-article jun-liu
june 2010 by arthegall

copy to mine

[1005.4274] This is SPIRAL-TAP: Sparse Poisson Intensity Reconstruction ALgorithms - Theory and Practice

This looks like the kind of thing I wanted, oh so long ago (pre-graduation), for thinking about delicious link frequencies. Also: great paper title.

via:Vaguery poisson-process statistics estimation images image-analysis optimization arxiv research-article
may 2010 by arthegall

copy to mine

Richard P. Brent, "George Forsythe's last paper" (arXiv:1005.9009)
samping statistics algorithms probability arxiv research-article von-neumann via:Vaguery
may 2010 by arthegall

copy to mine

Ryabko, "Clustering processes"
via:cshalizi clustering stochastic-processes arxiv research-article mathematics statistics computerscience machinelearning
may 2010 by arthegall

copy to mine

S.-I. Amari, O. E. Barndorff-Nielsen, R. E. Kass, S. L. Lauritzen, and C. R. Rao Differential geometry in statistical inference: (Hayward, CA: Institute of Mathematical Statistics, 1987)

Don't I already own this book...?

book via:cshalizi statistics inference differential-geometry project-euclid
may 2010 by arthegall

copy to mine

Larry Wasserman, 10-705 Intermediate Statistics, Fall 2009
via:cshalizi course cmu statistics notes list lectures
may 2010 by arthegall

copy to mine

McCormick, Salganik, and Zheng "How many people do you know? : Efficiently estimating personal network size"

Got this via Andrew Gelman's blog 1+ years ago. (For some reason, I remember the room I was sitting in when I first read it.)

pdf research-article social-networks estimation statistics friends sociology
april 2010 by arthegall

copy to mine

Efron & Thisted, "Estimating the number of unseen species: How many words did Shakespeare know?" (JSTOR)

[JSTOR: Biometrika, Vol. 63, No. 3 (Dec., 1976), pp. 435-447] Did I really not save a link to this already? There's an analogy to be drawn here with those social network papers that try to estimate the total number of X in a population by asking different people, "how many X do you know," etc.

networks bradley-efron jstor statistics research-article estimation shakespeare language
april 2010 by arthegall

copy to mine

"Finally joining the revolution" (Bill Simmons)

In the guise of an article about sports and baseball and fandom, I feel like Bill Simmons has actually written a great little piece about statistics and data mining in general. Take the way he looks at each statistics, picks apart each pro and con, and then figures out how to actually *use* it ... this is something that you could get a lot of high school or college statistics students to read.

statistics data data-mining sports baseball sabermetrics bill-simmons espn history
april 2010 by arthegall

copy to mine

Pradines et al. "Detection of activity centers in cellular pathways using transcript profiling."

[J Biopharm Stat. 2004] -- this is work that JAR and AR did at Millennium, apparently.

bioinformatics statistics pathways networks research-article pharmaceuticals transcription
november 2009 by arthegall

copy to mine

Mission Improbable: A Concise and Precise Definition of P-Value -- Cohen 2009 (1030): 1 -- ScienceNOW

To be honest, it seems (to me) like they're *both* confused.

via:WanderingAengus statistics p-value hypothesis-testing
november 2009 by arthegall

copy to mine

ISWC-triplerank-revised-version.pdf (application/pdf Object)

When I say 'graph data', you say 'spectral analysis'! (Graphdata...spectralanalysis!) "TripleRank: Ranking Semantic Web Data by Tensor Decomposition" -- presented at ISWC this year. Sam and I were just talking about this (general problem) yesterday. But is all the notation in terms of tensors really necessary? At first glance this looks like something that's (usually) presented as a "matrix factorization", no?

semanticweb pdf research-article ranking web triples rdf via:inkdroid statistics
october 2009 by arthegall

copy to mine

Devroye and Lugosi, "Bin width selection in multivariate histograms by the combinatorial method" (TEST, 2004)

There's a rich vein of papers about bin-width selection in histograms -- some of them are pretty interesting, actually.

histograms research-article optimization statistics luc-devroye
october 2009 by arthegall

copy to mine

Gary King - Zelig Software Website

"Zelig comes with detailed, self-contained documentation that minimizes startup costs for Zelig and R, automates graphics and summaries for all models, and, with only three simple commands required, generally makes the power of R accessible for all users." --- heading in the right direction, useability-wise. Gary King is sort of an inspirational figure, if you think about him in the right way. (Like Ben Schneiderman, no?)

gary-king via:kinggary software R statistics tool spss stata
october 2009 by arthegall

copy to mine

Quick-R: Home Page

"R for ... SPSS users." Need to send this to Rachel...

r via:cshalizi tutorial statistics software reference programming
october 2009 by arthegall

copy to mine

"What’s Wrong with Probability Notation?" (LingPipe Blog)

It's a reasonable explication -- but I feel like every first-year CS graduate student has a similar personal revelation about notation when he or she first comes into contact with the machine learning or probabilistic AI literature. "This notation is horrible, but lambda calculus [or, more generally, a functional language, or some other technique I learned in my proglang course] will come to the rescue and clear all this up!" And then they work it out in the same way, have exactly the same realization (this is hard, people have tried and failed at it before), and move on. Or maybe they're Avi Pfeffer and they actually do something about it. But either way, it's a worthwhile exercise!

machinelearning notation programminglanguages statistics probability computerscience
october 2009 by arthegall

copy to mine

Elements of Statistical Learning: data mining, inference, and prediction. 2nd Edition.

Available for free as a PDF, online. (!!)

book pdf free statistics machinelearning datamining
october 2009 by arthegall

copy to mine

Efron, "Are a set of microarrays independent of each other?" (Annals of Applied Statistics, 2008)

When Bradley Efron talks about microarrays... (But where is the Cabernet of k-Means and heat maps? Where is the Burgundy of Support-Vector Machines?)

dean-young bradley-efron poetry humor statistics obscurely-referential microarrays
september 2009 by arthegall

copy to mine

Poon et al. "Parsing Social Network Survey Data from Hidden Populations Using Stochastic Context-Free Grammars" (PLoS ONE)

"Here, we develop a new methodology based on stochastic context-free grammars (SCFGs), which are well-suited to modeling tree-like structure of the RDS recruitment process. We apply this methodology to an RDS case study of injection drug users (IDUs) in Tijuana, México, a hidden population at high risk of blood-borne and sexually-transmitted infections (i.e., HIV, hepatitis C virus, syphilis). ... We identified significant latent variability in the recruitment process that violates assumptions of Markov chain-based methods for RDS analysis: firstly, IDUs tended to emulate the recruitment behavior of their own recruiter; and secondly, the recruitment of like peers (homophily) was dependent on the number of recruits."

social-networks plos-one research-article scfgs networks markov-models statistics epidemiology network-models
september 2009 by arthegall

copy to mine

"Genes and Income" (Rortybomb)

"So this strikes me as a major problem for the graph. Your Mom guessing, in $20,000 increments, what your income is not the best proxy for actual income, and it seems like a rather blunt sword to use to declare the knot of “Nature/Nuture” cut. I think the lack of granularity among the categories alone could easily noise out that $1,600, no?" --- It turns out to be a "your mom" joke after all! That's hilarious.

humor genetics income mankiw graphing statistics causality
september 2009 by arthegall

copy to mine

"What's the difference between Bayesian and classical statistics" (Statistical Modeling, Causal Inference, and Social Science)

"One problem with finding statistical resources on the web, I think, is that a webpage on a technical issue is likely to have been written by a computer scientist. And what computer scientists do with data and models is often much different from what we do." -- A golden quote. [He says that like it's a *bad* thing!]

humor andrew-gelman quote statistics computerscience web
september 2009 by arthegall

copy to mine

Powell's Books - Identification for Prediction and Decision by Charles F. Manski

To buy. (Descriptions of identifiability, and degrees-of-identifiability, in statistics).

via:cshalizi book to:buy statistics identifiability inference decision-theory
september 2009 by arthegall

copy to mine

RANDOM NUMBER GENERATION (LUC DEVROYE)

Devroye's publications on random number generation (goes hand in hand with his book).

random-numbers publications researcher statistics
september 2009 by arthegall

copy to mine

A Beginner Battles WinBUGS

One user's notes...

winbugs statistics bayesian-methods software notes via:arsyed
august 2009 by arthegall

copy to mine

Zou, Hastie, Tibshirani, "On the “degrees of freedom” of the lasso" (Ann. Statist. 2007)
lasso degrees-of-freedom statistics model-selection
august 2009 by arthegall

copy to mine

Ye, "On Measuring and Correcting the Effects of Data Mining and Model Selection" (JASA, 1998)

[JSTOR: Journal of the American Statistical Association, Vol. 93, No. 441 (Mar., 1998), pp. 120-131]

jstor data-mining statistics degrees-of-freedom research-article
august 2009 by arthegall

copy to mine

Mathematics/Statistics - AcademicBlogs

The ultimate blog-roll.

blogging list index mathematics statistics
august 2009 by arthegall

copy to mine

Comment by cshalizi at "FDL Book Salon Welcomes Scott Page: The Difference"

"Maybe it’s the statistician in me, but I am warming to the idea of randomization as a way of introducing diversity."

humor diversity randomization statistics
august 2009 by arthegall

copy to mine

Robert Berk, "Limiting Behavior of Posterior Distributions when the Model is Incorrect"

Can I ask a question? Is it the case that Brad DeLong's "Rosencrantz and Guildenstern Flip a Coin" example (http://delong.typepad.com/sdj/2009/03/cosma-shalizi-takes-me-to-probability-school-or-is-it-philosophy-school.html) is a particular instance of the example given in the last paragraph of this paper? (the answer, I am subsequently told, is "yes.")

via:cshalizi baysian-methods inference modeling research-article statistics
august 2009 by arthegall

copy to mine

http://www.stanford.edu/~montanar/BOOK/book.html
book physics statistics draft information-theory
july 2009 by arthegall

copy to mine

"A little more about random configurations" (Quomodocumque)

"My impression is that statisticians are pretty good at distinguishing between a normal distribution and a superimposition of some small finite set of normal distributions. But I think it’s much harder to look at a giant cloud of points in R^100 and say “aha — this is actually a random sample from a normal distribution centered on the union of a surface of genus 2 sitting over here, and these ten disjoint circles sitting over there.""

geometry data statistics configurations physics sampling mcmc-sampling
july 2009 by arthegall

copy to mine

Ping Li, "Compressed counting" (STOC 2009)

Computing estimates of the moments of a data stream.

compressed-sensing data datastream statistics estimation research-article computerscience
july 2009 by arthegall

copy to mine