cshalizi + random_fields 37
[1203.4020] Large Deviations for Stochastic Partial Differential Equations Driven by a Poisson Random Measure
9 weeks ago by cshalizi
"Stochastic partial differential equations driven by Poisson random measures (PRM) have been proposed as models for many different physical systems, where they are viewed as a refinement of a corresponding noiseless partial differential equations (PDE). A systematic framework for the study of probabilities of deviations of the stochastic PDE from the deterministic PDE is through the theory of large deviations. The goal of this work is to develop the large deviation theory for small Poisson noise perturbations of a general class of deterministic infinite dimensional models. Although the analogous questions for finite dimensional systems have been well studied, there are currently no general results in the infinite dimensional setting. This is in part due to the fact that in this setting solutions may have little spatial regularity, and thus classical approximation methods for large deviation analysis become intractable. The approach taken here, which is based on a variational representation for nonnegative functionals of general PRM, reduces the proof of the large deviation principle to establishing basic qualitative properties for controlled analogues of the underlying stochastic system. As an illustration of the general theory, we consider a particular system that models the spread of a pollutant in a waterway."
to:NB
stochastic_processes
large_deviations
random_fields
dynamical_systems
re:almost_none
convergence_of_stochastic_processes
9 weeks ago by cshalizi
Kaiser , Lahiri , Nordman : Goodness of fit tests for a class of Markov random field models
10 weeks ago by cshalizi
"This paper develops goodness of fit statistics that can be used to formally assess Markov random field models for spatial data, when the model distributions are discrete or continuous and potentially parametric. Test statistics are formed from generalized spatial residuals which are collected over groups of nonneighboring spatial observations, called concliques. Under a hypothesized Markov model structure, spatial residuals within each conclique are shown to be independent and identically distributed as uniform variables. The information from a series of concliques can be then pooled into goodness of fit statistics. Under some conditions, large sample distributions of these statistics are explicitly derived for testing both simple and composite hypotheses, where the latter involves additional parametric estimation steps. The distributional results are verified through simulation, and a data example illustrates the method for model assessment."
to:NB
to_read
statistics
spatial_statistics
random_fields
goodness-of-fit
hypothesis_testing
re:stacs
markov_models
10 weeks ago by cshalizi
Truquet : On a nonparametric resampling scheme for Markov random fields
november 2011 by cshalizi
"We study an extension to general Markov random fields of the resampling scheme given in Bickel and Levina (2006) [4] for texture synthesis with stationary Markov mesh models. The procedure generates bootstrap replicates of a sample using kernel regression and the principle of Gibbs sampling. Consistency of the bootstrap distribution is investigated under the Dobrushin contraction condition. Some simulation examples are given, in particular for the texture synthesis, for which the multiscale algorithm of Paget and Longstaff (1998) [27] is revisited."
in_NB
to_read
random_fields
bootstrap
statistics
spatial_statistics
markov_models
november 2011 by cshalizi
[1111.1177] Partially observed Markov random fields are variable neighborhood random fields
november 2011 by cshalizi
"The present paper has two goals. First to present a natural example of a new class of random fields which are the variable neighborhood random fields. The example we consider is a partially observed nearest neighbor binary Markov random field. The second goal is to establish sufficient conditions ensuring that the variable neighborhoods are almost surely finite. We discuss the relationship between the almost sure finiteness of the interaction neighborhoods and the presence/absence of phase transition of the underlying Markov random field. In the case where the underlying random field has no phase transition we show that the finiteness of neighborhoods depends on a specific relation between the noise level and the Dobrushin coefficient. The case in which there is phase transition is addressed in the frame of the ferromagnetic Ising model. We prove that the existence of infinite interaction neighborhoods depends on the phase. The first result has a probabilistic proof using a Kalikow type decomposition of a Glauber dynamics associated to the field. The second result is proved using cluster expansion."
to:NB
to_read
markov_models
random_fields
phase_transitions
re:AoS_project
stochastic_processes
november 2011 by cshalizi
Relational Learning with One Network: An Asymptotic Analysis
october 2011 by cshalizi
An attempt on the "n=1" problem. Alternative home: http://www.cs.purdue.edu/homes/neville/papers/xiang-neville-aistat2011.pdf
in_NB
re:XV_for_networks
re:your_favorite_ergm_sucks
network_data_analysis
relational_learning
neville.jennifer
have_read
random_fields
markov_models
statistics
machine_learning
estimation
october 2011 by cshalizi
[1107.1680] Developments in perfect simulation for Gibbs measures
july 2011 by cshalizi
"This paper deals with the problem of perfect sampling from a Gibbs measure with infinite range interactions. We present some sufficient conditions for the extinction of processes which are like supermartingales when large values are taken. This result has profound consequences on perfect simulation, showing that local modifications on the interactions of a model do not affect the simulability. We also pose the question to optimize over a sequence of sets and we completely solve the question in the case of finite range interactions."
simulation
gibbs_distributions
random_fields
stochastic_processes
to:NB
july 2011 by cshalizi
[1103.4415] Cram'er's theorem for asymptotically decoupled fields
march 2011 by cshalizi
I'd mark it "to read", but it's in French!
large_deviations
weak_dependence
random_fields
stochastic_processes
in_NB
march 2011 by cshalizi
[1101.5195] A New Condition for the Invariance Principle for Stationary Random Fields
february 2011 by cshalizi
"We establish a central limit theorem and an invariance principle for stationary random fields. In particular, we extend the Maxwell--Woodroofe condition on stationary processes to the multiparameter setting. Our result is obtained via an $m$-dependent approximation method. As applications, we improve known results on the invariance principles for orthomartingales and functionals of linear random fields."
stochastic_processes
random_fields
central_limit_theorem
to:NB
february 2011 by cshalizi
[0810.4221] Chaos, concentration, and multiple valleys
january 2011 by cshalizi
"Disordered systems are an important class of models in statistical mechanics, having the defining characteristic that the energy landscape is a fixed realization of a random field. Examples include various models of glasses and polymers. They also arise in other areas, like fitness models in evolutionary biology. The ground state of a disordered system is the state with minimum energy. The system is said to be chaotic if a small perturbation of the energy landscape causes a drastic shift of the ground state. We present a rigorous theory of chaos in disordered systems that confirms long-standing physics intuition about connections between chaos, anomalous fluctuations of the ground state energy, and the existence of multiple valleys in the energy landscape."
statistical_mechanics
disordered_systems
spin_glasses
fitness_landscapes
random_fields
january 2011 by cshalizi
[1101.0255] Conditional information and definition of neighbor in categorical random fields
january 2011 by cshalizi
"Who then is my neighbor?" (Not an actual quote from the paper.)
random_fields
information_theory
stochastic_processes
spatial_statistics
january 2011 by cshalizi
Faris : Combinatorics and cluster expansions
december 2010 by cshalizi
I am not sure whether there shouldn't be a chapter on diagrammatic methods in _Almost None_, because I don't really understand how what I learned about them as a physicist relates to actual probability theory. I will come back to this one later.
combinatorics
diagrammatic_methods
statistical_mechanics
generatingfunctionology
re:almost_none
random_fields
december 2010 by cshalizi
Levina, Bickel: Texture synthesis and nonparametric resampling of random fields
august 2010 by cshalizi
Found the pre-print, which I'd read in '04, while looking for something else in my office... Note that this is the same shape of mesh that Lindgren and Nordahl advocated for use in 2D information theory, on totally different (I think) grounds.
bootstrap
spatial_statistics
random_fields
statistics
nonparametrics
have_read
august 2010 by cshalizi
Cesaro Summation for Random Fields
july 2010 by cshalizi
"Various methods of summation for divergent series of real numbers have been generalized to analogous results for sums of i.i.d. random variables. The natural extension of results corresponding to Cesàro summation amounts to proving almost sure convergence of the Cesàro means. In the present paper we extend such results as well as weak laws and results on complete convergence to random fields, more specifically to random variables indexed by ℤ+2, the positive two-dimensional integer lattice points."
probability
ergodic_theory
random_fields
re:almost_none
july 2010 by cshalizi
[1007.1490] A Central Limit Theorem For Linear Random Fields
july 2010 by cshalizi
"A Central Limit Theorem is proved for linear random fields when sums are taken over finite disjoint union of rectangles. The approach does not rely upon the use of Beveridge Nelson decomposition and the conditions needed are similar to those given by Ibragimov for linear processes. When specializing this result to the case when sums are being taken over rectangles, an analogue of Ibragimov result is obtained with a lot of uniformity."
central_limit_theorem
random_fields
stochastic_processes
re:almost_none
to_teach:advanced-stochastic-processes
july 2010 by cshalizi
Grimmett: Probability on Graphs: Random Processes on Graphs and Lattices - Cambridge University Press
may 2010 by cshalizi
"his introduction to some of the principal models in the theory of disordered systems leads the reader through the basics, to the very edge of contemporary research, with the minimum of technical fuss. Topics covered include random walk, percolation, self-avoiding walk, interacting particle systems, uniform spanning tree, random graphs, as well as the Ising, Potts, and random-cluster models for ferromagnetism, and the Lorentz model for motion in a random medium. Schramm–Löwner evolutions (SLE) arise in various contexts. The choice of topics is strongly motivated by modern applications and focuses on areas that merit further research. Special features include a simple account of Smirnov's proof of Cardy's formula for critical percolation, and a fairly full account of the theory of influence and sharp-thresholds. Accessible to a wide audience of mathematicians and physicists, this book can be used as a graduate course text. Each chapter ends with a range of exercises."
books:noted
probability
stochastic_processes
networks
random_fields
random_walks
ising_model
coveted
grimmett.geoffrey
interacting_particle_systems
may 2010 by cshalizi
Steif: Consistent estimation of joint distributions for sufficiently mixing random fields
may 2010 by cshalizi
"The joint distribution of a d-dimensional random field restricted to a box of size k can be estimated by looking at a realization in a box of size $n \gg k$ and computing the empirical distribution. This is done by sliding a box of size k around in the box of size n and computing frequencies. We show that when $k = k(n)$ grows as a function of n, then the total variation distance between this empirical distribution and the true distribution goes to 0 a.s. as $n \to \infty$ provided $k(n)^d \leq (\log n^d)/(H + \varepsilon)$ (where H is the entropy of the random field) and providing the random field satisfies a condition called quite weak Bernoulli with exponential rate. ... Marton and Shields have proved such results in one dimension and this paper is an attempt to extend their results to some extent to higher dimensions."
statistics
information_theory
random_fields
estimation
density_estimation
entropy
mixing
to_read
statistical_inference_for_stochastic_processes
may 2010 by cshalizi
[1004.2304] Spatio-Temporal Graphical Model Selection
april 2010 by cshalizi
"We consider the problem of estimating the topology of spatial interactions in a discrete state, discrete time spatio-temporal graphical model where the interactions affect the temporal evolution of each agent in a network. Among other models, the susceptible, infected, recovered ($SIR$) model for interaction events fall into this framework. We pose the problem as a structure learning problem and solve it using an $\ell_1$-penalized likelihood convex program. We evaluate the solution on a simulated spread of infectious over a complex network. Our topology estimates outperform those of a standard spatial Markov random field graphical model selection using $\ell_1$-regularized logistic regression."
graphical_models
random_fields
lasso
model_selection
april 2010 by cshalizi
Exponential Rates of Convergence in the Ergodic Theorem: A Constructive Approach
april 2010 by cshalizi
Very clever, though they do not derive explicit rates. --- I wonder if this couldn't be shown as a consequence of general properties of very-weak-Bernoulli processes? The vwB property would seem to imply perfect simulation, but I am not sure about the converse.
large_deviations
stochastic_processes
ergodic_theory
random_fields
have_read
re:almost_none
april 2010 by cshalizi
Verzelen: Adaptive estimation of stationary Gaussian fields
march 2010 by cshalizi
"We study the nonparametric covariance estimation of a stationary Gaussian field X observed on a regular lattice. In the time series setting, some procedures ... achieve optimal model selection among autoregressive models. ... no such equivalent results of adaptivity in a spatial setting. By considering collections of Gaussian Markov random fields (GMRF) as approximation sets for the distribution of X, we introduce a novel model selection procedure for spatial fields. For all neighborhoods m in a given collection , this procedure first amounts to computing a covariance estimator of X within the GMRFs of neighborhood m. Then it selects a neighborhood ̂m by applying a penalization strategy. The so-defined method satisfies a nonasymptotic oracle-type inequality. If X is a GMRF, the procedure is also minimax adaptive to the sparsity of its neighborhood. More generally, the procedure is adaptive to the rate of approximation of the true distribution by GMRFs with growing neighborhoods."
spatial_statistics
model_selection
statistics
stochastic_processes
random_fields
statistical_inference_for_stochastic_processes
march 2010 by cshalizi
[cond-mat/0009219] Renormalization Group and Probability Theory
august 2009 by cshalizi
Understanding phase transitions probabilistically, as places where the failure of mixing makes the ordinary central limit theorem break down, and non-Gaussian, heavy-tailed distributions appear for macroscopic averages. (I think I bookmarked this in 2000 and then forgot about it... and making me find it again is the only good thing about refereeing this **** paper, grumble.)
probability
heavy_tails
phase_transitions
renormalization
limit_theorems
random_fields
statistical_mechanics
to_teach:complexity-and-inference
have_read
august 2009 by cshalizi
Adaptive Gaussian Markov random fields with applications in human brain mapping
july 2009 by cshalizi
I wonder if these guys shouldn't have been at Columbia last week, rather than me...
fmri
random_fields
markov_models
statistics
spatial_statistics
in_NB
july 2009 by cshalizi
Stochastic Modeling of Scientific Data - Peter Guttorp
november 2007 by cshalizi
Recommended-but-not-required text for my class.
guttorp.peter
books:recommended
to_teach:complexity-and-inference
statistics
stochastic_processes
markov_models
random_fields
point_processes
branching_processes
modeling
stochastic_models
november 2007 by cshalizi
related tags
books:noted ⊕ books:recommended ⊕ bootstrap ⊕ branching_processes ⊕ causal_inference ⊕ central_limit_theorem ⊕ combinatorics ⊕ conditional_random_fields ⊕ convergence_of_stochastic_processes ⊕ coveted ⊕ density_estimation ⊕ diagrammatic_methods ⊕ disordered_systems ⊕ dynamical_systems ⊕ entropy ⊕ ergodic_theory ⊕ estimation ⊕ exponential_families ⊕ feature_selection ⊕ fitness_landscapes ⊕ fmri ⊕ friedman.nir ⊕ functional_connectivity ⊕ generatingfunctionology ⊕ gibbs_distributions ⊕ goodness-of-fit ⊕ graphical_models ⊕ grimmett.geoffrey ⊕ guttorp.peter ⊕ have_read ⊕ heavy_tails ⊕ hilbert_space ⊕ hypothesis_testing ⊕ information_theory ⊕ interacting_particle_systems ⊕ in_NB ⊕ ising_model ⊕ kernel_estimators ⊕ koller.daphne ⊕ large_deviations ⊕ lasso ⊕ limit_theorems ⊕ long-memory_processes ⊕ machine_learning ⊕ markov_models ⊕ mixing ⊕ modeling ⊕ model_selection ⊕ networks ⊕ network_data_analysis ⊕ neural_data_analysis ⊕ neville.jennifer ⊕ nonparametrics ⊕ particle_filters ⊕ phase_transitions ⊕ point_processes ⊕ prediction ⊕ probability ⊕ random_fields ⊖ random_walks ⊕ re:almost_none ⊕ re:AoS_project ⊕ re:stacs ⊕ re:XV_for_networks ⊕ re:your_favorite_ergm_sucks ⊕ relational_learning ⊕ renormalization ⊕ rosenblatt.murray ⊕ simulation ⊕ sparsity ⊕ spatial_statistics ⊕ spin_glasses ⊕ statistical_inference_for_stochastic_processes ⊕ statistical_mechanics ⊕ statistics ⊕ stochastic_models ⊕ stochastic_processes ⊕ to:NB ⊕ to_read ⊕ to_teach:advanced-stochastic-processes ⊕ to_teach:complexity-and-inference ⊕ weak_dependence ⊕Copy this bookmark: