shivak + probability   43

Algebraic Geometric Comparison of Probability Distributions
"... treating the cumulants as elements of the polynomial ring."
algebraic_geometry  probability  papers 
8 weeks ago by shivak
On a conjecture concerning the sum of independent Rademacher random variables
"It is shown that at least 50% of the probability mass of a sum of independent Rademacher random variables is within one standard deviation from its mean. This lower bound is sharp, it is much better than for instance the bound that can be obtained from application of the Chebishev inequality..."
probability  combinatorics  papers 
january 2012 by shivak
Central Binomial Tail Bounds
"An alternate form for the binomial tail is presented, which leads to a variety of bounds for the central tail. A few can be weakened into the corresponding Chernoff and Slud bounds, which not only demonstrates the quality of the presented bounds, but also provides alternate proofs for the classical bounds."
probability  combinatorics  papers 
january 2012 by shivak
On Low-Dimensional Projections of High-Dimensional Distributions
"Let $P$ be a probability distribution on $q$-dimensional space. The so-called Diaconis-Freedman effect means that for a fixed dimension $d << q$, most $d$-dimensional projections of $P$ look like a scale mixture of spherically symmetric Gaussian distributions. The present paper provides necessary and sufficient conditions for this phenomenon in a suitable asymptotic framework with increasing dimension $q$. It turns out, that the conditions formulated by Diaconis and Freedman (1984) are not only sufficient but necessary as well. Moreover, letting $\hat{P}$ be the empirical distribution of $n$ independent random vectors with distribution $P$, we investigate the behavior of the empirical process $\sqrt{n}(\hat{P} - P)$ under random projections, conditional on $\hat{P}$."
random_projections  probability  gaussians  papers 
july 2011 by shivak
A note about the uniform distribution on the intersection of a simplex and a sphere
"Uniform probability distributions on $\ell_p$ balls and spheres have been studied extensively and are known to behave like product measures in high dimensions. In this note we consider the uniform distribution on the intersection of a simplex and a sphere. Certain new and interesting features, such as phase transitions and localization phenomena emerge."
probability  geometry  phase_transitions  papers 
november 2010 by shivak
The complexity of distributions
Upon a uniform RV, compute an "$\alpha-local$" or decision forest function upon it. By doing so, you can't get particularly close to the uniform or "majmod" output distribution. Utilizes an anti-concentration result from 1943.
probability  papers  filetype:pdf  media:document 
november 2010 by shivak
Bayesian generalized probability calculus for density matrices
"We develop a probability calculus based on these more general distributions that includes definitions of joints, conditionals and formulas that relate these, including analogs of the Theorem of Total Probability and various Bayes rules for the calculation of posterior density matrices. The resulting calculus parallels the familiar “conventional” probability calculus and always retains the latter as a special case when all matrices are diagonal."
probability  papers  filetype:pdf  media:document 
november 2010 by shivak
New Probabilistic Inequalities from Monotone Likelihood Ratio Property
One needs the densities to use the likelihood ratio, so what's the point of these bounds?
deviation_inequalities  probability  likelihood  papers  huh? 
october 2010 by shivak
Closed-form cdf and pdf of Tukey's h-distribution, the heavy-tail Lambert W approach, and how to bijectively "Gaussianize" heavy-tailed data
"...the Lambert W approach allows practicioners to "Gaussianize" their heavy-tailed data and apply common methods and models on the latent Gaussian RV. The optimal parameters to do the backtransformation can be estimated by maximum likelihood (ML). Contrary to the skewed case, the transformation is bijective: each observed data point is uniquely linked to its hidden (and normally tailed) input."
gaussians  heavy_tails  probability  papers 
october 2010 by shivak
Radically Elementary Probability Theory
"This work is an attempt to lay new foundations for probability theory, using a tiny bit of nonstandard analysis."
probability  nonstandard_analysis  books  filetype:pdf  media:document 
september 2010 by shivak
On Khintchine inequalities with a weight
"In this paper we prove a weighted version of the Khintchine inequalities."
probability  papers 
june 2010 by shivak
Computable de Finetti measures
Also see the upcoming paper "On the computability of conditional probability".
computability  probability  papers 
april 2010 by shivak
Applications of Lindeberg Principle in Communications and Statistical Learning
Derivation and application of a theorem which is a bit more usable than Sourav's original result.
probability  examples 
april 2010 by shivak
Transport Inequalities. A Survey
"This is a survey of recent developments in the area of transport inequalities. We investigate their consequences in terms of concentration and deviation inequalities and sketch their links with other functional inequalities and also large deviation theory."
surveys  concentration_of_measure  probability  large_deviations  mass_transportation 
march 2010 by shivak
Refining quasi-probability kernels
"We consider the problem of modifying a quasi-probability kernel in order to improve its properties without changing the set of measures whose conditional probabilities it specifies."
probability  stochastic_processes  papers 
march 2010 by shivak
Defining probability density for a distribution of random functions
A density-like concept "defined in terms of the average value of the logarithms of the densities of the distributions of principal components for a given dimension", along with an estimation method.
probability  density_estimation  principal_components  papers 
march 2010 by shivak
18.177 course project: Invariance Principles
A very nice course project by an old TA which summarizes Mossel's "Gaussian bounds for noise correlations and tight analysis of long codes" and applies it to a sensitivity problem.
probability  invariance  sensitivity  juba  brendan  filetype:pdf  media:document 
february 2010 by shivak
A generalization of the Lindeberg principle
A technique of replacing non-Gaussian random variables with Gaussian ones, recently utilized by Tao and Vu to prove a property about Wigner Hermitian matrices.
probability  exchangeability  mathematics  proof_techniques  chatterjee  sourav 
june 2009 by shivak
Pseudo-randomness and partial information in symbolic security analysis
Symbolic definition of independence as the basis of a symbolic model for partial information leakage.
interfaces  cryptography  randomness  probability  micciancio  daniele 
june 2009 by shivak
Probability without measure & finance without probability
"Mathematical probability can be based on a two-person sequential game of perfect information. On each round, Player II states odds at which Player I may bet on what Player II will do next. In statistical modeling, Player I is a statistician and Player II is the world. In finance, Player I is an investor and Player II is a market."
measure_theory  game_semantics  probability  quantitative_finance  markets  vovk  vladimir  shafer  glenn 
may 2009 by shivak
21L.017 The Art of the Probable: Literature and Probability, Spring 2008 (MIT OpenCourseWare)
"The Art of the Probable" addresses the history of scientific ideas, in particular the emergence and development of mathematical probability. But it is neither meant to be a history of the exact sciences per se nor an annex to, say, the Course 6 curriculum in probability and statistics. Rather, our objective is to focus on the formal, thematic, and rhetorical features that imaginative literature shares with texts in the history of probability. These shared issues include (but are not limited to): the attempt to quantify or otherwise explain the presence of chance, risk, and contingency in everyday life; the deduction of causes for phenomena that are knowable only in their effects; and, above all, the question of what it means to think and act rationally in an uncertain world."
probability  statistics  history  language  science  via:arsyed 
april 2009 by shivak
An Analysis of Random-Walk Cuckoo Hashing
"Cuckoo hashing provides a useful methodology for building practical, high-performance hash tables. The essential idea of cuckoo hashing is to combine the power of schemes that allow multiple hash locations for an item with the power to dynamically change the location of an item among its possible locations. Previous work on the case where the number of choices is larger than two has required a breadth-first search analysis, which is both inefficient in practice and currently has only a polynomial high probability upper bound on the insertion time. Here we signicantly advance the state of the art by proving a polylogarithmic bound on the more efficient randomwalk method, where items repeatedly kick out random blocking items until a free location for an item is found."
hashing  probability  data_structures  frieze  alan  melsted  pall  mitzenmacher  michael  filetype:pdf  media:document 
april 2009 by shivak
From absolute distinguishability to positive distinguishability
Don't say squaring. Given an algorithm D that distinguishes ensembles X and Y indexed by α, this is a BPP algorithm D' such that ℙ(D'(α, X)=1) - ℙ(D'(α, Y)=1) ≥ ρ(ℙ(D(α, X)=1) - ℙ(D(α, Y)=1)|) for some ρ.
probability  proof_techniques  brakerski  zvika  goldreich  oded 
april 2009 by shivak
Wired almost wrote a hit piece on the Gaussian copula
I was afraid they were actually going to blame the credit collapse on a representation of a multivariate distribution. Instead they blamed the practitioners and slapped on a dumb headline.
credit_collapse  financial_speculation  popular_science  leaky_abstractions  probability  wired 
february 2009 by shivak
A Weak Convergence Approach to the Theory of Large Deviations
"This book presents an approach to large deviation theory which is based on evaluating the asymptotics of certain expectations."
large_deviations  probability  stochastic_processes  dupuis  paul  ellis  richard  via:cshalizi  filetype:pdf  media:document 
february 2009 by shivak

related tags

alan  algebraic_geometry  almost  analysis  books  brakerski  brendan  central_limit_theorems  chatterjee  chris  cmu  coding_theory  combinatorics  computability  concentration_of_measure  conferences  courses  credit_collapse  cryptography  daniele  data_structures  density_estimation  deviation_inequalities  diaconis  differential_equations  dupuis  ellis  empirical_processes  examples  exchangeability  extension_theorems  filetype:pdf  financial_speculation  frieze  game_semantics  gaussians  geometry  glenn  goldreich  group_theory  hanneke  hashing  haskell  heavy_tails  hilbert_spaces  history  huh?  identifiability  interfaces  invariance  jordan  juba  kallenberg  kernel_methods  language  large_deviations  larry  leaky_abstractions  learning_theory  lectures  likelihood  markets  mass_transportation  mathematics  measure_theory  media:document  melsted  micciancio  michael  michel  mitzenmacher  monads  networks  nonstandard_analysis  oded  olav  pall  papers  paul  perception  persi  phase_transitions  popular_science  principal_components  probability  proof_techniques  prophylaxis  quantitative_finance  randomness  random_projections  reference  richard  science  sensitivity  severalization  shafer  sourav  statistics  steve  stochastic_processes  surveys  talagrand  tao  terence  theoretical_computer_science  to_teach  updated_content  via:arsyed  via:cshalizi  via:mreid  videos  vladimir  vovk  wasserman  wired  zvika 

Copy this bookmark:



description:


tags: