shivak + probability 43
Algebraic Geometric Comparison of Probability Distributions
8 weeks ago by shivak
"... treating the cumulants as elements of the polynomial ring."
algebraic_geometry
probability
papers
8 weeks ago by shivak
CMU 15-359: Probability and Computing
january 2012 by shivak
I guess I'll be TAing it this semester.
to_teach
probability
cmu
courses
january 2012 by shivak
On a conjecture concerning the sum of independent Rademacher random variables
january 2012 by shivak
"It is shown that at least 50% of the probability mass of a sum of independent Rademacher random variables is within one standard deviation from its mean. This lower bound is sharp, it is much better than for instance the bound that can be obtained from application of the Chebishev inequality..."
probability
combinatorics
papers
january 2012 by shivak
Central Binomial Tail Bounds
january 2012 by shivak
"An alternate form for the binomial tail is presented, which leads to a variety of bounds for the central tail. A few can be weakened into the corresponding Chernoff and Slud bounds, which not only demonstrates the quality of the presented bounds, but also provides alternate proofs for the classical bounds."
probability
combinatorics
papers
january 2012 by shivak
On Low-Dimensional Projections of High-Dimensional Distributions
july 2011 by shivak
"Let $P$ be a probability distribution on $q$-dimensional space. The so-called Diaconis-Freedman effect means that for a fixed dimension $d << q$, most $d$-dimensional projections of $P$ look like a scale mixture of spherically symmetric Gaussian distributions. The present paper provides necessary and sufficient conditions for this phenomenon in a suitable asymptotic framework with increasing dimension $q$. It turns out, that the conditions formulated by Diaconis and Freedman (1984) are not only sufficient but necessary as well. Moreover, letting $\hat{P}$ be the empirical distribution of $n$ independent random vectors with distribution $P$, we investigate the behavior of the empirical process $\sqrt{n}(\hat{P} - P)$ under random projections, conditional on $\hat{P}$."
random_projections
probability
gaussians
papers
july 2011 by shivak
A note about the uniform distribution on the intersection of a simplex and a sphere
november 2010 by shivak
"Uniform probability distributions on $\ell_p$ balls and spheres have been studied extensively and are known to behave like product measures in high dimensions. In this note we consider the uniform distribution on the intersection of a simplex and a sphere. Certain new and interesting features, such as phase transitions and localization phenomena emerge."
probability
geometry
phase_transitions
papers
november 2010 by shivak
The complexity of distributions
november 2010 by shivak
Upon a uniform RV, compute an "$\alpha-local$" or decision forest function upon it. By doing so, you can't get particularly close to the uniform or "majmod" output distribution. Utilizes an anti-concentration result from 1943.
probability
papers
filetype:pdf
media:document
november 2010 by shivak
Bayesian generalized probability calculus for density matrices
november 2010 by shivak
"We develop a probability calculus based on these more general distributions that includes definitions of joints, conditionals and formulas that relate these, including analogs of the Theorem of Total Probability and various Bayes rules for the calculation of posterior density matrices. The resulting calculus parallels the familiar “conventional” probability calculus and always retains the latter as a special case when all matrices are diagonal."
probability
papers
filetype:pdf
media:document
november 2010 by shivak
New Probabilistic Inequalities from Monotone Likelihood Ratio Property
october 2010 by shivak
One needs the densities to use the likelihood ratio, so what's the point of these bounds?
deviation_inequalities
probability
likelihood
papers
huh?
october 2010 by shivak
Closed-form cdf and pdf of Tukey's h-distribution, the heavy-tail Lambert W approach, and how to bijectively "Gaussianize" heavy-tailed data
october 2010 by shivak
"...the Lambert W approach allows practicioners to "Gaussianize" their heavy-tailed data and apply common methods and models on the latent Gaussian RV. The optimal parameters to do the backtransformation can be estimated by maximum likelihood (ML). Contrary to the skewed case, the transformation is bijective: each observed data point is uniquely linked to its hidden (and normally tailed) input."
gaussians
heavy_tails
probability
papers
october 2010 by shivak
Radically Elementary Probability Theory
september 2010 by shivak
"This work is an attempt to lay new foundations for probability theory, using a tiny bit of nonstandard analysis."
probability
nonstandard_analysis
books
filetype:pdf
media:document
september 2010 by shivak
On Khintchine inequalities with a weight
june 2010 by shivak
"In this paper we prove a weighted version of the Khintchine inequalities."
probability
papers
june 2010 by shivak
The maximal probability that k-wise independent bits are all 1
may 2010 by shivak
A sharp lower bound for the maximal probability.
probability
papers
may 2010 by shivak
Characterization of the law of a finite exchangeable sequence through the finite dimensional distributions of the empirical measure
may 2010 by shivak
An extension theorem for exchangeable sequences.
probability
exchangeability
extension_theorems
may 2010 by shivak
Computable de Finetti measures
april 2010 by shivak
Also see the upcoming paper "On the computability of conditional probability".
computability
probability
papers
april 2010 by shivak
Applications of Lindeberg Principle in Communications and Statistical Learning
april 2010 by shivak
Derivation and application of a theorem which is a bit more usable than Sourav's original result.
probability
examples
april 2010 by shivak
Transport Inequalities. A Survey
march 2010 by shivak
"This is a survey of recent developments in the area of transport inequalities. We investigate their consequences in terms of concentration and deviation inequalities and sketch their links with other functional inequalities and also large deviation theory."
surveys
concentration_of_measure
probability
large_deviations
mass_transportation
march 2010 by shivak
Refining quasi-probability kernels
march 2010 by shivak
"We consider the problem of modifying a quasi-probability kernel in order to improve its properties without changing the set of measures whose conditional probabilities it specifies."
probability
stochastic_processes
papers
march 2010 by shivak
Defining probability density for a distribution of random functions
march 2010 by shivak
A density-like concept "defined in terms of the average value of the logarithms of the densities of the distributions of principal components for a given dimension", along with an estimation method.
probability
density_estimation
principal_components
papers
march 2010 by shivak
18.177 course project: Invariance Principles
february 2010 by shivak
A very nice course project by an old TA which summarizes Mossel's "Gaussian bounds for noise correlations and tight analysis of long codes" and applies it to a sensitivity problem.
probability
invariance
sensitivity
juba
brendan
filetype:pdf
media:document
february 2010 by shivak
36-754, Advanced Probability II: Stochastic Processes, Spring 2010
january 2010 by shivak
This year and onwards: less stochastic calculus, more empirical processes.
probability
stochastic_processes
empirical_processes
courses
cmu
hanneke
steve
january 2010 by shivak
CCC 09 accepted papers
july 2009 by shivak
Lots of these have already been posted on arXiv.
conferences
theoretical_computer_science
probability
coding_theory
july 2009 by shivak
A generalization of the Lindeberg principle
june 2009 by shivak
A technique of replacing non-Gaussian random variables with Gaussian ones, recently utilized by Tao and Vu to prove a property about Wigner Hermitian matrices.
probability
exchangeability
mathematics
proof_techniques
chatterjee
sourav
june 2009 by shivak
Probability in Asymptotic Geometry
june 2009 by shivak
Workshop at Texas A&M.
probability
geometry
combinatorics
june 2009 by shivak
Persi Diaconis likes Probabilistic Symmetries and Invariance Principles
june 2009 by shivak
With a nice story about (fallacious) statistical perception.
books
probability
group_theory
exchangeability
perception
kallenberg
olav
diaconis
persi
filetype:pdf
media:document
june 2009 by shivak
Talagrand's concentration inequality
june 2009 by shivak
Short proof of a restricted version.
concentration_of_measure
probability
tao
terence
via:mreid
june 2009 by shivak
Pseudo-randomness and partial information in symbolic security analysis
june 2009 by shivak
Symbolic definition of independence as the basis of a symbolic model for partial information leakage.
interfaces
cryptography
randomness
probability
micciancio
daniele
june 2009 by shivak
Probability without measure & finance without probability
may 2009 by shivak
"Mathematical probability can be based on a two-person sequential game of perfect information. On each round, Player II states odds at which Player I may bet on what Player II will do next. In statistical modeling, Player I is a statistician and Player II is the world. In finance, Player I is an investor and Player II is a market."
measure_theory
game_semantics
probability
quantitative_finance
markets
vovk
vladimir
shafer
glenn
may 2009 by shivak
21L.017 The Art of the Probable: Literature and Probability, Spring 2008 (MIT OpenCourseWare)
april 2009 by shivak
"The Art of the Probable" addresses the history of scientific ideas, in particular the emergence and development of mathematical probability. But it is neither meant to be a history of the exact sciences per se nor an annex to, say, the Course 6 curriculum in probability and statistics. Rather, our objective is to focus on the formal, thematic, and rhetorical features that imaginative literature shares with texts in the history of probability. These shared issues include (but are not limited to): the attempt to quantify or otherwise explain the presence of chance, risk, and contingency in everyday life; the deduction of causes for phenomena that are knowable only in their effects; and, above all, the question of what it means to think and act rationally in an uncertain world."
probability
statistics
history
language
science
via:arsyed
april 2009 by shivak
An Analysis of Random-Walk Cuckoo Hashing
april 2009 by shivak
"Cuckoo hashing provides a useful methodology for building practical, high-performance hash tables. The essential idea of cuckoo hashing is to combine the power of schemes that allow multiple hash locations for an item with the power to dynamically change the location of an item among its possible locations. Previous work on the case where the number of choices is larger than two has required a breadth-first search analysis, which is both inefficient in practice and currently has only a polynomial high probability upper bound on the insertion time. Here we signicantly advance the state of the art by proving a polylogarithmic bound on the more efficient randomwalk method, where items repeatedly kick out random blocking items until a free location for an item is found."
hashing
probability
data_structures
frieze
alan
melsted
pall
mitzenmacher
michael
filetype:pdf
media:document
april 2009 by shivak
Statistics 210B: Theoretical Statistics
april 2009 by shivak
Pick up a copy of van der Vaart.
learning_theory
empirical_processes
probability
statistics
jordan
michael
via:mreid
via:cshalizi
april 2009 by shivak
From absolute distinguishability to positive distinguishability
april 2009 by shivak
Don't say squaring. Given an algorithm D that distinguishes ensembles X and Y indexed by α, this is a BPP algorithm D' such that ℙ(D'(α, X)=1) - ℙ(D'(α, Y)=1) ≥ ρ(ℙ(D(α, X)=1) - ℙ(D(α, Y)=1)|) for some ρ.
probability
proof_techniques
brakerski
zvika
goldreich
oded
april 2009 by shivak
Wired almost wrote a hit piece on the Gaussian copula
february 2009 by shivak
I was afraid they were actually going to blame the credit collapse on a representation of a multivariate distribution. Instead they blamed the practitioners and slapped on a dumb headline.
credit_collapse
financial_speculation
popular_science
leaky_abstractions
probability
wired
february 2009 by shivak
A Weak Convergence Approach to the Theory of Large Deviations
february 2009 by shivak
"This book presents an approach to large deviation theory which is based on evaluating the asymptotics of certain expectations."
large_deviations
probability
stochastic_processes
dupuis
paul
ellis
richard
via:cshalizi
filetype:pdf
media:document
february 2009 by shivak
related tags
alan ⊕ algebraic_geometry ⊕ almost ⊕ analysis ⊕ books ⊕ brakerski ⊕ brendan ⊕ central_limit_theorems ⊕ chatterjee ⊕ chris ⊕ cmu ⊕ coding_theory ⊕ combinatorics ⊕ computability ⊕ concentration_of_measure ⊕ conferences ⊕ courses ⊕ credit_collapse ⊕ cryptography ⊕ daniele ⊕ data_structures ⊕ density_estimation ⊕ deviation_inequalities ⊕ diaconis ⊕ differential_equations ⊕ dupuis ⊕ ellis ⊕ empirical_processes ⊕ examples ⊕ exchangeability ⊕ extension_theorems ⊕ filetype:pdf ⊕ financial_speculation ⊕ frieze ⊕ game_semantics ⊕ gaussians ⊕ geometry ⊕ glenn ⊕ goldreich ⊕ group_theory ⊕ hanneke ⊕ hashing ⊕ haskell ⊕ heavy_tails ⊕ hilbert_spaces ⊕ history ⊕ huh? ⊕ identifiability ⊕ interfaces ⊕ invariance ⊕ jordan ⊕ juba ⊕ kallenberg ⊕ kernel_methods ⊕ language ⊕ large_deviations ⊕ larry ⊕ leaky_abstractions ⊕ learning_theory ⊕ lectures ⊕ likelihood ⊕ markets ⊕ mass_transportation ⊕ mathematics ⊕ measure_theory ⊕ media:document ⊕ melsted ⊕ micciancio ⊕ michael ⊕ michel ⊕ mitzenmacher ⊕ monads ⊕ networks ⊕ nonstandard_analysis ⊕ oded ⊕ olav ⊕ pall ⊕ papers ⊕ paul ⊕ perception ⊕ persi ⊕ phase_transitions ⊕ popular_science ⊕ principal_components ⊕ probability ⊖ proof_techniques ⊕ prophylaxis ⊕ quantitative_finance ⊕ randomness ⊕ random_projections ⊕ reference ⊕ richard ⊕ science ⊕ sensitivity ⊕ severalization ⊕ shafer ⊕ sourav ⊕ statistics ⊕ steve ⊕ stochastic_processes ⊕ surveys ⊕ talagrand ⊕ tao ⊕ terence ⊕ theoretical_computer_science ⊕ to_teach ⊕ updated_content ⊕ via:arsyed ⊕ via:cshalizi ⊕ via:mreid ⊕ videos ⊕ vladimir ⊕ vovk ⊕ wasserman ⊕ wired ⊕ zvika ⊕Copy this bookmark: