The problem of nonparametric estimation of a bounded regression function $f\in L²\left({[a,b]}^d\right)$, [a,b] ⊂ ℝ, d ≥ 1, using an orthonormal system of functions $e_k$, k=1,2,..., is considered in the case when the observations follow the model $Y_i=f\left(X_i\right)+{\eta }_i$, i=1,...,n, where $X_i$ and ${\eta }_i$ are i.i.d. copies of independent random variables X and η, respectively, the distribution of X has density ϱ, and η has mean zero and finite variance. The estimators are constructed by proper truncation of the function $f̂ₙ\left(x\right)={\sum }_{k=1}^{N\left(n\right)}c{̂}_k{e}_k\left(x\right)$, where the coefficients $ĉ₁,...,c{̂}_{N\left(n\right)}$...

This paper is concerned with general conditions for convergence rates of nonparametric orthogonal series estimators of the regression function. The estimators are obtained by the least squares method on the basis of an observation sample $Y_i=f\left(X_i\right)+{\eta }_i$, i=1,...,n, where $X_i\in A\subset {ℝ}^d$ are independently chosen from a distribution with density ϱ ∈ L¹(A) and ${\eta }_i$ are zero mean stationary errors with long-range dependence. Convergence rates of the error $n^{-1}{\sum }_{i=1}^n(f\left(X_i\right)-f{̂}_N\left(X_i\right))²$ for the estimator $f{̂}_N\left(x\right)={\sum }_{k=1}^{N}c{̂}_k{e}_k\left(x\right)$, constructed using an orthonormal system...

This paper is a survey of recent results on some problems of supervised learning in the setting formulated by Cucker and Smale. Supervised learning, or learning-from-examples, refers to a process that builds on the base of available data of inputs $x_i$ and outputs $y_i$, i = 1,...,m, a function that best represents the relation between the inputs x ∈ X and the corresponding outputs y ∈ Y. The goal is to find an estimator $f_z$ on the base of given data $z:=((x₁,y₁),...,(x_m,y_m))$ that approximates well the regression function...

We consider the problem of estimating the mean $f$ of a Gaussian vector $Y$ with independent components of common unknown variance ${\sigma }^2$. Our estimation procedure is based on estimator selection. More precisely, we start with an arbitrary and possibly infinite collection $𝔽$ of estimators of $f$ based on $Y$ and, with the same data $Y$, aim at selecting an estimator among $𝔽$ with the smallest Euclidean risk. No assumptions on the estimators are made and their dependencies with respect to $Y$ may be unknown....

For each n ≥ 1, let $v_{n,k},k\ge 1$ and $u_{n,k},k\ge 1$ be mutually independent sequences of nonnegative random variables and let each of them consist of mutually independent and identically distributed random variables with means v̅ₙ and u̅̅ₙ, respectively. Let $X{ₙ}^B\left(t\right)=(1/cₙ){\sum }_{j=1}^{\left[nt\right]}(v_{n,j}-v̅ₙ)$, $X{ₙ}^A\left(t\right)=(1/cₙ){\sum }_{j=1}^{\left[nt\right]}(u_{n,j}-u̅̅ₙ)$, t ≥ 0, and $Xₙ=X{ₙ}^B-X{ₙ}^A$. The main result gives conditions under which the weak convergence $Xₙ\stackrel{}{\to }X$, where X is a Lévy process, implies $X{ₙ}^B\stackrel{}{\to }{X}^B$ and $X{ₙ}^A\stackrel{}{\to }{X}^A$, where $X^B$ and $X^A$ are mutually independent Lévy processes and $X=X^B-X^A$.

Let $\left\{X_{ij}\right\}$, $i,j=\cdots$, be a double array of independent and identically distributed (i.i.d.) real random variables with $E{X}_{11}=\mu$, $E|X_{11}{-\mu |}^2=1$ and $E|X_{11}{|}^{4}lt;\infty$. Consider sample covariance matrices (with/without empirical centering) $𝒮=\frac{1}{n}{\sum }_{j=1}^n({𝐬}_j-\overline{𝐬}){({𝐬}_j-\overline{𝐬})}^T$ and $𝐒=\frac{1}{n}{\sum }_{j=1}^n{𝐬}_j{𝐬}_j^T$, where $\overline{𝐬}=\frac{1}{n}{\sum }_{j=1}^n{𝐬}_j$ and ${𝐬}_j={𝐓}_n^{1/2}{(X_{1j},...,X_{pj})}^T$ with ${\left({𝐓}_n^{1/2}\right)}^2={𝐓}_n$, non-random symmetric non-negative definite matrix. It is proved that central limit theorems of eigenvalue statistics of $𝒮$ and $𝐒$ are different as $n\to \infty$ with $p/n$ approaching a positive constant. Moreover, it is also proved that such a different behavior is not observed in the...

If the space $𝒬$ of quadratic forms in ${ℝ}^n$ is splitted in a direct sum ${𝒬}_1\oplus ...\oplus {𝒬}_k$ and if $X$ and $Y$ are independent random variables of ${ℝ}^n$, assume that there exist a real number $a$ such that $E\left(X\right|X+Y)=a(X+Y)$ and real distinct numbers $b_1,...,b_k$ such that $E\left(q\left(X\right)\right|X+Y)=b_{i}q(X+Y)$ for any $q$ in ${𝒬}_i.$ We prove that this happens only when $k=2$, when ${ℝ}^n$ can be structured in a Euclidean Jordan algebra and when $X$ and $Y$ have Wishart distributions corresponding to this structure.

We consider the problem of estimating a function $s$ on ${[-1,1]}^k$ for large values of $k$ by looking for some best approximation of $s$ by composite functions of the form $g\circ u$. Our solution is based on model selection and leads to a very general approach to solve this problem with respect to many different types of functions $g,u$ and statistical frameworks. In particular, we handle the problems of approximating $s$ by additive functions, single and multiple index models, artificial neural networks, mixtures...

Suppose that $𝒢$ is a finite, connected graph and $X$ is a lazy random walk on $𝒢$. The lamplighter chain $X^{\diamond }$ associated with $X$ is the random walk on the wreath product ${𝒢}^{\diamond }={𝐙}_2\wr 𝒢$, the graph whose vertices consist of pairs $(\underline{f},x)$ where $f$ is a labeling of the vertices of $𝒢$ by elements of ${𝐙}_2=\{0,1\}$ and $x$ is a vertex in $𝒢$. There is an edge between $(\underline{f},x)$ and $(\underline{g},y)$ in ${𝒢}^{\diamond }$ if and only if $x$ is adjacent to $y$ in $𝒢$ and $f_z=g_z$ for all $z\ne x,y$. In each step, $X^{\diamond }$ moves from a configuration $(\underline{f},x)$ by updating $x$ to $y$ using the transition rule of $X$ and then...

In this paper, we study the size of the giant component $C_G$ in the random geometric graph $G=G(n,r_n,f)$ of $n$ nodes independently distributed each according to a certain density $f(·)$ in ${[0,1]}^2$ satisfying ${inf}_{x\in {[0,1]}^2}f\left(x\right)gt;$ $0$. If $\frac{c_1}{n}\le r_n^2\le c_2\frac{logn}{n}$ for some positive constants $c_1$, $c_2$ and $n{r}_n^2⟶\infty$ as $n\to \infty$, we show that the giant component of $G$ contains at least $n-\mathrm{o}\left(n\right)$ nodes with probability at least $1-{\mathrm{e}}^{-\beta n{r}_n^2}$ for all $n$ and for some positive constant $\beta$. We also obtain estimates on the diameter and number of the non-giant components of $G$.

Let $S_n^{\left(2\right)}$ denote the iterated partial sums. That is, $S_n^{\left(2\right)}=S_1+S_2+\cdots +S_n$, where $S_i=X_1+X_2+\cdots +X_i$. Assuming $X_1,X_2,...,X_n$ are integrable, zero-mean, i.i.d. random variables, we show that the persistence probabilities $$p_n^{\left(2\right)}:=\mathbb{P}\left(\underset{1\le i\le n}{max}{S}_i^{\left(2\right)}lt;0\right)\le c\sqrt{\frac{𝔼|S_{n+1}|}{(n+1)𝔼|X_1|}},$$ with $c\le 6\sqrt{30}$ (and $c=2$ whenever $X_1$ is symmetric). The converse inequality holds whenever the non-zero $min(-X_1,0)$ is bounded or when it has only finite third moment and in addition $X_1$ is squared integrable. Furthermore, $p_n^{\left(2\right)}\asymp n^{-1/4}$ for any non-degenerate squared integrable, i.i.d., zero-mean $X_i$. In contrast, we show that for any $0lt;\gamma lt;1/4$ there exist integrable,...

We consider “nonconventional” averaging setup in the form $\frac{\mathrm{d}{X}^{\epsilon }\left(t\right)}{\mathrm{d}t}=\epsilon B(X^{\epsilon }\left(t\right)$, $𝛯\left(q_1\left(t\right)\right),𝛯\left(q_2\left(t\right)\right),...,𝛯\left(q_{\ell }\left(t\right)\right))$ where $𝛯\left(t\right)$, $t\ge 0$ is either a stochastic process or a dynamical system with sufficiently fast mixing while $q_j\left(t\right)={\alpha }_{j}t$, ${\alpha }_{1}lt;{\alpha }_{2}lt;\cdots lt;{\alpha }_k$ and $q_j$, $j=k+1,...,\ell$ grow faster than linearly. We show that the properly normalized error term in the “nonconventional” averaging principle is asymptotically Gaussian.

Let a space $X$ be Tychonoff product ${\prod }_{\alpha <\tau }{X}_{\alpha }$ of $\tau$-many Tychonoff nonsingle point spaces $X_{\alpha }$. Let Suslin number of $X$ be strictly less than the cofinality of $\tau$. Then we show that every point of remainder is a non-normality point of its Čech–Stone compactification $\beta X$. In particular, this is true if $X$ is either $R^{\tau }$ or ${\omega }^{\tau }$ and a cardinal $\tau$ is infinite and not countably cofinal.

We study a continuous time growth process on the $d$-dimensional hypercubic lattice ${𝒵}^d$, which admits a phenomenological interpretation as the combustion reaction $A+B\to 2A$, where $A$ represents heat particles and $B$ inert particles. This process can be described as an interacting particle system in the following way: at time 0 a simple symmetric continuous time random walk of total jump rate one begins to move from the origin of the hypercubic lattice; then, as soon as any random walk visits a site...

Let $G$ be a finite group and $H$ a subgroup. Denote by $D(G;H)$ (or $D\left(G\right)$) the crossed product of $C\left(G\right)$ and $ℂH$ (or $ℂG$) with respect to the adjoint action of the latter on the former. Consider the algebra $\langle D\left(G\right),e\rangle$ generated by $D\left(G\right)$ and $e$, where we regard $E$ as an idempotent operator $e$ on $D\left(G\right)$ for a certain conditional expectation $E$ of $D\left(G\right)$ onto $D(G;H)$. Let us call $\langle D\left(G\right),e\rangle$ the basic construction from the conditional expectation $E:D\left(G\right)\to D(G;H)$. The paper constructs a crossed product algebra $C(G/H\times G)⋊ℂG$, and proves that there is an algebra isomorphism between...

Take a centered random walk $S_n$ and consider the sequence of its partial sums $A_n:={\sum }_{i=1}^n{S}_i$. Suppose $S_1$ is in the domain of normal attraction of an $\alpha$-stable law with $1lt;\alpha \le 2$. Assuming that $S_1$ is either right-exponential (i.e. $\mathbb{P}(S_{1}gt;x|S_{1}gt;0)={\mathrm{e}}^{-ax}$ for some $agt;0$ and all $xgt;0$) or right-continuous (skip free), we prove that $$\mathbb{P}\{A_{1}gt;0,\cdots ,A_{N}gt;0\}\sim C_{\alpha }{N}^{1/\left(2\alpha \right)-1/2}$$ as $N\to \infty$, where $C_{\alpha }gt;0$ depends on the distribution of the walk. We also consider a conditional version of this problem and study positivity of integrated discrete bridges.