• A
  • A
  • A
  • ABC
  • ABC
  • ABC
  • А
  • А
  • А
  • А
  • А
Regular version of the site
ФКН
Contacts

Dean — Ivan Arzhantsev

 

First Deputy Dean — Tamara Voznesenskaya

 

Deputy Dean for Research and International Relations — Sergei Obiedkov

 

Deputy Dean for Methodical and Educational Work — Ilya Samonenko

 

Deputy Dean for Development, Finance and Administration — Irina Plisetskaya

Phone: +7 (495) 772-95-90 * 12332

computerscience@hse.ru

125319, Moscow, 3 Kochnovsky Proezd (near metro station 'Aeroport'). 

Events
Feb 22 – Feb 23
Регистрация открыта 
Mar 21 – Mar 23
Papers Submission Deadline: 15 January 2019 
Jun 12 – Jun 14
submission: Friday, 01 February 2019, notification: Friday, 15 February 2019 
Aug 26 – Aug 30
Registration and Poster Submission deadline — April 1, 2019 
Article
Ontology-Mediated Queries: Combined Complexity and Succinctness of Rewritings via Circuit Complexity

Bienvenu M., Kikot S., Kontchakov R. et al.

Journal of the ACM. 2018. Vol. 65. No. 5. P. 28:1-28:51.

Article
Randomized Block Cubic Newton Method
In press

Doikov Nikita, Richtarik P.

Proceedings of Machine Learning Research. 2018. No. 80. P. 1290-1298.

Article
Particle-identification techniques and performance at LHCb in Run 2
In press

Hushchyn M., Chekalina V.

Nuclear Instruments and Methods in Physics Research, Section A: Accelerators, Spectrometers, Detectors and Associated Equipment. 2018. P. 1-2.

Article
Observational evidence in favor of scale free evolution of sunspot groups

Shapoval A., Le Mouël J., Shnirman M. et al.

Astronomy and Astrophysics. 2018. Vol. 618. P. A183-1-A183-13.

Mini-course: Advanced statistical methods. Vladimir Spokoiny (HSE, Russia/Weierstrass Institute, Germany)

Event ended

Advanced statistical methods

Vladimir Spokoiny (HSE, Russia/Weierstrass Institute, Germany)

Course Schedule:

12, 19, 26 February 18:10 – 21:00, room 205 (3, Kochnovsky Proezd)
13, 20, 27 February 18:10 – 21:00, room 509 (3, Kochnovsky Proezd)

Pass to HSE building can be ordered at: kkorshunova@hse.ru

Short Course Description

This course introduces the main notions, approaches, and methods of nonparametric statistics. The main topics include smoothing and regularization, model selection and parameter tuning, structural inference, efficiency and rate efficiency, local and sieve parametric approaches. The study is mainly limited to regression and density models. The topics of this course form an essential basis for working with complex data structures using modern statistical tools.

Course structure: lectures, seminars, exam.

Prerequisites

Probability theory, linear algebra, mathematical analysis.

Nonparametric Regression

  • Regression models: design, errors, and response function.
  • Projection estimation. The case of orthogonal design.
  • Bias, variance, risk of estimation, rate and accuracy, smoothness classes.

Regularization and roughness penalty

Ridge regression, roughness penalty, penalized maximum likelihood estimation, impact of regularization, modeling bias, complexity, bias-variance trade-off.

Model selection by SURE and AIC, Cross validation

Problem of model choice. Penalized model selection. Akaike criterion. Stein unbiased risk estimation. Parameter tuning by cross-validation.

Model section by smallest accepted

Ordered Model selection and multiple testing. Smallest accepted rule. Parameter tuning by propagation condition and multiplicity correction.

Wavelet methods: hard and soft thresholding

Sequence space model. Wavelet decomposition. Nonlinear wavelet estimation. Hard and soft thresholding.

Density model: Kernel and projection methods

Nadaraya-Watson estimator, high-order kernels. Rate of estimation. Reduction to sequence space model. Wavelet density estimation.

List of References Required or Recommended for the Course

Course materials/Textbooks:

  1. Wassermann, L. "All of nonparametric statistics." (2006). Springer
  2. Rohde, Charles A. Introductory statistical inference with the likelihood function. Springer International Publishing, 2014.
  3. Tsybakov, Alexandre B. "Introduction to nonparametric estimation" (2009).
  4. Spokoiny, V. and Dickhaus, T. “Basics of moderm mathematical Statistics” (2015) Springer

Additional sources:

  1. Stéphane Boucheron, Olivier Bousquet and Gábor Lugosi “Theory of Classification: a Survey of Some Recent Advances”, ESAIM: P&S, 2005, Vol. 9, p. 323-375
  2. Bartlett, Peter L., Boucheron, Stephane, Gábor Lugosi (2002) “Model Selection and Error Estimation”, Machine Learning (48), 85-113