Cross-validated density estimates based on Kullback-Leibler information
Authors:
Alain Berlinet a;
Elodie Brunel b
| Affiliations: | a Laboratoire de Probabilit s et Statistique, Universit Montpellier II, Place Eug ne Bataillon, Montpellier Cedex 5, France |
b MAP5, Universit Paris 5, Paris, Cedex 6, France |
DOI:
10.1080/10485250310001644583
Publication Frequency:
8 issues per year
Published in:
Journal of Nonparametric Statistics,
Volume
16,
Issue
3 &
4
June
2004
, pages 493
- 513
Subjects:
Mathematical Economics;
Mathematical Finance;
Medical Statistics;
Statistical Theory & Methods;
Statistics;
Statistics for the Biological Sciences;
Stochastic Models & Processes;
Number of References: 23
Formats available:
HTML
(English)
:
PDF
(English)
View Article:
View Article (PDF)
View Article (HTML)
Abstract
The convergence of measure estimates in the sense of Kullback-Leibler divergence is required in many applications in decision and information theory. Recently, modified histograms have been shown to have good properties with respect to information divergences. For these estimates deterministic optimal bandwidths have been given, but no automatic smoothing procedure has been shown to be asymptotically optimal. In the present article, we consider the Kullback-Leibler cross-validation method for selecting the bin width of modified histograms. We analyze the behavior of the Kullback-Leibler divergence and of its expectation and prove that the cross-validated estimate is asymptotically optimal with respect to the Kullback-Leibler divergence.
|
| Keywords: Functional estimation; Binned data; Barron density estimates; Histograms; Kullback-Leibler divergence; Automatic smoothing parameter; Cross-validation techniques |
| view references (23) : view citations |

Download Citation


s et Statistique, Universit
ne Bataillon, Montpellier Cedex 5, France
CiteULike
Del.icio.us
BibSonomy
Connotea