Monotonic alpha-divergence minimisation - Equipe Signal, Statistique et Apprentissage Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2021

Monotonic alpha-divergence minimisation

Résumé

In this paper, we introduce a novel iterative algorithm which carries out $\alpha$-divergence minimisation by ensuring a systematic decrease in the $\alpha$-divergence at each step. In its most general form, our framework allows us to simultaneously optimise the weights and components parameters of a given mixture model. Notably, our approach permits to build on various methods previously proposed for $\alpha$-divergence minimisation such as gradient or power descent schemes. Furthermore, we shed a new light on an integrated Expectation Maximization algorithm. We provide empirical evidence that our methodology yields improved results, all the while illustrating the numerical benefits of having introduced some flexibility through the parameter $\alpha$ of the $\alpha$-divergence.
Fichier principal
Vignette du fichier
ddr_2021_hal.pdf (1.41 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03164338 , version 1 (09-03-2021)
hal-03164338 , version 2 (27-04-2023)

Identifiants

  • HAL Id : hal-03164338 , version 1

Citer

Kamélia Daudel, Randal Douc, François Roueff. Monotonic alpha-divergence minimisation. 2021. ⟨hal-03164338v1⟩
301 Consultations
84 Téléchargements

Partager

Gmail Facebook X LinkedIn More