Nonlinear Theory and Its Applications, IEICE
Online ISSN : 2185-4106
ISSN-L : 2185-4106
Regular Section
Ensemble kalman variational objective: a variational inference framework for sequential variational auto-encoders
Tsuyoshi IshizoneTomoyuki HiguchiKazuyuki Nakamura
Author information
JOURNAL OPEN ACCESS

2023 Volume 14 Issue 4 Pages 691-717

Details
Abstract

Time series model inference can be divided into modeling and optimization. Sequential VAEs have been studied as a modeling technique. As an optimization technique, methods combining variational inference (VI) and sequential Monte Carlo (SMC) have been proposed; however, they have two drawbacks: less particle diversity and biased gradient estimators. This paper proposes Ensemble Kalman Variational Objective (EnKO), a VI framework with the ensemble Kalman filter, to infer latent time-series models. Our proposed method efficiently learns the time-series models because of its particle diversity and unbiased gradient estimators. We demonstrate that our EnKO outperforms previous SMC-based VI methods in the predictive ability for several synthetic and real-world data sets.

Content from these authors
© 2023 The Institute of Electronics, Information and Communication Engineers

This article is licensed under a Creative Commons [Attribution-NonCommercial-NoDerivatives 4.0 International] license.
https://creativecommons.org/licenses/by-nc-nd/4.0/
Previous article
feedback
Top