BayesNDE: Bayesian Generative Modeling for Neural Density Estimation

Abstract

Density estimation is a fundamental problem in statistics and machine learning. In this work, we introduce BayesNDE, a neural density estimator based on Bayesian generative modeling. BayesNDE learns a Bayesian generative model and evaluates its density without requiring invertible networks or Jacobian-determinant computation. For each observation, it infers a sample-specific latent posterior to construct an adaptive proposal that focuses computation on regions contributing most to its density. Bridge sampling then combines samples from this proposal with separate posterior samples to estimate the density. Experiments on nonlinear and multimodal synthetic datasets show improved estimation of density values and better recovery of the density structure compared to the state-of-the-art neural density estimators. Applications to real-world datasets further demonstrate improved anomaly detection. Together, these results highlight BayesNDE as a flexible and effective neural density estimator, demonstrating how posterior inference can turn generative models into tools for density estimation.

Publication
arXiv preprint arXiv:2609.39843
Chenglin Li
Chenglin Li
Visiting student

I am an undergraduate student in Statistics and Data Science at Yunnan University. My research interests lie in biostatistics, machine learning, and causal inference, with a focus on their intersection with modern AI methods. Outside of research, I enjoy playing the guitar and tennis, and serve as the captain of the university tennis team.

Qiao Liu
Qiao Liu
Assistant Professor of Biostatistics

My research interests include generative AI, high-dimensional data analysis, and computational biology.