Unbiased Implicit Variational Inference

We develop unbiased implicit variational inference (UIVI), a method that expands the applicability of variational inference by defining an expressive variational family. UIVI considers an implicit variational distribution obtained in a hierarchical manner using a simple reparameterizable distribution whose variational parameters are defined by arbitrarily flexible deep neural networks. Unlike prev

[elu_18]

変分推論の事後確率の近似に強力な暗黙的モデルを使った場合でもELBOの勾配の不偏推定を求められる。エントロピー項についての勾配が問題となるが、潜在変数を生成するノイズ分布を求める問題に変換し、実際に生成し