KL increases

[rojinsafavi]

Hello,

I ran the VAE code, and I noticed that the KL term increases instead of decreasing. I was wondering if that is the expected behavior?

blue is the total loss, green is the binary cross-entropy loss, and red is the KL

[Coderx7]

Can you use the latest PR for VAE and see if this still happens ?

[PyExtreme]

@rojinsafavi , Is the problem still there in latest PR of VAE? I hope my inputs may help in this.

[anlijuncn]

Current master branch is Okay. KL is firstly increasing and then decreasing, if you train more epochs, you could find this trend.
@PyExtreme @Coderx7 You could close it