Boltzmann Encoded Adversarial Machines

Restricted Boltzmann Machines (RBMs) are a class of generative neural network that are typically trained to maximize a log-likelihood objective function. We argue that likelihood-based training strategies may fail because the objective does not sufficiently penalize models that place a high probability in regions where the training data distribution has low probability. To overcome this problem, we introduce Boltzmann Encoded Adversarial Machines (BEAMs). A BEAM is an RBM trained against an adversary that uses the hidden layer activations of the RBM to discriminate between the training data and the probability distribution generated by the model. We present experiments demonstrating that BEAMs outperform RBMs and GANs on multiple benchmarks.

Enter your email address to download paper.

Click the link to begin download.
Oops! Something went wrong while submitting the form.
Blog

Embracing Innovation to Move Forward

Podcasts

Your Digital Twin - UnlearnAI

Podcasts

Using AI Digital Twins for Drug Testing

Dr. Charles Fisher, CEO of Unlearn AI, discusses creating digital clones by using artificial intelligence for use in clinical drug trials.
A fascinating approach to the problem of how to make clinical trials more efficient, and understand more about what may be possible with more and better patient data.
At Unlearn, our goal is to use the data available from historical trials, to generate new evidence to inform and advance research.