Boltzmann Encoded Adversarial Machines

Restricted Boltzmann Machines (RBMs) are a class of generative neural network that are typically trained to maximize a log-likelihood objective function. We argue that likelihood-based training strategies may fail because the objective does not sufficiently penalize models that place a high probability in regions where the training data distribution has low probability. To overcome this problem, we introduce Boltzmann Encoded Adversarial Machines (BEAMs). A BEAM is an RBM trained against an adversary that uses the hidden layer activations of the RBM to discriminate between the training data and the probability distribution generated by the model. We present experiments demonstrating that BEAMs outperform RBMs and GANs on multiple benchmarks.

Enter your email address to download paper.

Click the link to begin download.
Oops! Something went wrong while submitting the form.
White Papers

Applications of Digital Twins in Clinical Trials for Alzheimer’s Disease

Press

Unlearn.AI named to the 2021 CB Insights AI 100 List of Most Innovative Artificial Intelligence Startups

Blog

Welcoming Dr. Taylor to Unlearn.AI’s Board of Directors

I’m honored to have such an inspirational and experienced leader like Dr. Taylor join our board.
The AI 100 is CB Insights' annual list of the 100 most promising private AI companies in the world.
How Digital Twins make it possible to design and run more efficient clinical trials with well-defined statistical properties.