Boltzmann Encoded Adversarial Machines

Restricted Boltzmann Machines (RBMs) are a class of generative neural network that are typically trained to maximize a log-likelihood objective function. We argue that likelihood-based training strategies may fail because the objective does not sufficiently penalize models that place a high probability in regions where the training data distribution has low probability. To overcome this problem, we introduce Boltzmann Encoded Adversarial Machines (BEAMs). A BEAM is an RBM trained against an adversary that uses the hidden layer activations of the RBM to discriminate between the training data and the probability distribution generated by the model. We present experiments demonstrating that BEAMs outperform RBMs and GANs on multiple benchmarks.

Enter your email address to download paper.

Click the link to begin download.
Oops! Something went wrong while submitting the form.
Blog

CTAD 2020: Unlearn will present abstracts to demonstrate how Digital Twins enable smaller, more efficient trials

Blog

Announcing The Unlearn Opportunities Internship Program

Podcasts

UCSF Rosenman Institute - The Health Technology Podcast #59: Digital Twins for Clinical Trials

Charles Fisher: Digital Twins for Clinical Trials
Creating Opportunities for Students of Data Science and Business from Underrepresented Groups in STEM
Unlearn will present data from two separate abstracts demonstrating how Digital Twins can power novel trial designs and accelerate timelines.