Boltzmann Encoded Adversarial Machines

Restricted Boltzmann Machines (RBMs) are a class of generative neural network that are typically trained to maximize a log-likelihood objective function. We argue that likelihood-based training strategies may fail because the objective does not sufficiently penalize models that place a high probability in regions where the training data distribution has low probability. To overcome this problem, we introduce Boltzmann Encoded Adversarial Machines (BEAMs). A BEAM is an RBM trained against an adversary that uses the hidden layer activations of the RBM to discriminate between the training data and the probability distribution generated by the model. We present experiments demonstrating that BEAMs outperform RBMs and GANs on multiple benchmarks.

Enter your email address to download paper.

Click the link to begin download.
Oops! Something went wrong while submitting the form.
Blog

Digital Twins: A Tool for Risk Mitigation in the Era of COVID-19

Blog

CB Insights 2020 Digital Health 150: Unlearn.AI named in List of Most Innovative Digital Health Startups

Blog

Embracing Innovation to Move Forward

At Unlearn, our goal is to use the data available from historical trials, to generate new evidence to inform and advance research.
Unlearn is thrilled to be recognized as a contributing member of the international community of pioneers in health.
In what ways can we mitigate risk and apply innovative solutions to unstable trials in the wake of COVID-19?