1.
Introduction
2.
Boltzmann machines
3.
Types of Boltzmann machine
3.1.
Restricted Boltzmann Machine
3.1.1.
How does Restricted Boltzmann Machine work?
3.2.
Deep Boltzmann Machine
3.2.1.
How does the Deep Boltzmann Machine work?
3.3.
Deep Belief Network
3.3.1.
How does Deep Belief Network work?
4.
4.1.
What are the uses of the Restricted Boltzmann Machine?
4.2.
What are the uses of the Deep Boltzmann machine?
4.3.
What are the uses of the Deep Belief Network?
5.
Conclusion
Last Updated: Mar 27, 2024
Easy

# Types of Boltzmann Machine

Tashmit
0 upvote

## Introduction

Deep learning is a sub-category of machine learning which mirrors the functioning of our brains. Deep learning algorithms are similar to how the nervous system is structured, where each neuron is connected with the other and passes information. The Boltzmann Machine is a powerful generative model that uses a deep architecture, and in this article, we will learn all the types of Boltzmann Machine.

## Boltzmann machines

The Boltzmann Machine works on symmetric networks and decides whether the network will be on or off position by the random probability distribution. It belongs to the family of unsupervised learning; therefore, the model is solely responsible for any decision-making when some input features are provided.

## Types of Boltzmann machine

There are three types of Boltzmann machine

1. Restricted Boltzmann machine
2. Deep Boltzmann machine
3. Deep Belief machine

### Restricted Boltzmann Machine

The Restricted Boltzmann Machine is one of the types of Boltzmann machine. It is a bi-layered artificial network. They can learn a probability distribution over a set of inputs. As the name suggests, the Restricted Boltzmann machine restricts a few connections. We know that the Boltzmann machine has two layers, the hidden layer and the visible layer, which are connected with each other.

But the Restricted Boltzmann machine network is bipartite, which means that every node in the hidden layer is connected to the visible layer. Still, no two nodes of the visible layer are connected. This restriction provides a more efficient model.

#### How does Restricted Boltzmann Machine work?

As no two neurons of the same layer are connected, therefore each neuron has some random behaviour when activated. In RBMs, there are two additional layers of bias; hidden bias and visible bias. The hidden bias is responsible for producing the activation on the forward pass. The visible bias helps the machine rebuild the input during a backward pass or the reconstruction phase.

The image shows the initial step in training a Restricted Boltzmann Machine with numerous inputs. The product of inputs and weights are added to the bias. The final output is then passed through a sigmoid activation function, and the outcome determines if the hidden state gets activated or not. The sigmoid activation function here is:

Later comes the reconstruction phase. It is pretty similar to the initial step but only varies the direction.

### Deep Boltzmann Machine

It is one of the types of Boltzmann machines. Deep Boltzmann Machine is a generative model with an undirected connection between the layers. It contains a single visible layer and multiple layers of the hidden layer. Unlike the Restricted Boltzmann Machine, the layers are not interconnected; instead, they are intraconnected. The neuron in the deep Boltzmann machine is independent of each other, although they are dependent on the neighboring layer. The machine is trained layer-by-layer to make the model efficient.

#### How does the Deep Boltzmann Machine work?

The Deep Boltzmann Machine works by greedy layer-by-layer training. It depends on learning stacks of restricted Boltzmann machines. In layer-wise training, we increase the input twice for lower-level and top-level Restricted Boltzmann Machine. The lower level Restricted Boltzmann Machine inputs are doubled to compensate for the deficiency of top-down information into the first hidden layer. Likewise, we double the hidden units for the top-level Restricted Boltzmann Machine to pay for the lack of bottom-up input.

### Deep Belief Network

The Deep Belief Network is one of the types of Boltzmann machines. It is a generative model which uses multiple stacks of the deep architecture of the Restricted Boltzmann Machine. Each restricted Boltzmann machine performs a non-linear transformation on the input neurons and produces the outputs that serve as the input for the consecutive model. Deep Belief Networks can act as supervised or unsupervised as they have a generative model. Due to it, there is a lot of flexibility in Deep Belief Networks, and it is easier to expand.

#### How does Deep Belief Network work?

Deep Belief Networks are pre-trained using a greedy algorithm like all other networks. The algorithm applies a layer-by-layer approach to learn the top-down weights, and these weights determine the dependencies between each layer. In this network, numerous steps of Gibbs sampling run on the top two hidden layers. This step essentially creates a sample from the Restricted Boltzmann Machine deﬁned by the top two hidden layers. Later, a single pass of the previous sampling is used to find a piece from the visible layer throughout the rest of the model.

#### What are the uses of the Restricted Boltzmann Machine?

Restricted Boltzmann Machines are used for dimensionality reduction, classification, collaborative filtering, feature learning, topic modeling, and even many-body quantum mechanics.

#### What are the uses of the Deep Boltzmann machine?

The deep Boltzmann machine is used for efficient Deep Learning Approaches in Health Informatics.

#### What are the uses of the Deep Belief Network?

The Deep Belief Network is used to recognize, cluster, and generate images, video sequences, and motion-capture data.

## Conclusion

Boltzmann Machines comes under unsupervised learning and works on a systematic network. The article gives a brief description of the types of Boltzmann Machines and the working of each of the types.

Refer to our Guided Path on Coding Ninjas Studio to upskill yourself in Data Structures and AlgorithmsCompetitive ProgrammingJavaScriptSystem DesignMachine learning and many more! If you want to test your competency in coding, you may check out the mock test series and participate in the contests hosted on Coding Ninjas Studio! But if you have just started your learning process and are looking for questions asked by tech giants like Amazon, Microsoft, Uber, etc; you must look at the problems, interview experiences, and interview bundle for placement preparations.

You can also consider our Online Coding Courses such as the Machine Learning Course to give your career an edge over others.

Do upvote our blogs if you find them helpful and engaging!

Happy Learning!

Live masterclass