Naïve Bayes Classifier Algorithm.pptx

Introduction
• Naïve Bayes algorithm is a supervised learning algorithm, which is
based on Bayes theorem and used for solving classification
problems.
• It is mainly used in text classification that includes a high-
dimensional training dataset.
• Naïve Bayes Classifier is one of the simple and most effective
Classification algorithms which helps in building the fast machine
learning models that can make quick predictions.
• It is a probabilistic classifier, which means it predicts on the
basis of the probability of an object.
• Some popular examples of Naïve Bayes Algorithm are spam
filtration, Sentimental analysis, and classifying articles.

Why is it called Naïve Bayes?
• The Naïve Bayes algorithm is comprised of two words Naïve
and Bayes, Which can be described as:
• Naïve: It is called Naïve because it assumes that the
occurrence of a certain feature is independent of the occurrence
of other features. Such as if the fruit is identified on the bases of
color, shape, and taste, then red, spherical, and sweet fruit is
recognized as an apple. Hence each feature individually
contributes to identify that it is an apple without depending on
each other.
• Bayes: It is called Bayes because it depends on the principle
of Bayes' Theorem.

Bayes' Theorem:
• Bayes' theorem is also known as Bayes' Rule or Bayes' law,
which is used to determine the probability of a hypothesis with
prior knowledge. It depends on the conditional probability.
• The formula for Bayes' theorem is given as:

Where,
• P(A|B) is Posterior probability: Probability of hypothesis A on
the observed event B.
• P(B|A) is Likelihood probability: Probability of the evidence
given that the probability of a hypothesis is true.
• P(A) is Prior Probability: Probability of hypothesis before
observing the evidence.
• P(B) is Marginal Probability: Probability of Evidence.

Working of Naïve Bayes' Classifier:
• Working of Naïve Bayes' Classifier can be understood with the
help of the below example:
• Suppose we have a dataset of weather conditions and
corresponding target variable "Play". So using this dataset we
need to decide that whether we should play or not on a
particular day according to the weather conditions.

• Problem: If the weather is sunny, then the Player should play or
not?
• Solution: To solve this, first consider the below dataset:

Likelihood table weather condition:

Advantages of Naïve Bayes Classifier:
• Naïve Bayes is one of the fast and easy ML algorithms
to predict a class of datasets.
• It can be used for Binary as well as Multi-class
Classifications.
• It performs well in Multi-class predictions as compared
to the other Algorithms.
• It is the most popular choice for text classification
problems.

Disadvantages of Naïve Bayes Classifier:
• Naive Bayes assumes that all features are
independent or unrelated, so it cannot learn the
relationship between features.

Applications of Naïve Bayes
Classifier:
• It is used for Credit Scoring.
• It is used in medical data classification.
• It can be used in real-time predictions because Naïve
Bayes Classifier is an eager learner.
• It is used in Text classification such as Spam
filtering and Sentiment analysi

Types of Naïve Bayes Model:
There are three types of Naive Bayes Model, which are given
below:
• Gaussian: The Gaussian model assumes that features follow a
normal distribution
• Bernoulli: The Bernoulli classifier works similar to the
Multinomial classifier, but the predictor variables are the
independent Booleans variables. Such as if a particular word is
present or not in a document. This model is also famous for
document classification tasks.
• Multinomial: The Multinomial Naïve Bayes classifier is used
when the data is multinomial distributed. It is primarily used for
document classification problems, it means a particular
document belongs to which category such as Sports, Politics,
education, etc.

Python Implementation of the Naïve
Bayes algorithm:
Now we will implement a Naive Bayes Algorithm using Python.
So for this, we will use the "user_data" dataset, which we have
used in our other classification model. Therefore we can easily
compare the Naive Bayes model with the other models.

Steps to implement:
• Data Pre-processing step
• Fitting Naive Bayes to the Training set
• Predicting the test result
• Test accuracy of the result(Creation of Confusion
matrix)
• Visualizing the test set result.

Naïve Bayes Classifier Algorithm.pptx

More Related Content

What's hot

Similar to Naïve Bayes Classifier Algorithm.pptx

More from Shubham Jaybhaye

Recently uploaded

Naïve Bayes Classifier Algorithm.pptx