UrbanPro
true

Learn Data Science from the Best Tutors

  • Affordable fees
  • 1-1 or Group class
  • Flexible Timings
  • Verified Tutors

Search in

Outlier

Nitish Vig
01/07/2020 0 0

Outliers
* An Outlier is an observation point that is distant from other observations.
* An outlier may indicate an experimental error, or it may be due to variability in the measurement.
* Outliers are different from the noise data. Noise is random error or variance that needs to be removed before outlier detection
* We can check the performance of dataset without outlier by checking scores.

 

Categories of Outlier

a) Global Outlier / Point Anomalies
* They are defined as data points that differ from the rest of the data.
* A particular type of global outlier is the influential point. It is defined as the outlier that impacts the rest of the data.
* We can evaluate an outlier based on the R2 score and regression line.
* Removing an outlier may or may not increase the R2. We have to study the individual purpose if needed.

b) Contextual / Conditional Outlier
* It is defined as the data point whose context differs from the rest of the data.
* It can be a point that is following a trend in some other context, with what defined for rest of the dataset.
* We have to study it and remove it carefully.
* We shall focus on two conditions :
    Contextual attributes: e.g., time, location, etc.
    Behavioural attributes: e.g., temperature, calories taken

c) Collective Outlier
* It is defined as a set of data point that deviates significantly from the rest of the data, even if the individual data points are not the outliers.
* We have to study it carefully. Removal of such data points may degrade the system. We shall focus on improving it.

0 Dislike
Follow 2

Please Enter a comment

Submit

Other Lessons for You

Basics of K means classification- An unsupervised learning algorithm
K-means is one of the simplest unsupervised learning algorithms that solve the well-known clustering problem. The procedure follows a simple and easy way to classify a given data set with n objects through...

What are Kalman filters? Why they are popular in AI?
Imagine we are making a self-driving car and we are trying to localize its position in an environment. The sensors of the vehicle can detect cars, pedestrians, and cyclists. Knowing the location of these...
T

Tasneem

0 0
0

13 Things Every Data Scientist Must Know Today
We have spent close to a decade in data science & analytics now. Over this period, We have learnt new ways of working on data sets and creating interesting stories. However, before we could succeed,...

Code: Gantt Chart: Horizontal bar using matplotlib for tasks with Start Time and End Time
import pandas as pd from datetime import datetimeimport matplotlib.dates as datesimport matplotlib.pyplot as plt def gantt_chart(df_phase): # Now convert them to matplotlib's internal format... ...
R

Rishi B.

0 0
0

Decision Tree or Linear Model For Solving A Business Problem
When do we use linear models and when do we use tree based classification models? This is common question often been asked in data science job interview. Here are some points to remember: We can use any...
X

Looking for Data Science Classes?

The best tutors for Data Science Classes are on UrbanPro

  • Select the best Tutor
  • Book & Attend a Free Demo
  • Pay and start Learning

Learn Data Science with the Best Tutors

The best Tutors for Data Science Classes are on UrbanPro

This website uses cookies

We use cookies to improve user experience. Choose what cookies you allow us to use. You can read more about our Cookie Policy in our Privacy Policy

Accept All
Decline All

UrbanPro.com is India's largest network of most trusted tutors and institutes. Over 55 lakh students rely on UrbanPro.com, to fulfill their learning requirements across 1,000+ categories. Using UrbanPro.com, parents, and students can compare multiple Tutors and Institutes and choose the one that best suits their requirements. More than 7.5 lakh verified Tutors and Institutes are helping millions of students every day and growing their tutoring business on UrbanPro.com. Whether you are looking for a tutor to learn mathematics, a German language trainer to brush up your German language skills or an institute to upgrade your IT skills, we have got the best selection of Tutors and Training Institutes for you. Read more