Hypothesis Testing

T-test

We use the T-test to compare the mean of two given samples. In the t-test, the sample has a normal distribution. We use the t-test when the population parameters (mean and standard deviation) are unknown.

There are three versions of the t-test:

•  Independent samples or a Two-sample T-test that compares the mean for two groups.
•  Paired sample t-test compares means of the same group at different intervals.
• One sample t-test tests the mean of one sample against a known mean.

The statistic for this hypothesis testing is called t-statistic, the score for which is calculated as:

t = (x1 — x2) / (σ / √n1 + σ / √n2)

Where,
x1 = mean of sample 1
x2 = mean of sample 2
n1 = size of sample 1
n2 = size of sample 2

Implementation

One sample t-test

Hypothesis:
H0(Null Hypothesis): There is no mean difference in the heights of different students. i.e., μ = 170.
H1(Alternative Hypothesis): The population mean is less than 170. i.e., μ < 170.

Importing libraries

from scipy.stats import ttest_1samp import numpy as np

Creating a data sample

data=[183, 152, 178, 157, 194, 163, 144, 114, 178, 152, 118, 158, 172, 138]

expected_mean=170

data_mean = np.mean(data) print(data_mean) tset, pval = ttest_1samp(data, expected_mean)

Output

157.21428571428572

print("p-value",pval) if pval < 0.05:      print("Null hypothesis rejected!") else:   print("Null hypothesis accepted!")

Output

p-value 0.06203337726572187 Null hypothesis accepted!

Two sample t-test

Hypothesis
H0(Null Hypothesis): Both samples are related.
H1(Alternative Hypothesis): Both samples are not related.

Importing Libraries

from scipy.stats import ttest_ind import numpy as np

Generating Data sample

data_A=[183, 152, 178, 157, 194, 163, 144, 114, 178, 152, 118, 158, 172, 138, 145, 133, 177, 200] data_B=[134, 156, 178, 123, 144, 155, 198, 133, 138, 143, 215, 189, 217, 170, 177, 175, 190, 195]

dataA_mean = np.mean(data_A) dataB_mean = np.mean(data_B)

print(dataA_mean) print(dataB_mean)

Output

158.66666666666666 168.33333333333334

ttest,pval = ttest_ind(data_A,data_B) print("p-value",pval) print("t-test value",ttest)

Output

p-value 0.28540582788030006 t-test value -1.0853424327944439

 

if pval <0.05: print("Null hypothesis rejected!") else: print("Null hypothesis accepted!")

Output

Null hypothesis accepted!

Paired t-test

We were given marks of 10 students on mathematics tests before and after taking tuition.

H0:Students have not shown positive results from tuition.
H1:Students have shown positive results from the tuition.

from scipy import stats import numpy as np

before=[15,16,14,22,25,19,18,19,20,23] after=[17,14,16,11,19,20,22,15,14,22]

before_mean = np.mean(before) after_mean = np.mean(after) print(before_mean) print(after_mean)

Output

19.1 17.0

ttest,pval = stats.ttest_rel(before, after) print(pval)

Output

0.18732880656887668

if pval<0.05:     print("Null hypothesis rejected!") else:     print("Null hypothesis accepted!")

Output

Null hypothesis accepted!

 

 

ANOVA Test

The t-test works fine while dealing with two samples, but sometimes we want to compare more than two groups simultaneously. In that case, we have to compare the means of each sample. We can carry out a separate t-test for each pair of samples, but you increase the chances of false positives when you conduct many tests.

ANOVA, also known as analysis of variance, compares multiple (three or more) samples with a single test. There are two primary flavors of ANOVA:
One-way ANOVA compares the difference between the three or more samples of a single independent variable.
Two-way ANOVA: It allows us to test the effect of one or more independent variables on two or more samples. 

The hypothesis that we test in ANOVA is
Null Hypothesis: All pairs of samples have the equal or same mean.
Alternate Hypothesis: Minimum of one pair of samples is significantly different.

Code

Importing Libraries

from scipy.stats import f_oneway import numpy as np

Creating Data Samples

df1=[15,16,14,22,25,19,18,19,20,23] df2=[17,14,16,11,19,20,22,15,14,22] df3=[15,16,12,14,18,19,10,25,26,22]

stat, p = f_oneway(df1, df2, df3)

print((stat, p))

Output

(0.6261663286004056, 0.5422225995608327)

if p > 0.05: print('Probably the same distribution') else: print('Probably different distributions')

Output

Probably the same distribution

 

 

Chi-square Test

The test is applied when we have two categorical variables from a single population. We use the chi-square test to determine whether there is a significant association between the two variables.

Z-Test

In a z-test, the sample should have a normal distribution. We calculate Z-score with population parameters such as mean and standard deviation. It is used to validate a hypothesis that the sample drawn belongs to the same population.

Null Hypothesis: Sample mean the same as the population mean.
Alternate Hypothesis: Sample mean is not the same as the population mean.

One sample Z-test

Importing Libraries

import pandas as pd from scipy import stats from statsmodels.stats import weightstats as stests

data=[183, 152, 178, 157, 194, 163, 144, 114, 178, 152, 118,158,172,138]

ztest ,pval = stests.ztest(data, x2=None, value=165) print(float(pval))

Output

0.21380045079406707

if pval<0.05:     print("Null hypothesis rejected!") else:     print("Null hypothesis accepted!")

Output

Null hypothesis accepted!

Two sample Z-test

import pandas as pd from scipy import stats from statsmodels.stats import weightstats as stests

before=[15,16,14,22,25,19,18,19,20,23] after=[17,14,16,11,19,20,22,15,14,22] before_mean = np.mean(before) after_mean = np.mean(after) print((before_mean,after_mean))

Output

(19.1, 17.0)

ztest ,pval = stests.ztest(before, x2=after, value=0,alternative='two-sided') print(float(pval))

Output

0.19364643126922043

if pval<0.05:     print("Null hypothesis rejected!") else:     print("Null hypothesis accepted!")

Output

Null hypothesis accepted!

 

 

FAQs

1. Can we change our hypothesis??
   It is not a good practice to change hypotheses. Generally, we form a hypothesis prior, and we cannot change it after the data collection.
    
2. What is the primary goal of hypothesis testing?
   Hypothesis testing tests whether the null hypothesis can be rejected or approved. If we reject the null hypothesis, the research hypothesis can be accepted.
    
3. What does a p-value of 0.05 mean?
   The null hypothesis is true when P>0.05. A statistically significant test result (P ≤ 0.05) means that the test hypothesis is false and we should reject it. A P value greater than 0.05 means that no effect was observed.

Key Takeaways

Let us brief the article.

Firstly we saw hypothesis testing. Further, we saw the basics of hypothesis testing that is needed before the validation of a hypothesis. Lastly, we saw different types of hypothesis testing and under which circumstances they are used. 

I hope you all like this article.
Happy Learning Ninjas!