Survivalist Pro
Photo by Jovan  Setyadi Pexels Logo Photo: Jovan Setyadi

What are the 3 types of sum of squares?

In regression analysis, the three main types of sum of squares are the total sum of squares, regression sum of squares, and residual sum of squares.

Who is gambling god?
Who is gambling god?

Ko Chun is a world-famous gambler, so renowned and talented at winning various games of chance that he is referred to as the "God of Gamblers".

Read More »
What a girl should carry in her bag for safety?
What a girl should carry in her bag for safety?

21 handbag essentials a woman should always carry Wallet/Cash. Phone and charger. Power-bank. Headphones. Hand sanitizer. Wet wipes. Notepad and...

Read More »

Sum of Squares A statistical tool that is used to identify the dispersion of data Written by CFI Team Updated December 4, 2022

What is Sum of Squares?

Sum of squares (SS) is a statistical tool that is used to identify the dispersion of data as well as how well the data can fit the model in regression analysis. The sum of squares got its name because it is calculated by finding the sum of the squared differences.

This image is only for illustrative purposes.

The sum of squares is one of the most important outputs in regression analysis. The general rule is that a smaller sum of squares indicates a better model, as there is less variation in the data. In finance, understanding the sum of squares is important because linear regression models are widely used in both theoretical and practical finance.

Types of Sum of Squares

In regression analysis, the three main types of sum of squares are the total sum of squares, regression sum of squares, and residual sum of squares.

1. Total sum of squares

The total sum of squares is a variation of the values of a dependent variable from the sample mean of the dependent variable. Essentially, the total sum of squares quantifies the total variation in a sample. It can be determined using the following formula:

Where:

y i – the value in a sample

– the value in a sample ȳ – the mean value of a sample 2. Regression sum of squares (also known as the sum of squares due to regression or explained sum of squares) The regression sum of squares describes how well a regression model represents the modeled data. A higher regression sum of squares indicates that the model does not fit the data well.

The formula for calculating the regression sum of squares is:

Where:

ŷ i – the value estimated by the regression line

– the value estimated by the regression line ȳ – the mean value of a sample 3. Residual sum of squares (also known as the sum of squared errors of prediction) The residual sum of squares essentially measures the variation of modeling errors. In other words, it depicts how the variation in the dependent variable in a regression model cannot be explained by the model. Generally, a lower residual sum of squares indicates that the regression model can better explain the data, while a higher residual sum of squares indicates that the model poorly explains the data.

The residual sum of squares can be found using the formula below:

Where:

y i – the observed value

– the observed value ŷ i – the value estimated by the regression line The relationship between the three types of sum of squares can be summarized by the following equation: Thank you for reading CFI’s guide to Sum of Squares. To keep learning and advancing your career, the following CFI resources will be helpful:

What shortages should we expect in 2022?
What shortages should we expect in 2022?

Baby formula, wine and spirits, lawn chairs, garage doors, butter, cream cheese, breakfast cereal and many more items have also been facing...

Read More »
What condition occurs in females only?
What condition occurs in females only?

Turner syndrome, a condition that affects only females, results when one of the X chromosomes (sex chromosomes) is missing or partially missing....

Read More »

What are the 6 defenses?
What are the 6 defenses?

These are six conventional approaches to defending people from criminal prosecution. Affirmative Defense. Coercion and Duress. Abandonment and...

Read More »
Is there a 1 man tank?
Is there a 1 man tank?

In 1925 British tank pioneer Giffard Le Quesne Martel built a one-man tank in his garage and showed it to the War Office, who agreed to production...

Read More »
What code do hackers use?
What code do hackers use?

Given below is the list of the best programming languages that hackers around the world extensively use: Python. Exploit Writing: Python is a...

Read More »
Can 1 year old drink Coke?
Can 1 year old drink Coke?

It's best to avoid these drinks if you can. Fizzy drinks, fruit squashes and flavoured milks are not healthy choices for your baby. Most fizzy...

Read More »