Machine Learning

♡ supervised learning
♡ unsupervised learning
♡ reinforcement learning

#3 supervised learning: regression

note: independent variables are also called *features*

regression simply means prediction. there are many types of regression methods:

• simple linear regression
• multivariate linear regression
• polynomial regression
• ridge regression
• lasso regression

🎁 simple linear regression means predicting for only two variables, a dependent and an independent one

let us say that we have many points on a graph of x,y and want to draw a line of best fit. we draw the line of best fit then we predict for further values of x and y. i.e. it calculates the values of m and c in y = m * x + c

🎁 : multivariate linear regression means predicting for one dependent variable and two or more independent variables

the formula is in the format

ind. var. means independent variable

stuff = m1 * ind. var. 1+ m2 * ind. var. 2 + … + b

or

stuff = m1*feature1 + m2*feature2 + … + b

b is the intercept

many real world examples better fit with multivariate regression. like you might want to calculate fuel cost of trip based on many factors such as state of engine, age etc etc

we train our data to get the m1 m2 m3 etc then we can predict our target value for such and such situations

🎁 ridge regression

definition of ridge:
A ridge or a mountain ridge is a geological feature consisting of a chain of mountains or hills that form a continuous elevated crest for some distance.

just like the tops of mountains go up and down, similarly in the case where a graph’s shape is like mountain tops, going up and down, ridge regression is used as a *regularisation* method to have a simple curve so as to ignore large coefficients and get better predictions

another name: tikhonov regularization

exercise:

1) dig into the maths of how
i. linear regression works (how the line of best fit is drawn)
ii. multivariate regression works
iii. polynomial regression works

next:
cost function and gradient descent