Supervised learning: regression, classification and evaluation
Machine-learning approaches differ in what they learn, how they are trained, how they are evaluated and which problems they suit.
What you need to be able to do
- ExplainHow linear regression is used to predict continuous outcomes
- ExplainHow classifications techniques in supervised learning are used to predict discrete categorical outcomes
- ExplainThe role of hyperparameter tuning when evaluating supervised learning algorithms
Rapid Recall Deck
Say the answer aloud before flipping. Mark secure knowledge quickly and spend time on the gaps.
- What kind of outcome does linear regression predict?: A continuous numerical value.
- What are the predictor and response variables in regression?: The predictor/independent variable is used as input; the response/dependent variable is the outcome being predicted.
- What do the slope and intercept represent in a linear regression equation?: The slope is the predicted change in the response per unit change in the predictor; the intercept is the predicted response when the predictor is zero.
- What does R² indicate in a regression model?: How much of the variation in the response is explained by the model; higher values generally indicate a closer fit to the observed data.
- How does K-nearest neighbours (K-NN) classify a new data point?: It looks at the labels of nearby training examples and predicts a category based on those neighbours.
- How does a decision tree classify data?: It follows a sequence of feature-based decision rules from the root to a leaf that assigns a category.
- What do accuracy, precision, recall, and F1 score measure?: Accuracy is overall correctness; precision measures how many predicted positives are correct; recall measures how many actual positives are found; F1 balances precision and recall.
- Why tune hyperparameters and watch for overfitting/underfitting?: Hyperparameters affect model behaviour; poor choices can underfit the data or overfit training examples and generalize badly to new data.
Core knowledge and application
How linear regression is used to predict continuous outcomes
Machine-learning approaches differ in what they learn, how they are trained, how they are evaluated and which problems they suit.
Explain it without notes
Explain: How linear regression is used to predict continuous outcomes in the context of a team comparing candidate models for prediction, clustering and automation.
- The relationship between the independent (predictor) and dependent (response) variables
- The significance of the slope and intercept in the regression equation
- How well the model fits the data—often assessed using measures like r2
How classifications techniques in supervised learning are used to predict discrete categorical outcomes
Machine-learning approaches differ in what they learn, how they are trained, how they are evaluated and which problems they suit.
Explain it without notes
Explain: How classifications techniques in supervised learning are used to predict discrete categorical outcomes in the context of a team comparing candidate models for prediction, clustering and automation.
- K-Nearest Neighbours (K-NN) and decision trees algorithms to categorize new data points, based on patterns learned from existing labelled data
- Real-world applications of K-NN may include collaborative filtering recommendation systems
- Real-world applications of decision trees may include medical diagnosis based on a patient’s symptoms
Core knowledge and application
The role of hyperparameter tuning when evaluating supervised learning algorithms
Machine-learning approaches differ in what they learn, how they are trained, how they are evaluated and which problems they suit.
Explain it without notes
Explain: The role of hyperparameter tuning when evaluating supervised learning algorithms in the context of a team comparing candidate models for prediction, clustering and automation.
- Accuracy, precision, recall and F1 score as evaluation metrics
- Role of hyperparameter tuning on model performance
- Overfitting and underfitting when training algorithms
Regression, classification and supervised-model evaluation
Linear regression
12 is the intercept (prediction when x=0). 3.5 is the slope (predicted change in y per unit increase in x). R² summarizes how much variation is explained by the fitted relationship.
Classification
K-NN predicts using nearby labelled examples. Decision trees split data through learned decision rules. The best choice depends on data, problem and desired behaviour.
Transfer to a new scenario
- The relationship between the independent (predictor) and dependent (response) variables
- The significance of the slope and intercept in the regression equation
- K-Nearest Neighbours (K-NN) and decision trees algorithms to categorize new data points, based on patterns learned from existing labelled data
- Real-world applications of K-NN may include collaborative filtering recommendation systems
- Accuracy, precision, recall and F1 score as evaluation metrics
- Role of hyperparameter tuning on model performance
Paper 1 practice
- Explain: How linear regression is used to predict continuous outcomes in the context of a team comparing candidate models for prediction, clustering and automation.
- Explain: How classifications techniques in supervised learning are used to predict discrete categorical outcomes in the context of a team comparing candidate models for prediction, clustering and automation.
- Explain: The role of hyperparameter tuning when evaluating supervised learning algorithms in the context of a team comparing candidate models for prediction, clustering and automation.
Generative AI research checkpoint
Build a reusable evidence bank for Paper 1 Section B. Keep claims technical, specific and supported.
Finish the learning cycle
Exam preparation — main task
Complete targeted 2027 case-study research and cumulative Paper 1/Paper 2 practice. Record evidence and technical vocabulary you can use in extended responses.
Retrieval
Repeat today’s recall deck and revisit any item marked ‘Review again’.