What is Machine Learning?
- Machine learning is a type of artificial intelligence where computers learn from data and improve their performance over time without being explicitly programmed.
- Algorithms detect patterns, make decisions, and predict outcomes based on previous examples.
Supervised Learning
- Supervised learning involves training a model on a labeled dataset, where each input is paired with a corresponding output.
- Types:
- Classification: Predicts discrete categories (e.g., spam or not spam).
- Regression: Predicts continuous values (e.g., house prices).
- Medical Imaging Diagnostics: Supervised learning is used to classify medical images (e.g., X-rays) into diagnostic categories.
- Object detection (e.g. cat or dog in image)
- Sentiment analysis (e.g. positive/negative reviews)
- Predicting student performance
Unsupervised Learning
- Unsupervised learning deals with unlabeled data, aiming to find hidden patterns or structures.
- Types:
- Clustering: Groups similar data points (e.g., customer segmentation).
- Association rule mining (finding item relationships)
- Dimensionality Reduction: Reduces data complexity while preserving important features (e.g., PCA).
Market Basket Analysis: Unsupervised learning algorithms like Apriori identify associations between products in transaction data. (e.g. "People who buy X also buy Y") Customer segmentation Anomaly detection.
Reinforcement Learning
- Reinforcement learning involves an agent learning to make decisions by interacting with an environment to maximize cumulative reward.
- Key Concepts:
- Exploration vs. Exploitation: Balancing trying new actions and using known strategies.
- Policy: A strategy that defines the agent's actions.
- Robotics Navigation: Reinforcement learning enables robots to learn optimal paths by receiving feedback from their actions.
- Game playing (e.g. chess, Go)
- Personalised learning systems
- Financial decision-making
Deep Learning
- Deep learning is a subset of machine learning that uses artificial neural networks with multiple layers to automatically extract and learn hierarchical features from large, complex data sets.
- Architectures:
- Convolutional Neural Networks (CNNs): Ideal for image processing.
- Recurrent Neural Networks (RNNs): Designed for sequential data like text.
- Transformers – modern Natural Language Processing (NLP) and vision models
- Medical Imaging: CNNs are used to detect diseases in X-rays and MRIs.
- Speech and audio recognition
- Natural language processing (e.g. chatbots, translation)
- Educational visual aids and content personalisation
Transfer Learning
- Transfer learning involves reusing a pre-trained model on a new, related task, with the aim to reduce the time and data needed for training a new model.
- How it works:
- Use a pre-trained model (e.g. on a general dataset)
- Fine-tune it on a smaller, specific dataset
- Benefits:
- Reduces training time.
- Improves performance with limited data.
- Natural Language Processing (NLP): Models like BERT are pre-trained on large text corpora and fine-tuned for specific tasks like sentiment analysis.
- Medical imaging (reusing models trained on general images)
- Sentiment analysis (adapting BERT to new text tasks)
- Object detection in specific environments
- Language translation in domain-specific contexts
Real-World Applications of Machine Learning
Market Basket Analysis
- Description: Identifies associations between products in transaction data.
- Algorithm: Apriori (Unsupervised Learning).