🚧 This website is under construction — more content coming soon.

ML Resources Hub
Home Theory Engineering Resources
ML Theory

Machine Learning Theory

Short TL;DRs on each ML topic, with curated pointers to the canonical deep dives. A structured tour from mathematical foundations through model families and frontier topics.

Model Families

Neural Networks

  • Neural Networks
  • NN Architectures 8
    • Deep Neural Networks (DNN)
    • Convolutional Neural Networks (CNN)
    • Recurrent Neural Networks (RNN)
    • Transformers
    • Graph Neural Networks (GNN)
    • Autoencoders & VAEs
    • Generative Adversarial Networks (GAN)
    • Diffusion Models

Linear Models

  • Linear & Logistic Regression

Kernel Methods

  • Support Vector Machines
  • Gaussian Processes

Tree-Based & Ensembles

  • Decision Trees
  • Random Forests
  • Gradient Boosting (XGBoost, LightGBM)

Probabilistic Models

  • Naive Bayes
  • Gaussian Mixture Models
  • Hidden Markov Models
  • Bayesian Inference

Clustering

  • Clustering Algorithms

Dimensionality Reduction

  • Dimensionality Reduction
  • Methods 4
    • Principal Component Analysis (PCA)
    • t-SNE
    • UMAP
    • Independent Component Analysis (ICA)

Anomaly Detection

  • Anomaly Detection

Core Concepts

The Learning Problem

  • Learning Paradigms
  • Hypothesis Spaces & Inductive Bias

Training

  • Loss Functions
  • Gradient Descent
  • Advanced Optimizers

Generalization

  • Bias-Variance & Overfitting
  • Regularization
  • Model Selection

Evaluation

  • Classification Metrics
  • Regression Metrics
  • Calibration

Data & Features

Preparing Data

  • Data Preprocessing
  • Feature Engineering
  • Splits & Cross-Validation

Common Pitfalls

  • Imbalanced Data
  • Missing Data
  • Data Leakage

Learning Paradigms

Beyond Supervised Learning

  • Supervised & Unsupervised
  • Self-Supervised & Contrastive
  • Semi-Supervised Learning
  • Reinforcement Learning
  • Transfer Learning & Fine-Tuning

Applications & Frontier

Application Domains

  • Natural Language Processing
  • Computer Vision

Frontier

  • Generative Models
  • Foundation Models & LLMs
  • Interpretability & Explainability
  • Fairness, Bias & Ethics

Contact

Have questions or suggestions? Get in touch!

liv.helen.vage@cern.ch

© 2024 ML Resources Hub. Credits