Skip to content
Léonel Vodounou

Blog

Notes on machine learning, LLMs and the math behind them.

Reading notes

7-chapter series · 4 published

Build a Large Language Model (from Scratch)

By Sebastian Raschka

Chapter-by-chapter reading notes on Sebastian Raschka's book. A complete path to understanding and building an LLM from the ground up.

  1. 00 Introduction to PyTorch
  2. 01 Understanding large language models
  3. 02 Working with text data
  4. 03 Coding attention mechanisms

Series

5-chapter series · 5 published

Logic Tensor Networks

A step-by-step series on Logic Tensor Networks, a neuro-symbolic framework where first-order logic becomes a differentiable loss: from grounding symbols as tensors to learning by satisfying a knowledge base.

  1. 01 Grounding: from symbols to tensors
  2. 02 Connectives and quantifiers
  3. 03 Operators and their gradients
  4. 04 Learning by satisfying a knowledge base
  5. 05 Case study: adding digits without ever labeling them

Articles