LOADING

From Micrograd to coppergrad: Building Neural Networks and Backpropagation from Scratch in Rust

In this talk, we’ll re-create the core ideas of Karpathy’s micrograd, but entirely in Rust.

Paweł Szulc
About This Talk

What happens when we take Andrej Karpathy’s legendary “The spelled-out intro to neural networks and backpropagation” — and rebuild it line by line in Rust?

In this talk, we’ll re-create the core ideas of Karpathy’s micrograd, but entirely in Rust. Together, we’ll build a tiny automatic differentiation engine and a simple neural network library - all from first principles. Along the way, we’ll uncover what backpropagation really is, why it works, and how it feels to express these mathematical concepts using Rust’s types, ownership, and safety guarantees.

This session is not just about Rust, and not just about neural networks — it’s where the two meet.

If you know Rust but have never built a neural net from scratch, you’ll finally understand how gradients flow and models learn.

If you know machine learning but not Rust, you’ll see how Rust’s design leads to clear, correct, and fast numerical code.

And if you love both - you’ll walk away inspired to experiment with tch-rs and other Rust ML tools.

Prerequisites: Basic Rust (or any programming language) and a vague memory of high-school calculus.

Outcome: You’ll leave understanding both how backpropagation works and how Rust helps you express it safely and efficiently.

more great talks

Might Be Interesting

Day 1
  —  
5:20 pm
arrow pointing right icon

There are rats in my Cargo!!!

In this introductory talk, we will explore what it means to "Ratatuify" the Rust package manager, Cargo.

Day 1
  —  
8:00 pm
arrow pointing right icon

Rustikon afterparty

Join us at the Rustikon afterparty!

Day 2
  —  
4:15 pm
arrow pointing right icon

Beyond println!: Mastering Rust Debugging

This talk explains how Rust debugging actually works: how compiler-generated debuginfo (DWARF/PDB) maps binaries back to source, and how LLDB/GDB interpret that data in practice.

Day 1
  —  
2:35 pm
arrow pointing right icon

Blazingly Fast or Blazingly Hyped? A Reality Check on the RIIR Movement

This talk puts popular Rust rewrites to the test. We'll examine how these tools stack up against their battle-tested predecessors, looking at real-world performance, compilation times, binary sizes, feature completeness, and ecosystem maturity.

Day 1
  —  
9:00 am
arrow pointing right icon

An Option? Have a slice!

In 2024, I added the `Option::as_slice` and `Option::as_mut_slice` methods to libcore. This talk is about what motivated the addition, and looks into the no less than 4 different implementations that made up the methods. It also shows that even without a deep understanding of all compiler internals, it is possible to add changes both to the compiler and standard library.

Day 2
  —  
11:50 am
arrow pointing right icon

Let's build an async runtime together

During this talk we'll build a basic, working async runtime using nothing more than a standard library. The point? To see it's approachable for mere mortals.

See All Events
Join us!

We're looking for amazing speakers.
CFP is open till 10.01.2023

Fill in Call for Papers
location icon

Location

Centrum Konferencyjne POLIN, Poland
stay in touch icon

Follow Us

Contact Us