LOADING

From Micrograd to coppergrad: Building Neural Networks and Backpropagation from Scratch in Rust

In this talk, we’ll re-create the core ideas of Karpathy’s micrograd, but entirely in Rust.

Paweł Szulc
About This Talk

What happens when we take Andrej Karpathy’s legendary “The spelled-out intro to neural networks and backpropagation” — and rebuild it line by line in Rust?

In this talk, we’ll re-create the core ideas of Karpathy’s micrograd, but entirely in Rust. Together, we’ll build a tiny automatic differentiation engine and a simple neural network library - all from first principles. Along the way, we’ll uncover what backpropagation really is, why it works, and how it feels to express these mathematical concepts using Rust’s types, ownership, and safety guarantees.

This session is not just about Rust, and not just about neural networks — it’s where the two meet.

If you know Rust but have never built a neural net from scratch, you’ll finally understand how gradients flow and models learn.

If you know machine learning but not Rust, you’ll see how Rust’s design leads to clear, correct, and fast numerical code.

And if you love both - you’ll walk away inspired to experiment with tch-rs and other Rust ML tools.

Prerequisites: Basic Rust (or any programming language) and a vague memory of high-school calculus.

Outcome: You’ll leave understanding both how backpropagation works and how Rust helps you express it safely and efficiently.

more great talks

Might Be Interesting

Day 2
  —  
9:35 am
arrow pointing right icon

Building a self-hosted LLM ecosystem in Rust: from infrastructure to applications

This talk explores building a complete self-hosted LLM stack in Rust: Paddler, a distributed load balancer for serving LLMs at scale, and Poet, a static site generator that consumes those LLMs for AI-powered content features.

Day 1
  —  
5:20 pm
arrow pointing right icon

There are rats in my Cargo!!!

In this introductory talk, we will explore what it means to "Ratatuify" the Rust package manager, Cargo.

Day 1
  —  
9:35 am
arrow pointing right icon

From Pain to Solution: Private Rust Crates with CrabHub

As Rust projects grow, managing private crates becomes a real headache. Teams struggle with inconsistent versioning, fragile dependencies, and cumbersome workflows that slow down development. In this talk, I’ll walk through how these challenges can be solved with Rust and CrabHub.

Day 2
  —  
12:25 pm
arrow pointing right icon

Clean Code for Good Science: Rust in Research and Health

This talk explores what it means to write scientific software that lives up to the standards we expect of science itself.

Day 1
  —  
9:00 am
arrow pointing right icon

An Option? Have a slice!

In 2024, I added the `Option::as_slice` and `Option::as_mut_slice` methods to libcore. This talk is about what motivated the addition, and looks into the no less than 4 different implementations that made up the methods. It also shows that even without a deep understanding of all compiler internals, it is possible to add changes both to the compiler and standard library.

See All Events
Join us!

We're looking for amazing speakers.
CFP is open till 10.01.2023

Fill in Call for Papers
location icon

Location

Centrum Konferencyjne POLIN, Poland
stay in touch icon

Follow Us

Contact Us