PreprintarXiv licencearXiv
Build Your Own Neural Network From Scratch
Abstract
These notes are based on our reading of Michael Nielsen's online book neuralnetworksanddeeplearning.com. They represent our effort to elaborate his exposition of neural networks and to provide supporting mathematical detail. Our goal is to provide self-contained instructions for building a basic neural network in the form of pseudocode, so that an interested reader can build a network from scratch and know why it works. No prior knowledge of neural networks or of Python is assumed. Some familiarity with linear algebra, calculus, and probability is helpful but we explain the relevant mathematics in a set of appendices designed to be accessible to newcomers.
Related
- How to Bake a Composition Operator from Scratch
- Vector valued Jack polynomials from scratch
- A diffusion-free multi-layer neural-network method for multidimensional nonlinear hyperbolic equations
- Neural Ideals and Neural Codes: An Algebraic Framework for Neural Network Classification and Feature Interpretation
- Boundary-preserving randomized neural network methods for Poisson equations on general two- and three-dimensional domains
BibTeX
@misc{donner2026build,
title = {{Build Your Own Neural Network From Scratch}},
author = {Samantha Donner and Ethan Geary and Peter March and Mathew Umano},
howpublished = {arXiv},
year = {2026},
month = oct,
doi = {10.48550/arxiv.2610.24271},
eprint = {2610.24271},
archivePrefix = {arXiv},
url = {https://arxiv.org/abs/2610.24271},
}
RIS
TY - UNPB
TI - Build Your Own Neural Network From Scratch
AU - Samantha Donner
AU - Ethan Geary
AU - Peter March
AU - Mathew Umano
PY - 2026
DA - 2026/10/16
PB - arXiv
DO - 10.48550/arxiv.2610.24271
UR - https://arxiv.org/abs/2610.24271
AB - These notes are based on our reading of Michael Nielsen's online book neuralnetworksanddeeplearning.com. They represent our effort to elaborate his exposition of neural networks and to provide supporting mathematical detail. Our goal is to provide self-contained instructions for building a basic neural network in the form of pseudocode, so that an interested reader can build a network from scratch and know why it works. No prior knowledge of neural networks or of Python is assumed. Some familiarity with linear algebra, calculus, and probability is helpful but we explain the relevant mathematics in a set of appendices designed to be accessible to newcomers.
ER -