Kyle Dotterrer

Tagged “Neural-Networks”

  1. A Neural Character Bigram Language Model

    A neural character-level bigram language model, optimized with gradient descent rather than counted from the training data.

  2. More Autograd: Arithmetic Operations, Nonlinearities, and a Simple Neural Network Library

    Extending the autograd engine with more arithmetic operations and nonlinear activations, then building a small neural network library on top of it.

  3. A Scalar-Valued Autograd Engine

    Implementing a scalar-valued automatic differentiation engine from scratch. First post following Karpathy's Neural Networks: Zero to Hero.