GitHub Trending repo Repositories Jun 15

JustVugg/nanoeuler: GPT-2-style LLM built from scratch in C/CUDA with hand-written backprop, BPE tokenizer, FlashAttention, pretraining, and SFT.

by JustVugg

GPT-2-style LLM built from scratch in C/CUDA with hand-written backprop, BPE tokenizer, FlashAttention, pretraining, and SFT.

Read Original
LLM NVIDIA OpenAI

Metadata

Stars
5
Forks
1
Language
Cuda
Watchers
5
License
MIT

Related