Mastodon discussion Discussions Apr 16 6 views

Title: P3: Llama2 learning and distributed training paradigms [2023-09-08 Fri]1. https://huggingface.co/blog/dpo-trl2. t...

by anoncheg

Title: P3: Llama2 learning and distributed training paradigms [2023-09-08 Fri]1. https://huggingface.co/blog/dpo-trl2. trl + accelerate https://huggingface.co/blog/trl-peft3. https://github.com/microsoft/DeepSpeedFor my task of dirtributed training large models I highlighted for myself paradigs: 🦄Model parallelism:\n#nn #ai #neural #automl #tensorflow #tf #torch #pytorch #llama #llama2

Read Original
Hugging Face Meta

Metadata

Account
anoncheg@mastodon.in.th

Related