Ml Engineering

stas00/ml-engineering

Field-tested methodology and concrete recipes for training and operating large-scale LLM/VLM/multi-modal models end to end - choosing and benchmarking accelerators, storage and network; SLURM/Kubernetes orchestration; maximizing training throughput and fitting models in memory; diagnosing and surviving training instabilities, NaN/Inf, and hardware/job failures; checkpointing and fault tolerance; inference…

Материал обновлён:

В коллекцииML Engineering Skills ↗
Открыть на GitHub
19 702Звёзды1 301ФоркиПоследний push репозитория

Об этом Skill

Field-tested methodology and concrete recipes for training and operating large-scale LLM/VLM/multi-modal models end to end - choosing and benchmarking accelerators, storage and network; SLURM/Kubernetes orchestration; maximizing training throughput and fitting models in memory; diagnosing and surviving training instabilities, NaN/Inf, and hardware/job failures; checkpointing and fault tolerance; inference…

Почему мы его выбрали

A task from ML Engineering Skills. Retain the upstream supporting files and follow the repository’s setup instructions.

Перед использованием

  • The relevant ML stack and cluster access. Cluster evaluation runs hardware/software checks and needs the upstream test dependencies.

Источники и материалы

Ссылки на оригинальные материалы приведены ниже. Практические идеи предложены редакцией SkillHey.