ML Engineering Skills

stas00/ml-engineering

Apply practical large-model training and operations guidance, and evaluate GPU cluster performance and readiness.

Материал обновлён:

Открыть на GitHub
19 702Звёзды1 301ФоркиПоследний push репозитория

Об этом Skill

Apply practical large-model training and operations guidance, and evaluate GPU cluster performance and readiness.

Почему мы его выбрали

A single repository groups related tasks; the members below link to their individual upstream entrypoints. Follow the upstream setup and each task’s dependencies.

Навыки в этой коллекции

2 навыков
  • Ml Engineering

    Field-tested methodology and concrete recipes for training and operating large-scale LLM/VLM/multi-modal models end to end - choosing and benchmarking accelerators, storage and network; SLURM/Kubernetes orchestration; maximizing training throughput and fitting models in memory; diagnosing and surviving training instabilities, NaN/Inf, and hardware/job failures; checkpointing and fault tolerance; inference…

    Открыть →
  • Evaluate Cluster

    Evaluates an ML GPU cluster for a cloud trial or acceptance test: environment dump, isolated newest PyTorch, matmul FLOPS (MAMF/MSMF) on every GPU while the others compute, intra-node all-reduce bandwidth and per-call latency of every collective, the same inter-node on every node you were given (omit those sections if there is only one node), fio on local disk and shared FS, dated markdown report.

    Открыть →

Перед использованием

  • The relevant ML stack and cluster access. Cluster evaluation runs hardware/software checks and needs the upstream test dependencies.

Источники и материалы

Ссылки на оригинальные материалы приведены ниже. Практические идеи предложены редакцией SkillHey.