Tasks:
- * Accelerate data preprocessing and loading
- * Build CI/CD and regression testing workflows
- * Diagnose memory, GPU, and communication failures
- * Maintain and modularize training frameworks
- * Measure training efficiency and stability
- * Optimize distributed training performance
- * Optimize large scale data pipelines
Perks/Benefits:
Skills/Tech stack required:
[Arrow] [Async Programming] [C++11] [C++14] [C++17] [CI/CD] [CUDA] [DDP] [DeepSpeed] [Distributed Training] [FSDP] [Git] [GPU Profiling] [Linux] [Lmdb] [Megatron] [Multiprocessing] [Multithreading] [Python] [PyTorch] [STL] [TFRecord] [WebDataset]
Educational requirements:
[Doctor of Philosophy] [Master's Degree]
Role(s):
[Deep Learning Framework Engineer] [Engineer] [Framework Engineer] [Learning Engineer] [Machine Learning Engineer]