Tasks:
- * Accelerate and deploy model inference
- * Build self-distillation and self-evolution pipelines
- * Design distributed training for embodied foundation models
- * Optimize training throughput with mixed precision and fused kernels
- * Track experiments and visualize model metrics
Perks/Benefits:
Skills/Tech stack required:
[BF16] [C++] [Data parallelism] [Data Pipelines] [DeepSpeed] [Diffusion Models] [FlashAttention] [FP8] [FSDP] [GPU Performance] [GPU Performance Optimization] [Inference Optimization] [Linux] [Megatron-LM] [Mixture of Experts] [Model Inference] [Model Inference Optimization] [Performance optimization] [Pipeline parallelism] [Python] [PyTorch] [PyTorch distributed] [Tensor Parallelism] [Transformer] [Triton]
Educational requirements:
N/A
Role(s):
[AI Infrastructure Engineer] [Deep Learning Engineer] [Engineer] [Inference Engineer] [Infrastructure Engineer] [Learning Engineer] [Machine Learning Engineer]