Tasks:
- * Analyze evaluation data and identify model issues
- * Assess generated audio and video quality
- * Design and execute evaluation plans and test sets
- * Design and iterate evaluation benchmarks
- * Produce evaluation reports and improvement recommendations
- * Research competing multimodal models and analyze performance
- * Train evaluators and control annotation quality
Perks/Benefits:
Skills/Tech stack required:
[AIGC production workflow] [Annotation quality] [Annotation quality control] [Audio and video quality assessment] [Automated Evaluation] [Benchmark design] [Competitor Analysis] [Data Analysis] [Generative AI] [Model Evaluation] [Multimodal Generative AI] [Production workflow] [Prompt engineering] [Python] [Quality Assessment] [Quality Control] [Set design] [SQL] [Test set] [Test Set Design] [Video quality assessment]
Educational requirements:
[Bachelor's Degree]
Role(s):
[AI Model Evaluator] [Evaluation Specialist] [Evaluator] [Model Evaluation Specialist] [Specialist]