Tasks:
- * Analyze edge cases and recurring errors
- * Calibrate, inspect, and accept evaluation data
- * Classify evaluation issues for algorithm improvement
- * Compile evaluation reports and bad-case datasets
- * Coordinate AI evaluation project delivery
- * Evaluate and provide feedback to suppliers
- * Identify and report project risks
- * Improve evaluation tools and workflows
- * Maintain evaluation standards and answer operational questions
- * Maintain project documentation and SOPs
- * Track schedules, task assignments, and progress
- * Track team productivity, quality, and attendance
- * Train and assess new evaluators
Perks/Benefits:
Skills/Tech stack required:
[AI Agents] [AI model] [AI Model Evaluation] [Automatic Speech Recognition] [Automatic Speech Recognition (ASR)] [CSV] [Data Analysis] [Digital Humans] [Feishu] [JSON] [Language Models] [Large Language Models] [Microsoft Excel] [Microsoft PowerPoint] [Microsoft Word] [Model Evaluation] [Multidimensional spreadsheets] [Project Management] [Python] [Speech Recognition ASR] [SQL] [Text to Speech] [Text to Speech TTS]
Educational requirements:
[Bachelor's Degree]
Role(s):
[Assistant] [Coordinator] [Project] [Project Assistant] [Project Coordinator]