Tasks:
- * Build AI evaluation sets
- * Coordinate incident resolution
- * Document reproducible defects
- * Gather user feedback
- * Integrate tests into CI/CD pipelines
- * Maintain automated regression test suites
- * Monitor platform health and performance
- * Partner with developers on defect fixes
- * Perform manual white-box and black-box testing
- * Resolve application issues and service requests
- * Support custom AI platform operations
- * Train employees on platform use
- * Validate AI response accuracy and grounding
Perks/Benefits:
- + 401k matching
- + Dental insurance
- + Medical insurance
- + Paid Holidays
- + Paid time off
- + Parental leave
- + Profit sharing
- + Tuition reimbursement
- + Vision insurance
- + Wellness program
Skills/Tech stack required:
[AI Observability] [AI output evaluation] [Automated testing] [Cause analysis] [CI/CD] [Cypress] [Defect Tracking] [Evaluation sets] [Incident Management] [Langfuse] [Manual Testing] [Output Evaluation] [Performance Monitoring] [Platform monitoring] [Playwright] [Root cause] [Root Cause Analysis]
Educational requirements:
N/A
Role(s):
[AI Platform Analyst] [AI Quality Analyst] [Analyst] [Application Support] [Application Support Analyst] [Platform Analyst] [QA Analyst] [Quality Analyst] [Support Analyst]