Tasks:
- * Adapt pipelines to robot models and hardware
- * Build high-concurrency backend services
- * Build large-scale data processing pipelines
- * Build multimodal data lakehouse
- * Build training datasets
- * Develop asynchronous task scheduling
- * Develop platform interfaces, dashboards, and admin tools
- * Diagnose production issues and optimize performance
- * Extract features and return processed data
- * Implement retries, idempotency, rate limiting, and callbacks
- * Ingest and govern data
- * Manage metadata, lineage, permissions, and dataset manifests
- * Parse and standardize robotics data
- * Support annotation and captioning workflows
- * Support data quality checks and cleaning
Perks/Benefits:
Skills/Tech stack required:
[Amazon S3] [Apache Flink] [Apache Iceberg] [Apache Kafka] [Apache Paimon] [Argo Workflows] [Asynchronous task processing] [CI/CD] [Concurrency programming] [Data Lakehouse] [Data Lineage] [Data Processing] [Dataset versioning] [Docker] [Go] [I/O] [Kubernetes] [Linux] [Multimodal Data] [Multimodal Data Processing] [Networking] [Performance Profiling] [PostgreSQL] [Prefect] [Process and Thread] [Process and thread management] [Python] [Ray] [ROS] [ROS 2] [Rosbag] [Shell Scripting] [Starrocks] [Task processing] [Thread management]
Educational requirements:
[Bachelor's Degree]
Role(s):
[Backend Engineer] [Data Engineer] [Data Platform] [Data Platform Engineer] [Engineer] [Full Stack Engineer] [Platform Engineer] [Robotics Data Engineer] [Stack Engineer]