Job Description
About The Role
As an AI Engineer, you will design, train, evaluate, and deploy ML models with a strong emphasis on LLM training pipelines and measurable model performance improvement. You will build data and evaluation workflows that connect model development to training data quality, annotation guidelines compliance, and QA evaluation.
What You Will Do
- Build and iterate on ML/LLM systems from prototype to production
- Develop evaluation harnesses for offline and online testing, including prompt evaluation and LLM evaluation
- Implement RLHF‑style feedback loops using human preference data when required
- Improve training data quality by defining labeling strategy, validation checks, and annotation guidelines
- Partner with QA evaluation and data labeling teams to reduce noise and bias
- Optimize inference latency and cost
- Document experiments, metrics, and rollouts