About this role
About the Role
Build and operate conversational AI systems that support real customer interactions over phone and SMS. This role connects product and platform work, with a focus on model quality, evaluation, tooling, and production reliability.
What You'll Do
• Build conversational AI systems that understand customer needs, take action, and determine when to act autonomously.
• Develop agent capabilities such as memory, knowledge graphs, and validated customization.
• Train, evaluate, deploy, and maintain models for prediction, classification, ranking, and capacity forecasting, using tools such as Ray Serve and Dagster.
• Create offline and online evaluations, simulations, and CI gates to identify regressions and measure production quality.
• Build shared evaluation, observability, and LLM tooling for product engineering teams.
• Contribute through design and code reviews, technical writing, and mentorship.
• Take ownership of work from problem definition through production monitoring and improvement.
What We're Looking For
• At least 6 years of software or machine learning engineering experience, including shipping ML or LLM-powered systems to production.
• Strong Python skills and software engineering fundamentals, including writing testable and maintainable code.
• Hands-on experience training and deploying ML models, working with LLMs, or both, including areas such as retrieval, tool use, and agents.
• An evaluation-first approach and experience measuring system quality and identifying regressions.
• Experience with ML platforms and tooling such as model serving, evaluation frameworks, registries, or observability.
• Familiarity with technologies such as Ray Serve, Dagster, Vertex AI, GCP, Kubernetes, Pulumi, LiveKit, and AI provider APIs.
• Experience with real-time or streaming systems, voice, telephony, or low-latency inference.
• Comfort working autonomously in an ambiguous, fast-changing product or startup environment.
Compensation & Benefits
Base salary: CA$200,000 to CA$250,000 annually. Visa sponsorship is not available.
Location
On-site in Montreal, Quebec, Canada.
Description from Clera's public careers feed, reproduced so you can read the role here. Apply on the company's own site; RealAnalystJobs never submits anything for you.
