# AI Evaluations Engineer, US Decision Intelligence Source: https://realanalystjobs.com/job/ai-evaluations-engineer-us-decision-intelligence-apple-002d96e9 AI Evaluations Engineer, US Decision Intelligence at Apple, an on-site role based in Austin, Texas, USA. Experience level: 5+ Years. Posted on 18 September 2026, read from Apple's own careers page (Apple), which RealAnalystJobs re-checks daily and removes the role when it closes. Apple has approved H-1B petitions on USCIS record (employer-wide, not a promise for this role). Updated 15 November 2026. ## Key facts - Company: [Apple](https://realanalystjobs.com/companies/apple) - Location: Austin, Texas, USA - Work mode: On-site - Posted: Sep 18, 2026 - Employment type: Full time - Experience level: 5+ Years - Source: Apple's careers page (Apple), re-checked daily Skills: [SQL](https://realanalystjobs.com/skills/sql), [Python](https://realanalystjobs.com/skills/python), Snowflake, Spark ## Visa sponsorship The posting does not say. Apple had H-1B petitions approved for 5,285 workers in fiscal year 2026 (USCIS). That is history, not a promise for this role. [See the record](https://realanalystjobs.com/companies/apple#h1b-record) ## About this role We’re seeking a visionary AI Evaluations Engineer to own the end-to-end evaluation pipeline for our AI products and agentic workflows. This role will focus on implementing and maintaining evaluation frameworks, instrumentation, and workflows that help us understand how well our AI systems perform, where they fail, and how they improve over time. You own the evaluation gate and the standards. This role will operate in both capacities, to augment existing AI roadmap, as well as innovate and trailblaze new frontier-technology projects, crafting AI experiences that reduce time to insight and catalyze decision making. 5+ years of experience in data and AI-related fields such as AI engineering, software development, ML engineering, data science, or QA roles. Eagerness and ability to learn new skills and solve dynamic problems in an encouraging and expansive environment. Strong Python skills. Hands-on experience with AI evaluation techniques, such as Golden datasets, LLM-as-a-Judge, or rubric-based scoring. Experience with different LLM ecosystems (OpenAI, Anthropic, Gemini, etc.), RAG pipelines, vector databases (e.g., Pinecone, FAISS, Milvus, PostgreSQL). Proficiency in SQL and experience with at least one major data analytics platform, such as Hadoop, Spark, or Snowflake. Experience with CI/CD or release validation workflows. Experience working with data science teams on insights generation leveraging LLMs. Strong time management skills with the ability to collaborate across multiple teams. Able to balance competing priorities, long-term projects, and ad hoc requirements. Ability to work in a fast-paced, dynamic, constantly evolving business environment. Hands-on experience with Langfuse or similar tools for LLM observability. Comfortable working with product/domain experts to translate fuzzy correctness criteria into measurable rubrics or metrics. B.S. degree in Computer Science/Engineering, or equivalent work experience Sound communication skills - expert at messaging domain and technical content, at a level appropriate for the audience. Strong ability to gain trust with stakeholders and senior leadership. Familiarity with embeddings, retrieval algorithms, agents, and data modeling for vector and graph databases. Other complementary technologies for distributed systems architecture and asynchronous messaging, agent communication, and caching like RabbitMQ, Redis, and Valkey are preferred. Experience working across global teams to ensure alignment of product development. Applied knowledge of GenAI and RAG strategies, microservices, recommendation systems, and context engineering. Working knowledge of agent evaluation concepts like trajectory vs. end-to-end vs. component-level evaluation, tool-call correctness. Advanced degree (MS or Ph.D.) in Economics, Electrical Engineering, Statistics, Data Science, or a similar quantitative field is preferred. Description from Apple's public careers feed, reproduced so you can read the role here. Apply on the company's own site; Real Analyst Jobs never submits anything for you. ## How to apply Open [this role on Real Analyst Jobs](https://realanalystjobs.com/job/ai-evaluations-engineer-us-decision-intelligence-apple-002d96e9) and use Apply now there to reach the employer's application. The listing is re-checked against Apple's careers page daily and removed when it closes. ## Apple 72 open analyst roles on Real Analyst Jobs. [More roles at Apple](https://realanalystjobs.com/companies/apple) ## More like this ### Other open roles at Apple - [Manager Data Products & AI Analytics - Supply Chain Operations - BPR](https://realanalystjobs.com/job/manager-data-products-and-ai-analytics-supply-chain-operations-bpr-apple-b5757881), Hyderabad, India (On-site) - [Corporate FP&A Analyst](https://realanalystjobs.com/job/corporate-fp-and-a-analyst-apple-b83eb78e), Cupertino, USA (On-site) - [EMEIA Credit Analyst](https://realanalystjobs.com/job/emeia-credit-analyst-apple-46a477cd), London, UK (On-site) - [Business system Analyst - SAP HCM Payroll Processing](https://realanalystjobs.com/job/business-system-analyst-sap-hcm-payroll-processing-apple-e58b8cd3), Bengaluru, India (On-site) - [Sr. Business Planning Functional Analyst, IT Governance & Planning, IS&T](https://realanalystjobs.com/job/sr-business-planning-functional-analyst-it-governance-and-planning-is-and-t-appl-2dbb581d), Sunnyvale California, USA (On-site) - [Data analyst jobs in the USA](https://realanalystjobs.com/jobs/data-analyst-jobs-in-usa) - [Analyst job market report](https://realanalystjobs.com/analyst-job-market) - [What analyst roles pay](https://realanalystjobs.com/blog/data-analyst-salaries) ## Sources and links - [This role on Real Analyst Jobs](https://realanalystjobs.com/job/ai-evaluations-engineer-us-decision-intelligence-apple-002d96e9) - [Apple on Real Analyst Jobs](https://realanalystjobs.com/companies/apple) - [All analyst jobs](https://realanalystjobs.com/jobs)