# Senior QA Engineer, AI Source: https://realanalystjobs.com/job/senior-qa-engineer-ai-intercontinental-exchange-7427cefd Senior QA Engineer, AI at Intercontinental Exchange, an on-site role based in Hyderabad, India. Experience level: 8+ Years. Posted on 7 October 2026, read from Intercontinental Exchange's own careers page (Jibe), which RealAnalystJobs re-checks daily and removes the role when it closes. Updated 15 November 2026. ## Key facts - Company: [Intercontinental Exchange](https://realanalystjobs.com/companies/intercontinental-exchange) - Location: Hyderabad, India - Work mode: On-site - Posted: Oct 7, 2026 - Employment type: Full time - Experience level: 8+ Years - Source: Intercontinental Exchange's careers page (Jibe), re-checked daily Skills: [SQL](https://realanalystjobs.com/skills/sql), [Python](https://realanalystjobs.com/skills/python), AWS, Azure ## Visa sponsorship The posting does not say. Intercontinental Exchange had H-1B petitions approved for 135 workers in fiscal year 2026 (USCIS). That is history, not a promise for this role. [See the record](https://realanalystjobs.com/companies/intercontinental-exchange#h1b-record) ## About this role ICE's AI Center of Excellence is looking for a Senior Software Test Engineer to own QA for our AI powered applications. This role works with Systems Analysts, Development, and QA to understand business/product and system requirements and define test scenarios for AI applications, combining core QA fundamentals, Python scripting, and API validation with specialized AI/LLM evaluation skills such as detecting hallucinations, bias, and drift. Responsibilities • Lead test strategy for AI/ML features: model output validation, regression testing across model/prompt versions, and edge case discovery. • Build evaluation frameworks for testing AI outputs for accuracy, consistency, bias, hallucination, and safety/guardrail compliance. • Define golden datasets, ground truth labels, and release acceptance criteria with data science and ML engineering. • Automate prompt based test suites and model evaluation metrics into CI/CD release gates. • Lead and mentor a QA team, setting AI testing standards across projects. • Translate AI feature requirements into test scenarios and quality gates. • Monitor production of AI behavior and evolve test coverage based on real world failures. Knowledge and Experience • 8+ years of QA/test engineering experience, including 3+ years testing AI, ML, or data driven applications. • 3+ years of experience with AI/LLM evaluation frameworks: prompt regression, hallucination detection, bias/fairness testing, and model/data drift detection. • 5+ years of Python experience for test automation, data analysis, and evaluation scripting. • 3+ years of experience with UI automation frameworks (Selenium, Playwright, or Cypress) for AI powered features. • Strong SQL and data validation skills for testing the pipelines that feed AI models. • Working knowledge of ML fundamentals: evaluation of metrics, train/validation/test splits, model versioning. • Experience testing conversational AI/chatbots: multi turn dialogue, intent/context handling, and guardrail validation against harmful or adversarial prompts. • Experience testing REST/GraphQL APIs: functional, contract, and schema validation, auth testing, negative/boundary testing, and load testing. • Experience testing AI applications for infosec: prompt injection resistance, data leakage/PII exposure prevention, access control, and secure endpoint authentication, per organizational security policy. • Ability to validate AI applications against organizational compliance requirements and frameworks (SOC 2, ISO 27001, NIST AI RMF, GDPR), coordinating with InfoSec and Compliance. Preferred Knowledge and Experience • Experience testing RAG systems or autonomous agents. • Familiarity with responsible AI principles: fairness, transparency, safety guardrails. • Experience with LLM eval tools such as LangSmith, Ragas, or DeepEval. • Exposure cloud AI/ML platforms (AWS SageMaker, Azure ML, or GCP Vertex AI). • Experience in financial services, Mortgage or fintech applications. • Experience with Git or other version control systems. Description from Intercontinental Exchange's public careers feed, reproduced so you can read the role here. Apply on the company's own site; Real Analyst Jobs never submits anything for you. ## How to apply Open [this role on Real Analyst Jobs](https://realanalystjobs.com/job/senior-qa-engineer-ai-intercontinental-exchange-7427cefd) and use Apply now there to reach the employer's application. The listing is re-checked against Intercontinental Exchange's careers page daily and removed when it closes. ## Intercontinental Exchange 45 open analyst roles on Real Analyst Jobs. [More roles at Intercontinental Exchange](https://realanalystjobs.com/companies/intercontinental-exchange) ## More like this ### Other open roles at Intercontinental Exchange - [Quantitative Business Analyst, Product Development](https://realanalystjobs.com/job/quantitative-business-analyst-product-development-intercontinental-exchange-c2948b8f), Atlanta Georgia, USA (On-site) - [Lead ServiceNow Developer](https://realanalystjobs.com/job/lead-servicenow-developer-intercontinental-exchange-24f98d36), Atlanta Georgia, USA (On-site) - [Trade Operations Analyst](https://realanalystjobs.com/job/trade-operations-analyst-intercontinental-exchange-f9445871), Atlanta Georgia, USA (On-site) - [Senior Analyst, Market Data Operations](https://realanalystjobs.com/job/senior-analyst-market-data-operations-intercontinental-exchange-f357d6b7), Atlanta Georgia, USA (On-site) - [AI and Data Product Manager](https://realanalystjobs.com/job/ai-and-data-product-manager-intercontinental-exchange-3567534f), Atlanta Georgia, USA (On-site) - [Data analyst jobs in India](https://realanalystjobs.com/jobs/data-analyst-jobs-in-india) - [Analyst job market report](https://realanalystjobs.com/analyst-job-market) - [What analyst roles pay](https://realanalystjobs.com/blog/data-analyst-salaries) ## Sources and links - [This role on Real Analyst Jobs](https://realanalystjobs.com/job/senior-qa-engineer-ai-intercontinental-exchange-7427cefd) - [Intercontinental Exchange on Real Analyst Jobs](https://realanalystjobs.com/companies/intercontinental-exchange) - [All analyst jobs](https://realanalystjobs.com/jobs)