# Senior AI Software Engineer Source: https://realanalystjobs.com/job/senior-ai-software-engineer-general-dynamics-information-technology-106c5547 Senior AI Software Engineer at General Dynamics Information Technology, an on-site role based in USA VA Sterling, USA. Posted on 2 November 2026, read from General Dynamics Information Technology's own careers page (Workday), which RealAnalystJobs re-checks daily and removes the role when it closes. The posting says the employer will not sponsor a visa for this role. General Dynamics Information Technology has approved H-1B petitions on USCIS record (employer-wide, not a promise for this role). Updated 15 November 2026. ## Key facts - Company: [General Dynamics Information Technology](https://realanalystjobs.com/companies/general-dynamics-information-technology) - Location: USA VA Sterling, USA - Work mode: On-site - Posted: Nov 2, 2026 - Employment type: Full time - Source: General Dynamics Information Technology's careers page (Workday), re-checked daily Skills: [SQL](https://realanalystjobs.com/skills/sql), [Python](https://realanalystjobs.com/skills/python) ## Visa sponsorship The posting says the employer will not sponsor a visa for this role. General Dynamics Information Technology had H-1B petitions approved for 18 workers in fiscal year 2026 (USCIS). That is history, not a promise for this role. [See the record](https://realanalystjobs.com/companies/general-dynamics-information-technology#h1b-record) ## About this role Type of Requisition: Pipeline Clearance Level Must Currently Possess: Secret Clearance Level Must Be Able to Obtain: Top Secret Public Trust/Other Required: None Job Family: Data Science and Data Engineering Job Qualifications: Skills: Agile Software Development, Back-End Development, Microservices Architecture Certifications: None Experience: 7 + years of related experience US Citizenship Required: Yes Job Description: GDIT is seeking a highly motivated and experienced Senior AI Software Engineer to support the development, modernization, integration, and sustainment of our on-premises, AI-powered enterprise chatbot platform supporting the U.S. Department of State in Sterling, VA. The selected candidate will design, develop, and integrate software solutions leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), vector databases, document processing technologies, and modern AI inference frameworks. This role requires a strong foundation in software engineering, Python development, API integration, containerization, and AI application architecture. The engineer will help transition existing AI services toward a scalable, containerized architecture while introducing new capabilities that enhance system performance, reliability, security, and user experience. The ideal candidate is a hands-on software engineer who can work across the AI application stack, from backend development and model serving integration to data processing, automated testing, and deployment. The individual will collaborate with AI/ML engineers, data engineers, infrastructure specialists, cybersecurity teams, and government stakeholders to deliver secure, reliable AI capabilities in highly controlled, classified, and air-gapped environments. Key Responsibilities 1. AI Application Development & Integration • Design, develop, test, and maintain Python-based applications, microservices, and APIs supporting an on prem chatbot. • Extend, configure, and integrate OpenWebUI with enterprise AI services and backend systems. • Develop custom OpenWebUI Functions, Tools, and integrations to support mission-specific use cases. • Integrate approved LLMs into chatbot using OpenAI-compatible APIs and inference frameworks such as vLLM and Ollama. • Develop reusable software components for AI model access, prompt management, response processing, and application workflows. • Collaborate with AI/ML engineers to improve model inference performance, response quality, and application reliability. • Support multimodal AI use cases, including document understanding, optical character recognition, and vision-language model integration. • Develop backend capabilities to support secure enterprise AI workflows. 2. Retrieval-Augmented Generation (RAG) & Document Processing • Design, implement, and optimize RAG workflows for enterprise document search and question answering. • Integrate document processing technologies such as Docling, Tesseract, and vision-language models into automated ingestion pipelines. • Develop document chunking, metadata extraction, embedding generation, and retrieval workflows. • Integrate embedding models and reranking models to improve retrieval accuracy and relevance. • Work with PostgreSQL and pgvector to support vector search, semantic retrieval, and document indexing. • Develop APIs and background processing services for document ingestion and knowledge base management. • Collaborate with data engineers to ensure accurate storage, indexing, and retrieval of enterprise information. • Implement testing and evaluation approaches to measure RAG accuracy, retrieval relevance, and answer quality. 3. AI Model Serving & Inference Integration • Integrate and maintain AI inference services using vLLM, Ollama, and compatible model-serving frameworks. • Support the deployment and configuration of approved open-weight LLMs, embedding models, rerankers, and vision-language models. • Develop software integrations using OpenAI-compatible REST APIs. • Assist in optimizing inference configurations, including context length, GPU memory utilization, concurrency, and model serving performance. • Support the transition from existing inference frameworks to improved architectures as technologies mature. • Collaborate with AI/ML engineers to troubleshoot inference errors, model loading issues, and integration failures. • Develop benchmarking and performance-testing utilities for AI workloads. 4. Containerization & Platform Modernization • Support the migration of DS Chat components from traditional deployments into containerized services. • Develop, configure, and maintain container images using Podman or Docker. • Create and maintain Podman Compose configurations defining application services, networking, volumes, and environment variables. • Integrate services such as OpenWebUI, vLLM, Docling, PostgreSQL, pgvector, PgBouncer, and Redis. • Develop scripts and automation for repeatable installation, deployment, upgrades, and recovery. • Implement health checks, readiness checks, logging, and service dependency management. • Troubleshoot container networking, authentication, storage, GPU access, and service connectivity. • Collaborate with infrastructure and cybersecurity teams to improve deployment consistency and security. 5. Agentic AI & Future Capabilities • Research, prototype, and develop agentic AI capabilities for future DS Chat releases. • Implement controlled tool-calling and multi-step AI workflows. • Develop integrations that allow approved AI models to interact with authorized enterprise APIs and services. • Explore emerging technologies involving AI orchestration, workflow automation, and Model Context Protocol (MCP). • Design secure execution boundaries, permissions, audit logging, and approval mechanisms for AI-driven actions. • Collaborate with stakeholders to evaluate new AI capabilities for mission relevance, security, and operational feasibility. • Implement safeguards Description from General Dynamics Information Technology's public careers feed, reproduced so you can read the role here. Apply on the company's own site; Real Analyst Jobs never submits anything for you. ## How to apply Open [this role on Real Analyst Jobs](https://realanalystjobs.com/job/senior-ai-software-engineer-general-dynamics-information-technology-106c5547) and use Apply now there to reach the employer's application. The listing is re-checked against General Dynamics Information Technology's careers page daily and removed when it closes. ## General Dynamics Information Technology 36 open analyst roles on Real Analyst Jobs. [More roles at General Dynamics Information Technology](https://realanalystjobs.com/companies/general-dynamics-information-technology) ## More like this ### Other open roles at General Dynamics Information Technology - [Sr Program Analyst](https://realanalystjobs.com/job/sr-program-analyst-general-dynamics-information-technology-6acebbb8), Remote - [Sr Program Analyst](https://realanalystjobs.com/job/sr-program-analyst-general-dynamics-information-technology-fdafe217), Remote - [Information Security Analyst Senior](https://realanalystjobs.com/job/information-security-analyst-senior-general-dynamics-information-technology-a1251747), USA Florida Tyndall Afb, USA (On-site) - [Senior Principal Intelligence Analyst](https://realanalystjobs.com/job/senior-principal-intelligence-analyst-general-dynamics-information-technology-e068db94), USA Virginia Arlington, USA (On-site) - [Senior Principal Intelligence Analyst](https://realanalystjobs.com/job/senior-principal-intelligence-analyst-general-dynamics-information-technology-f95e1fe2), USA Virginia Arlington, USA (On-site) - [Data analyst jobs in the USA](https://realanalystjobs.com/jobs/data-analyst-jobs-in-usa) - [Analyst job market report](https://realanalystjobs.com/analyst-job-market) - [What analyst roles pay](https://realanalystjobs.com/blog/data-analyst-salaries) ## Sources and links - [This role on Real Analyst Jobs](https://realanalystjobs.com/job/senior-ai-software-engineer-general-dynamics-information-technology-106c5547) - [General Dynamics Information Technology on Real Analyst Jobs](https://realanalystjobs.com/companies/general-dynamics-information-technology) - [All analyst jobs](https://realanalystjobs.com/jobs)