# AI Engineer (Managed Services) Source: https://realanalystjobs.com/job/ai-engineer-managed-services-avepoint-cab4968d AI Engineer (Managed Services) at AvePoint, based in Singapore. Experience level: 2+ Years. Posted on 26 June 2026, read from AvePoint's own careers page (Greenhouse), which RealAnalystJobs re-checks daily and removes the role when it closes. Updated 15 November 2026. ## Key facts - Company: [AvePoint](https://realanalystjobs.com/companies/avepoint) - Location: Singapore - Posted: Jun 26, 2026 - Employment type: Full time - Experience level: 2+ Years - Source: AvePoint's careers page (Greenhouse), re-checked daily Skills: [Python](https://realanalystjobs.com/skills/python) ## Visa sponsorship The posting does not say. AvePoint had H-1B petitions approved for 1 worker in fiscal year 2026 (USCIS). That is history, not a promise for this role. [See the record](https://realanalystjobs.com/companies/avepoint#h1b-record) ## About this role We are looking for a highly skilled AI Engineer specializing in Large Language Models (LLMs) and Agentic AI. You will architect, build, and deploy production-grade LLM applications - from intelligent knowledge bases and RAG systems to autonomous multi-agent workflows. You will work hands-on with open-source Chinese and international LLMs (DeepSeek, Qwen, Kimi, etc), implementing everything from model deployment and inference optimization to prompt engineering and agent orchestration. This is a builder role for someone who thrives at the intersection of research and engineering. KEY RESPONSIBILITIES LLM Application Development • Design and develop enterprise LLM-powered applications: intelligent Q&A systems, enterprise knowledge base assistants, AI copilots, document analysis tools, and automated customer service agents. • Architect and implement end-to-end RAG (Retrieval-Augmented Generation) systems: document parsing and chunking (recursive, semantic, agentic), embedding generation (BGE, M3E, GTE), vector retrieval (dense + sparse hybrid search), reranking (bge-reranker, Cohere Rerank), and response synthesis with source attribution. • Develop and optimize Prompt Engineering strategies: chain-of-thought, tree-of-thought, few-shot prompting, structured output parsing (JSON mode / Pydantic), prompt templates (LangChain/LangSmith), and prompt version management. • Knowledge in harness engineering, context management in ensuring LLM interactions and or AI agents reliable and deterministic. AI Agent & Multi-Agent Systems • Design and build AI Agent systems using ReAct, Plan-and-Execute, Reflection, and multi-agent collaboration patterns. • Implement Function Calling and tool-use capabilities, enabling agents to interact with external APIs, databases, and enterprise systems. • Develop multi-agent orchestration using LangGraph, AutoGen, CrewAI, and other agent frameworks to solve complex enterprise tasks through agent collaboration. • Design MCP (Model Context Protocol) integrations for standardized LLM tool interoperability. Open-Source LLM Deployment & Optimization • Deploy and optimize latest version of open-source Chinese LLMs: DeepSeek, Qwen, and Kimi for on-premise and private cloud environments. • Implement model inference optimization: quantization (GGUF/llama.cpp, GPTQ, AWQ, AutoAWQ, FP8/INT8), KV Cache optimization, continuous batching (vLLM, TensorRT-LLM, TGI, SGLang), speculative decoding, and tensor parallelism for high-throughput serving. • Build and maintain model serving infrastructure using vLLM, TensorRT-LLM, Text Generation Inference (TGI), Ollama, Xinference, and SGLang; configure GPU resource scheduling with Kubernetes + GPU operators. AI gateway tools for routing, model tracking and load balancing such as TrueFoundry, Kubeflow, LiteLLM or Ray for heavy deep learning. Model Fine-Tuning & Customization • Implement efficient fine-tuning pipelines using LoRA, QLoRA, DoRA, and full-parameter fine-tuning on proprietary domain-specific datasets. • Prepare and curate instruction-following datasets, RLHF/RLAIF datasets, and evaluation benchmarks for domain adaptation. • Evaluate fine-tuned models using automated benchmarks and LLM-as-a-Judge methodologies. Evaluation & Production Operations • Build and maintain LLM evaluation frameworks: LLM-as-a-Judge, RAGAS, DeepEval, ARES, and custom task-specific metrics for continuous quality monitoring. • Implement production monitoring for LLM systems: output quality tracking, latency/throughput metrics, cost monitoring, drift detection, and guardrail compliance. • Design A/B testing frameworks for model comparison and prompt iteration. • Implement LLM security guardrails: input/output filtering, PII detection, prompt injection defense, content moderation, and safety alignment. Research & Technical Leadership • Track frontier AI research and evaluate emerging technologies (new model architectures, training techniques, inference methods) for enterprise adoption. • Contribute to internal knowledge sharing: tech talks, documentation, and best-practice guides on LLM development. REQUIRED QUALIFICATIONS • Bachelor's degree or above in Computer Science, Artificial Intelligence, Machine Learning, or related technical field. Master's or PhD in AI/ML preferred. • 2+ years of professional experience in AI/ML engineering with demonstrated production deployment of LLM-based systems at scale. • Deep understanding of Transformer architecture, attention mechanisms (MHA, GQA, MQA), and LLM pre-training / fine-tuning / inference paradigms. • Expert proficiency in LLM application frameworks: LangChain, LlamaIndex, Haystack, or equivalent production-grade tools. • Hands-on experience with RAG system development: vector databases (Milvus, ChromaDB, Qdrant, Weaviate, Pinecone, pgvector), embedding models (BGE, M3E, GTE, OpenAI, Cohere), reranking (bge-reranker, Cohere Rerank, cross-encoders), and advanced retrieval techniques (hybrid search, query expansion, HyDE). • Practical experience deploying and tuning open-source Chinese LLMs: DeepSeek, Qwen, Kimi , or international models (Llama 3.x, Mistral, Mixtral, Gemma, Phi). • Strong experience with model deployment and serving infrastructure: vLLM, TensorRT-LLM, TGI, Ollama, Xinference, SGLang; GPU resource scheduling (Kubernetes + GPU operators). • Proficiency in model quantization and inference optimization: GGUF (llama.cpp), GPTQ, AWQ, AutoAWQ, FP8/INT8; knowledge of KV Cache optimization and memory-efficient attention (FlashAttention, FlashInfer, PageAttention). • Solid programming skills in Python; experience with PyTorch, TensorFlow, or JAX; familiarity with FastAPI/Flask for building LLM API services. • Experience with LLM evaluation methodologies, A/B testing frameworks, and production monitoring of AI systems. PREFERRED QUALIFICATIONS • Experience with agent frameworks: LangGraph, AutoGen, CrewAI, OpenAI Assistants API, and multi-agent orchestration patterns. • Fa Description from AvePoint's public careers feed, reproduced so you can read the role here. Apply on the company's own site; Real Analyst Jobs never submits anything for you. ## How to apply Open [this role on Real Analyst Jobs](https://realanalystjobs.com/job/ai-engineer-managed-services-avepoint-cab4968d) and use Apply now there to reach the employer's application. The listing is re-checked against AvePoint's careers page daily and removed when it closes. ## AvePoint 31 open analyst roles on Real Analyst Jobs. [More roles at AvePoint](https://realanalystjobs.com/companies/avepoint) ## More like this ### Other open roles at AvePoint - [Business Analyst (Managed Services)](https://realanalystjobs.com/job/business-analyst-managed-services-avepoint-bfd7e8f3), Singapore - [Channel Analyst](https://realanalystjobs.com/job/data-analyst-avepoint-c6b332b8), London, UK (On-site) - [Business Analyst](https://realanalystjobs.com/job/business-analyst-avepoint-ae43a8cf), Singapore - [Business Analyst (With OutSystems Experience)](https://realanalystjobs.com/job/business-analyst-with-outsystems-experience-avepoint-96f415cb), Kuala Lumpur Kuala Lumpur, Malaysia - [Senior Business Analyst](https://realanalystjobs.com/job/senior-business-analyst-avepoint-19b5d39b), Singapore - [Data analyst jobs in Singapore](https://realanalystjobs.com/jobs/data-analyst-jobs-in-singapore) - [Analyst job market report](https://realanalystjobs.com/analyst-job-market) - [What analyst roles pay](https://realanalystjobs.com/blog/data-analyst-salaries) ## Sources and links - [This role on Real Analyst Jobs](https://realanalystjobs.com/job/ai-engineer-managed-services-avepoint-cab4968d) - [AvePoint on Real Analyst Jobs](https://realanalystjobs.com/companies/avepoint) - [All analyst jobs](https://realanalystjobs.com/jobs)