Software Development · Bengaluru, India

Hybrid Full-time

Senior Software Engineer

Epsilon · Bengaluru, India · Posted Nov 9, 2026

This posting comes from Epsilon. Confirm the details on their site before applying.

Overview

We are looking for a Senior AI Engineer to join our AI Center of Excellence team at Epsilon, working at the heart of enterprise-grade Conversational, Agentic, and AI Platforms and applications. This role is for someone who brings a strong software engineering backbone, a data oriented mindset, and deep hands-on expertise in Generative AI, RAG, and Agentic AI systems and is ready to help shape the future of intelligent, enterprise systems at scale.

Responsibilities

  • Design, develop, and ship production-grade AI applications - including conversational Assistants, RAG pipelines, and multi-agent systems.
  • Architect scalable, secure, and cost-efficient backend services using Python, Node.js, and cloud-native patterns (AWS / Azure/ GCP).
  • Build and maintain API services (RESTful, streaming) that integrate AI capabilities with enterprise systems.
  • Write clean, testable, well-documented code with CI/CD standards; champion engineering rigor in an AI-first team.
  • Build and optimize LLM-powered features - including prompt engineering, structured output design, tool/function calling, and context management (multi-turn conversations, session handling).
  • Design and implement evaluation frameworks (groundedness scoring, regression testing, quality benchmarking) for AI outputs - ensuring trust, accuracy, and continuous improvement.
  • Stay hands-on with LLM APIs (Azure OpenAI, AWS Bedrock, Anthropic, open-source models) and make informed decisions on model selection, cost-latency tradeoffs, and fine-tuning vs. prompting strategies.
  • Design and build enterprise RAG pipelines - including embedding selection, chunking strategies, metadata enrichment, hybrid retrieval, re-ranking, and citation/traceability.
  • Integrate and manage vector databases for scalable knowledge retrieval across heterogeneous enterprise data sources.
  • Continuously improve retrieval quality by building golden test sets, measuring relevance, and implementing feedback loops.
  • Work with Multimodal retrieval based on unstructured content.
  • Design and implement agentic workflows - autonomous and semi-autonomous AI agents that can reason, plan, use tools, and implement multi-step business workflows with human-in-the-loop checkpoints.
  • Build multi-agent orchestration frameworks using tools like AWS Bedrock, Agentcore, Cursor and other innovative open-source frameworks - enabling collaborative agent systems for complex enterprise scenarios.
  • Develop reusable tool integrations that agents can invoke autonomously, with proper guardrails and safety controls.
  • Work with structured and unstructured enterprise data - cleaning, transforming, and preparing data for AI consumption.

Requirements

  • Experience: 5-8+ years in software engineering, with at least 2+ years hands-on in Generative AI / LLM-based systems
  • Software Engineering: Strong proficiency in Python; experience with backend frameworks (FastAPI, Flask, Express/Node.js); clean API design, version control (Git), testing, and CI/CD
  • Generative AI: Hands-on experience with LLM APIs (Azure OpenAI, AWS Bedrock, Anthropic, Google Gemini); prompt engineering, structured outputs, tool/function calling
  • RAG: Proven experience building RAG pipelines - embedding models, chunking, retrieval logic, vector database, re-ranking, and grounding
  • Agentic AI: Experience designing agent-based architectures - tool use, planning, multi-step workflows; familiarity with AWS Bedrock, Azure AI Foundry, or equivalent frameworks
  • Data Fundamentals: Solid understanding of data wrangling, SQL, EDA, and basic ML concepts; ability to work with structured/unstructured data at scale
  • DataBricks: Designs, builds, and manages scalable data pipelines and AI solutions within the Databricks Lakehouse Platform.
  • Cloud: Experience with AWS or Azure - deploying containerized services, serverless functions, and working with cloud AI/ML services
  • System Design: Ability to design distributed, scalable AI systems with clear tradeoffs on cost, latency, and reliability
  • Multi-Agent Systems & A2A Protocols - experience with agent-to-agent communication patterns, Model Context Protocol (MCP), or similar emerging standards.
  • Fine-Tuning & Model Adaptation - experience fine-tuning LLMs or adapter-based methods (LoRA, QLoRA) for domain-specific use cases.
  • AI Evaluation & Benchmarking - experience building evaluation harnesses, automated grading, and regression testing for LLM outputs.
  • Microsoft Ecosystem - familiarity with M365 Copilot, Copilot Studio, Bot Framework, Teams integrations, Adaptive Cards.
  • Observability & Tracing - experience with AI-specific observability for debugging and monitoring AI systems in production.
  • NLP & Classical ML - deeper grounding in NLP (named entity recognition, text classification, sentiment analysis) and classical ML (scikit-learn, XGBoost).

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.