Software Development · United States

Full-time

Senior AI Software Engineer

General Dynamics Information Technology · United States · Posted Nov 2, 2026

This posting comes from General Dynamics Information Technology. Confirm the details on their site before applying.

Overview

GDIT is seeking a highly motivated and experienced Senior AI Software Engineer to support the development, modernization, integration, and sustainment of our on-premises, AI-powered enterprise chatbot platform supporting the U.S. Department of State in Sterling, VA. The selected candidate will design, develop, and integrate software solutions leveraging Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), vector databases, document processing technologies, and modern AI inference frameworks.

Responsibilities

  • Design, develop, test, and maintain Python-based applications, microservices, and APIs supporting an on prem chatbot.
  • Extend, configure, and integrate OpenWebUI with enterprise AI services and backend systems.
  • Develop custom OpenWebUI Functions, Tools, and integrations to support mission-specific use cases.
  • Integrate approved LLMs into chatbot using OpenAI-compatible APIs and inference frameworks such as vLLM and Ollama.
  • Develop reusable software components for AI model access, prompt management, response processing, and application workflows.
  • Collaborate with AI/ML engineers to improve model inference performance, response quality, and application reliability.
  • Support multimodal AI use cases, including document understanding, optical character recognition, and vision-language model integration.
  • Develop backend capabilities to support secure enterprise AI workflows.
  • Design, implement, and optimize RAG workflows for enterprise document search and question answering.
  • Integrate document processing technologies such as Docling, Tesseract, and vision-language models into automated ingestion pipelines.
  • Develop document chunking, metadata extraction, embedding generation, and retrieval workflows.
  • Integrate embedding models and reranking models to improve retrieval accuracy and relevance.
  • Work with PostgreSQL and pgvector to support vector search, semantic retrieval, and document indexing.
  • Develop APIs and background processing services for document ingestion and knowledge base management.
  • Collaborate with data engineers to ensure accurate storage, indexing, and retrieval of enterprise information.

Requirements

  • Research, prototype, and develop agentic AI capabilities for future DS Chat releases.
  • Implement controlled tool-calling and multi-step AI workflows.
  • Develop integrations that allow approved AI models to interact with authorized enterprise APIs and services.
  • Explore emerging technologies involving AI orchestration, workflow automation, and Model Context Protocol (MCP).
  • Design secure execution boundaries, permissions, audit logging, and approval mechanisms for AI-driven actions.
  • Collaborate with stakeholders to evaluate new AI capabilities for mission relevance, security, and operational feasibility.
  • Implement safeguards to support human oversight and prevent unauthorized actions by AI-enabled systems.
  • Apply software engineering best practices, including modular architecture, code reviews, documentation, and version control.
  • Develop automated unit, integration, regression, and performance tests using frameworks such as pytest.
  • Build integration tests validating communication between OpenWebUI, inference services, document processing components, and databases.
  • Support CI/CD processes appropriate for disconnected and classified environments.
  • Troubleshoot production issues through application logs, metrics, traces, and system diagnostics.
  • Integrate operational logging and monitoring capabilities with tools such as Splunk.
  • Assist with vulnerability remediation, dependency management, software supply chain reviews, and container security assessments.
  • Produce technical documentation, deployment procedures, architecture diagrams, and operational runbooks.

Preferred qualifications

  • Experience with OpenWebUI, including configuration, integration, custom Functions, Tools, or application extensions.
  • Hands-on experience with vLLM, Ollama, Hugging Face Transformers, or other LLM inference technologies.
  • Experience serving or integrating open-weight LLMs in on-premises environments.
  • Experience with NVIDIA GPUs, CUDA, GPU memory management, and AI inference optimization.
  • Experience with PostgreSQL pgvector, vector similarity search, and semantic retrieval.
  • Familiarity with embedding models, rerankers, and cross-encoder architectures.
  • Experience with Docling, Tesseract, or document intelligence technologies.
  • Experience implementing production RAG pipelines and evaluation frameworks.
  • Familiarity with agentic AI frameworks, tool calling, and Model Context Protocol (MCP).
  • Experience developing or maintaining containerized microservice architectures.

Benefits

  • Our benefits package for all US-based employees includes a variety of medical plan options, some with Health Savings Accounts, dental plan options, a vision plan, and a 401(k) plan offering the ability to contribute both pre and post-tax dollars up to the IRS annual limits and receive a company…
  • To encourage work/life balance, GDIT offers employees full flex work weeks where possible and a variety of paid time off plans, including vacation, sick and personal time, holidays, paid parental, military, bereavement and jury duty leave.
  • To ensure our employees are able to protect their income, other offerings such as short and long-term disability benefits, life, accidental death and dismemberment, personal accident, critical illness and business travel and accident insurance are provided or available.
  • We regularly review our Total Rewards package to ensure our offerings are competitive and reflect what our employees have told us they value most.
  • As part of the hiring process, we will ask you to complete an identity verification process that leverages advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud.
  • You are expected to be on camera during virtual interviews.
  • We reserve the right to take your picture to verify your identity and prevent fraud.
  • By proceeding, you authorize the collection, processing, and use of your biometric data for identity verification and security purposes.

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.