Software Development · Tel Aviv, Israel

Full-time

Senior Backend Engineer - AI Framework (Python)

Gong.io · Tel Aviv, Israel · Posted Jun 29, 2026

This posting comes from Gong.io. Confirm the details on their site before applying.

Overview

As a Senior Backend Engineer on Gong’s AI Framework team, you will build the foundational platform that enables the entire organization to design, evaluate, deploy, and operate AI agents at scale. This is a new, high-impact team responsible for creating the frameworks, tools, and guardrails that power Gong’s agentic ecosystem. You’ll work deeply in the agentic space, designing systems for orchestration, evaluation, observability, and safety.

Responsibilities

  • Agentic Framework Architecture: Designing and building Gong’s internal agentic framework, leveraging and integrating industry-standard tools such as LangChain, LangSmith, ADK, and similar ecosystems.
  • Evaluation and Quality Systems: Building evaluation frameworks and workflows for AI agents, including offline and online evaluations, quality metrics, regression detection, and experimentation infrastructure.
  • Observability, Monitoring, and Guardrails: Providing the organization with robust observability capabilities for AI agents, including tracing, logging, monitoring, cost tracking, and safety guardrails to ensure reliable and responsible usage.
  • Developer Enablement Platforms: Creating APIs, SDKs, and abstractions that enable product teams to easily build, test, and operate agents while adhering to platform standards.
  • Cross-Language Integrations: Designing integrations and tooling across Python and Java to enable seamless adoption of the AI framework within Gong’s broader backend ecosystem.
  • Agent Runtime and Execution Engine: Building the runtime responsible for orchestrating agent execution, managing tool calls, maintaining state and memory, and ensuring reliable execution across distributed systems.
  • Agent Lifecycle and Orchestration Complexity: Managing agent execution, tool usage, memory, workflows, and failure modes in production-grade systems.
  • AI System Reliability at Scale: Ensuring agents remain observable, debuggable, and safe as usage scales across teams and products.
  • Evaluation and Drift Challenges: Detecting quality regressions, model behavior changes, and unintended agent behaviors through robust evaluation and monitoring systems.
  • Platform Adoption Friction: Balancing flexibility with guardrails so teams can innovate quickly without compromising reliability, security, or cost controls.
  • Company-Wide AI Enablement: Empowering every engineering team at Gong to build agent-based solutions faster, with higher quality and confidence.
  • Foundational AI Infrastructure: Establishing the core frameworks, evaluations, and observability standards that all AI agents at Gong will rely on.
  • AI Safety and Quality Bar: Raising the bar for how AI systems are evaluated, monitored, and governed across the company.
  • 7+ years of backend engineering experience, with strong system design and platform-building expertise.
  • Strong analytical and problem-solving skills, with the ability to debug and resolve complex technical issues efficiently.

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.