Software Development · Waterloo, Canada

Senior Software Development Engineer in Test, ML

PlayStation Global · Waterloo, Canada · Posted Nov 3, 2026

This posting comes from PlayStation Global. Confirm the details on their site before applying.

Overview

At PlayStation, we're passionate about both partnership and technology. We care about building performant products and powerful tools, solving practical problems in delightful ways. We love building the systems that millions of people use, and we're always our own first customers and critics. We strive to be at the forefront of development technologies and celebrate our diversity with engineering teams located on four continents from all walks of life.

Responsibilities

  • Drive architecture-level automation solutions and scalable quality engineering practices across multiple teams and product areas.
  • Design, develop, and maintain automated test frameworks, test scripts for ML inference services and related ML platform components using python/Java
  • Build and automate realistic, representative test account creations and datasets to evaluate model behavior across different scenarios
  • Validate score distributions, ranking behavior, output quality, and other model signals for incoming ML models prior to release
  • Perform different types of testing, including functional, integration, regression and API testing working with RESTful APIs, microservices and databases, and non-functional performance and load testing to verify inference service scalability, latency requirements and reliability under production…
  • Work closely with ML engineers and ops teams to ensure that all features and bug fixes come with automated test coverage, ensuring continuous integration and deployment
  • Debug and analyze test failures, model anomalies and report defects
  • Drive high standards of quality for both engineering decisions and customer-facing features with optimal test and automation strategy
  • Develop and implement best practices for test automation that is highly scalable and maintainable
  • Monitor test execution and optimize performance in test environments
  • Come up with innovative solutions to organizational problems

Requirements

  • A Bachelor's degree in Computer Science or related field
  • Minimum 5 years of experience as an SDET, with strong experience testing backend systems.
  • Proficiency in Python/Java/Scala/go for test automation.
  • Hands-on experience with API testing tools (e.g., Postman or similar) for distributed systems
  • Familiarity with CI/CD pipelines and test execution in Jenkins or similar environments such as jenkins, GitHub Actions, ArgoCD, etc
  • Hands-on experience building and maintaining automated test frameworks (e.g., pytest, JUnit, TestNG, etc.)Experience in working with databases for backend validation.
  • Experience with cloud and container technologies (AWS, GCP, Kubernetes, Docker, etc.)
  • Familiarity with monitoring and observability tools (e.g., Prometheus, Grafana, Datadog, etc.) for validating service health
  • Strong understanding of software development lifecycle (SDLC) and agile methodologies.
  • Excellent problem-solving skills and excellent communication skills.

Preferred qualifications

  • Experience testing machine learning systems, such as recommendation systems, search ranking systems, or other probabilistic ML application systems.
  • Experience creating synthetic or seeded test data to simulate realistic customer/account behaviors.
  • Experience evaluating model outputs using statistical techniques, distribution analysis, or scenario-based validation, rather than deterministic assertions.
  • Knowledge of data pipelines, feature stores, inference systems or model-serving infrastructure (Seldon, KServe, Ray Serve, etc.) is a plus.
  • Experience with performance and load testing tools
  • Experience with Databricks or similar ML platform tooling
  • Experience architecting and optimizing CI/CD pipelines, quality gates, and release validation systems using Jenkins or similar platforms.

Benefits

  • Parental leave

Great fits start here.

Whether you're looking for your next role or your next team member, give people and possibilities a place to meet.