Senior Quality Engineer (ai/ml) – Supply Chain Technology

About the Role:

We are seeking a Senior Quality Engineer (AI/ML) to join our fast-paced, agile Supply Chain Technology team. This role is a specialized AI/ML Quality Engineering role, requiring a deep understanding of AI/ML lifecycle, model training, fine-tuning, and validation. The ideal candidate should have expertise in computer vision, model evaluation, and AI-driven quality assurance for warehouse operations and product compliance.

Key Responsibilities:

AI/ML Quality Engineering:

• Collaborate with Data Scientists, ML Engineers, and DevOps teams to validate and fine-tune AI/ML models such as computer vision-based etc. in Warehouse Management & Execution Systems.
• Design and execute AI/ML testing strategies to assess model performance, accuracy, bias, and fairness across different datasets and scenarios.
• Develop automated validation pipelines for AI/ML models, ensuring robustness in real-world warehouse environments.
• Evaluate deep learning models for image-based quality inspection, vendor compliance, and operational efficiency improvements.
• Identify edge cases, dataset limitations, and adversarial scenarios that may impact model reliability and warehouse operations.

Test Automation & Performance Validation:

• Develop and maintain test automation frameworks using Python (Pytest), Playwright (JavaScript), while supporting legacy frameworks in Java (Selenium, TestNG).
• Design and implement performance/load testing strategies using K6 to benchmark AI/ML-driven solutions.
• Automate AI/ML validation workflows within CI/CD pipelines using GitHub Actions, GitLab Pipelines, and Terraform.
• Integrate API testing using Postman, Newman, and RESTful service validation.
• Utilize Temporal workflows where applicable to enhance AI/ML-driven automation.

Infrastructure, Cloud, and DevOps Integration:

• Work with AWS cloud services to optimize AI/ML models for scalability and deployment.
• Provision and maintain test environments using Terraform and Bash scripting.
• Collaborate with DevOps to ensure seamless deployment, monitoring, and observability of AI/ML pipelines.

Cross-functional Collaboration & Agile Execution:

• Work closely with Product Managers, AI/ML Engineers, and Supply Chain Experts to define and improve AI-driven solutions.
• Participate in Agile sprints, ensuring AI/ML quality assurance is embedded in the development lifecycle.
• Conduct root cause analysis and contribute to continuous improvement of AI/ML quality processes.
• Mentor junior engineers and champion best practices in AI/ML testing and automation.

Qualifications & Skills:

• 6+ years of experience in Quality Engineering, with at least 3+ years focusing on AI/ML model validation and testing.
• Strong understanding of AI/ML concepts, including model training, fine-tuning, evaluation metrics (precision, recall, F1-score, etc.), and bias detection.
• Hands-on experience with computer vision models (TensorFlow, PyTorch, OpenCV, etc.) and ML validation techniques.
• Proficiency in Golang, Python/JavaScript for AI/ML test automation.
• Experience with performance/load testing using K6 and API testing with Postman/Newman.
• Strong AWS cloud knowledge, including AI/ML service deployment, monitoring, and scalability.
• Proficiency in infrastructure automation using Terraform, Bash scripting, GitHub Actions, or GitLab Pipelines.
• Knowledge of Temporal workflows and their role in AI-driven automation.
• Excellent problem-solving skills, ability to work in a fast-paced agile environment, and strong collaboration with cross-functional teams.

Fanatics Commerce is a leading designer, manufacturer, and seller of licensed fan gear, jerseys, lifestyle and streetwear products, headwear, and hardgoods. It operates a vertically-integrated platform of digital and physical capabilities for leading sports leagues, teams, colleges, and associations globally – as well as its flagship site, www.fanatics.com.

Fanatics Commerce has a broad range of online, sports venue, and vertical apparel partnerships worldwide, including comprehensive partnerships with leading leagues, teams, colleges, and sports organizations across the world—including the NFL, NBA, MLB, NHL, MLS, Formula 1, and Australian Football League (AFL); the Dallas Cowboys, Golden State Warriors, Paris Saint-Germain, Manchester United, Chelsea FC, and Tokyo Giants; the University of Notre Dame, University of Alabama, and University of Texas; the International Olympic Committee (IOC), England Rugby, and the Union of European Football Associations (UEFA).

At Fanatics Commerce, we infuse our BOLD Leadership Principles in everything we do:
· Build Championship Teams
· Obsessed with Fans
· Limitless Entrepreneurial Spirit
· Determined and Relentless Mindset