Senior Computer Vision QA Automation Engineer (Evaluation & Testing)

Company Overview

At Motorola Solutions, we believe that everything starts with our people. We’re a global close-knit community, united by the relentless pursuit to help keep people safer everywhere. We build and connect technologies to help protect people, property and places. Our solutions foster the collaboration that’s critical for safer communities, safer schools, safer hospitals, safer businesses, and ultimately, safer nations. Connect with a career that matters, and help us build a safer future.

Department Overview

At Motorola Solutions, we're guided by a shared purpose - helping people be their best in the moments that matter and we live up to our purpose every day by solving for safety. Because people can only be their best when they not only feel safe, but are safe. We're solving for safer by building the best possible technologies across every part of our safety and security ecosystem. That's mission-critical communications devices and networks, AI-powered video security & access control and the ability to unite voice, video and data in a single command center view. We're solving for safer by connecting public safety agencies and enterprises, enabling the collaboration that's critical to connect those in need with those who can help. The work we do here matters. The Specialty Cameras Engineering team is responsible for developing cameras for special applications, such as AI cameras for traffic management and surveillance. The products are aimed at public and commercial safety. The team is responsible for the development of the firmware, taking care of the entire development life cycle, from development to testing and maintenance of the systems we build.

Job Description

We are looking for a driven Senior AI/CV QA Automation Engineer to take ownership of our automated evaluation and testing framework for our core Video Analytics Engine. In this role, you will design automated evaluation infrastructure, benchmark Computer Vision model performance, and optimize end-to-end testing execution time down to just a few minutes per cycle. You will collaborate closely with R&D, Platform, and System Architecture teams to ensure high stability and continuous release quality. ​

Key Responsibilities

Infrastructure & Optimization: Build, maintain, and optimize automated evaluation pipelines for AI/CV models and core video analytics libraries to achieve rapid, end-to-end test execution times.

Automation & CI/CD Integration: Develop Python automation test suites and integrate evaluation workflows directly into CI/CD pipelines for automated testing on Pull Requests (PRs).

Metrics & Analytics: Measure and report model accuracy metrics (mAP, Precision, Recall, IoU) and system performance metrics (FPS, Latency, CPU/GPU/Memory utilization).

Dataset Management: Manage, curate, and maintain golden datasets and annotation standards for regression, performance, and stress testing.

Cross-functional Collaboration: Work with Core C++ and Architecture teams to identify pipeline bottlenecks, isolate root causes, and drive continuous release pipeline improvements.

#LI-MM8

#LI-Onsite

Basic Requirements

Bachelor/Master Degree in Software Engineering, Computer Science, Machine Learning or any relevant Field

3+ years of experience in QA Automation, MLOps, Software Engineer in Test (SET), or AI/CV Evaluation.

Strong proficiency in Python for test framework development and data processing.

Hands-on experience with Docker containerization and CI/CD tools (Jenkins, GitLab CI, GitHub Actions).

Solid understanding of Machine Learning and Computer Vision evaluation metrics.

Proficient in Linux environments and Bash/Shell scripting.

Strong problem-solving skills with a focus on performance and execution speed.

Nice to Have

Ability to read and understand basic C/C++ code.

Familiarity with video streaming concepts and processing frameworks (e.g., GStreamer).

Prior experience with Edge AI, Smart Cameras, or Embedded Vision systems.

Travel Requirements

None

Relocation Provided

None

Position Type

Experienced

Referral Payment Plan

Yes

EEO Statement

Motorola Solutions is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion or belief, sex, sexual orientation, gender identity, national origin, disability, veteran status or any other legally-protected characteristic.

We are proud of our people-first and community-focused culture, empowering every Motorolan to be their most authentic self and to do their best work to deliver on the promise of a safer world. If you’d like to join our team but feel that you don’t quite meet all of the preferred skills, we’d still love to hear why you think you’d be a great addition to our team.