Training & Quality Manager

 Location: Remote in North America

Who we are:

Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are the AI technology solutions provider-of-choice to 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine.

By combining advanced machine learning and artificial intelligence (ML/AI) technologies, a global workforce of subject matter experts, and a high-security infrastructure, we’re helping usher in the promise of clean and optimized digital data to all industries. Innodata offers a powerful combination of both digital data solutions and easy-to-use, high-quality platforms.

Our global workforce includes over 3,000 employees in the United States, Canada, United Kingdom, the Philippines, India, Sri Lanka, Israel and Germany. We’re poised for a period of explosive growth over the next few years.

About the Role 

At Innodata, we’re working with the world’s largest technology companies on the next generation of AI and large language models (LLMs). We’re looking for smart, savvy, and curious Quality Assurance experts to join our team. 

As a Program Manager (PgM) for Training and Quality Control, you will inspect and validate deliverables before they are sent to our customers. You will build a team of QA leaders across languages who drive continuous improvement and best practices. 

You’ll work hands-on at the leading edge of natural language understanding, computer vision, and human/AI-in-the-loop workflows. You’ll work cross-functionally to engage with program and project managers, training & quality leads, and language specialists to deliver high quality data services across multiple languages and workstreams. As a subject matter expert in data annotation/labeling, localization, and human in the loop workstreams, you’ll drive continuous improvement in processes and KPIs. You’ll collaborate cross-functionally to develop AI that augments and automates workflows, in turn increasing efficiency and reducing costs for our customers. The ideal candidate is an extraordinarily skilled professional who is adept at staying close to the details without losing sight of the big picture.

Key Responsibilities 

Are you passionate about ensuring data is accurate, comprehensive, and usable? If so, this is the position for you. 

In this position, you’ll be a leader on the team. You’ll train and support multiple QA/training leads and language/labeling specialists. As a steward of data excellence and quality audit compliance, you’ll handle quality assurance and provide performance feedback to the team. You’ll be responsible for every aspect of internal audit quality, from audit planning, implementation, and feedback to re-auditing as required. 

You will be an integral member of a global team, tasked with shaping a high-quality, user-centric AI knowledge model that will be the foundation for an entire next generation of technology user experiences. 

Below are some responsibilities and tasks of the role: 

• Own quality for multiple projects in various domains across multiple data types (e.g. text, image, video, speech or multimodal data). 

• Architect solutions to problems and drive success at the level of individual tasks (or workers) and the program (or team). 

• Skill in conducting highly detailed qualitative and quantitative analyses, summarizing, and communicating results and insights to different stakeholders/functional roles.  

• Design and implement best practices to monitor auditor performance and create metrics/analytics to identify areas for improvement and ensure adherence to quality requirements.  

• Understand different approaches to quality and the tradeoffs between them; Apply experience and skill in using the right metrics to drive alignment and consistency in human evaluation tasks. 

• Help hire, coach, and develop leaders on the team to achieve their best results. 

• Develop and administer training programs to ensure Quality Control auditors are set up for success. 

• Collaborate closely with colleagues and the Program Manager to drive success across all tasks and languages. 

• Review project guidelines to ensure alignment between client expectations and team performance/outputs. 

• Lead the development of training programs that are comprehensive, relevant, and aligned with the latest industry standards and best practices; regularly review and update training content to ensure it remains current and effective. 

• Provide actionable and clear feedback 1:1 or to the team, as needed. 

• Oversee the lifecycle of an internal audit, from planning, implementation, and feedback to re-auditing as required; driving all audits in the required timeframe and providing feedback to teammates, as needed. 

• Explore and implement ways to automate quality control/improvement and reporting. 

• Ensure achievement of performance metrics; directing Root Cause Analyses documentation for any potential quality and audit deficiencies that resulted in missed KPIs; report on inefficiencies and error trends in process/systems/tools/policy. 

• Synthesize data, discover trends in accuracy, and translate quality assurance recommendations to the team. 

• Move across projects to fill in and supplement audits as and when needed. 

• Determine what additional quality assurance processes and metrics are needed to support the team. 

• Create process documentation; noting guideline changes and cascading changes to the entire project team. 

• Shadow specialists to ensure quality and compliance, as necessary. 

What You’ll Need to Bring:

• Advanced degree in humanities/social sciences (Master’s or Ph.D.) preferred, but exceptional candidates with Bachelor’s degrees or alternatively 3 years of data analysis and personnel leadership experience 

• Possesses exceptional writing and editing skills 

• Incredible attention to detail  

• 2+ years’ experience in a quality control environment  

• Strong practical experience with Excel (PivotTable, Charts, Statistical functions) is essential 

• Experience writing guidelines and labeler/annotator feedback 

• Experience being a leader and managing a team to produce high quality work 

• Experience with Tableau/Power BI or other similar tools is a plus 

• Experience with Python as a tool for automation is a plus 

• Exceptional attention to detail and nuance 

What We Offer 

• Fully remote work environment 

• Collaborative culture – and key tools enabling it 

• Competitive compensation package 

• Health, dental & vision benefits 

• Employee Assistance Program (EAP) 

• Career development & progression opportunities 

• Paid vacation & personal days as well as sick days 

We are an equal opportunity employer committed to fostering an inclusive, respectful, and diverse workplace. We welcome and encourage applications from individuals of all backgrounds and are dedicated to employment equity and building a team that reflects the diverse communities in which we live and operate.  

In accordance with the Accessibility for Ontarians with Disabilities Act (AODA), we are committed to providing accommodations throughout the recruitment and selection process. If you require an accommodation, please let us know, and we will work with you to meet your needs. 

#LI-NS1