Skip to content

Software Engineering Associate (open to US or Canada)

  • Remote
    • Toronto, Ontario, Canada
    • Ridgefield Park, New Jersey, United States
    +1 more
  • Innodata Services LLC

Job description

Who we are:

Innodata (NASDAQ: INOD) is a leading data engineering company. With more than 2,000 customers and operations in 13 cities around the world, we are the AI technology solutions provider-of-choice to 4 out of 5 of the world’s biggest technology companies, as well as leading companies across financial services, insurance, technology, law, and medicine.

By combining advanced machine learning and artificial intelligence (ML/AI) technologies, a global workforce of subject matter experts, and a high-security infrastructure, we’re helping usher in the promise of clean and optimized digital data to all industries. Innodata offers a powerful combination of both digital data solutions and easy-to-use, high-quality platforms.

Our global workforce includes over 3,000 employees in the United States, Canada, United Kingdom, the Philippines, India, Sri Lanka, Israel and Germany. We’re poised for a period of explosive growth over the next few years.

About the Role 

We’re looking for curious, hands-on engineers eager to build the next wave of Generative AI applications. As an Associate Software Engineer, you’ll work with experienced AI architects and data scientists to develop, test, and evaluate GenAI-powered systems that solve real enterprise problems.

This is a great opportunity for recent grads or early-career professionals passionate about Python programming, prompt engineering, and GenAI application evaluation.

Key Responsibilities 

  • Prototype LLM + retrieval pipelines with safety and filtering.

  • Operate knowledge graph/ vector DBs (Pinecone, Weaviate) and manage embeddings.

  • Build FastAPI services for search, recsys, and memory.

  • Design resilient systems with caching, retries, observability.

  • Run data pipelines for large-scale indexing and embeddings.

  • Capture personalization signals (search, chat, purchase).

  • Optimize for low-latency APIs & high-throughput pipelines.

  • Collaborate with research and product on evaluation and UX.

  • Build and test Python-based scripts, APIs, and microservices supporting GenAI workflows.

  • Assist in prompt engineering, data preparation, and evaluation of GenAI models (e.g., GPT, Claude, Gemini, Llama).

  • Help design and run experiments to measure model quality, reasoning, and response consistency.

  • Collaborate with project and solution teams to prototype new GenAI use cases.

  • Document findings, test cases, and improvement ideas for continuous learning.

Job requirements

Technical & Required Skills 

  • Strong Python (FastAPI, async/await, Redis, PostgreSQL).

  • 1-3 years of hands-on experience with LLM prompting, RAG, embeddings, vector search.

  • Comfort with APIs, distributed systems, caching, observability.

  • Familiarity with GCP/AWS/Azure or similar cloud services, Docker, Git, CI/CD.

  • Clear communicator, self-driven, team player.

  • Bachelor’s degree in Computer Science, Data Science, or related field (or equivalent practical experience).

  • Proficiency in Python (experience with libraries like Pandas, Requests, or LangChain a plus).

  • Familiarity with LLMs, prompt engineering, and GenAI applications.

  • Eagerness to learn and experiment with new tools and APIs.

  • Strong problem-solving skills, curiosity, and team mindset.

Preferred Skills and Experience 

  • Exposure to RESTful APIs, cloud platforms (GCP, AWS, Azure), or vector databases.

  • Interest in evaluating or improving AI model performance (QA, safety, relevance).

  • TypeScript/Node.js (NestJS), React/Next.js., familiarity with FAST API, Streamlit and similar frameworks 

  • Recommender systems exposure.

  • Embedding model evaluation skills.

Soft Skills

  • Excellent communication, presentation, and collaboration skills

  • Strong time management and organizational abilities

  • Self-starter attitude with a customer-centric mindset

  • Ability to work in a multicultural and fast-paced environment

Minimum Education Requirements 

  • Bachelor’s degree or higher in Computer Science, Artificial Intelligence, Machine Learning, Linguistics, Localization or a related field. 

We are an equal opportunity employer committed to fostering an inclusive, respectful, and diverse workplace. We welcome and encourage applications from individuals of all backgrounds and are dedicated to employment equity and building a team that reflects the diverse communities in which we live and operate.  

In accordance with the Accessibility for Ontarians with Disabilities Act (AODA), we are committed to providing accommodations throughout the recruitment and selection process. If you require an accommodation, please let us know, and we will work with you to meet your needs. 

Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit the Federal Trade Commission’s guide at https://consumer.ftc.gov/articles/job-scams. 

If you believe you’ve been targeted by a recruitment scam, please report it to Innodata at verifyjoboffer@innodata.com and consider reporting it to the FTC at ReportFraud.ftc.gov.

#LI-NS1

or