Software Engineering Associate (open to US or Canada)

Join to apply for the Software Engineering Associate (open to US or Canada) role at Innodata Inc.

About The Role

We're looking for curious, hands‑on engineers eager to build the next wave of Generative AI applications. As an Associate Software Engineer, you'll work with experienced AI architects and data scientists to develop, test, and evaluate GenAI‑powered systems that solve real enterprise problems.

This is a great opportunity for recent grads or early‑career professionals passionate about Python programming, prompt engineering, and GenAI application evaluation.

Key Responsibilities

Prototype LLM + retrieval pipelines with safety and filtering.

Operate knowledge graph/ vector DBs (Pinecone, Weaviate) and manage embeddings.

Build FastAPI services for search, recsys, and memory.

Design resilient systems with caching, retries, observability.

Run data pipelines for large‑scale indexing and embeddings.

Capture personalization signals (search, chat, purchase).

Optimize for low‑latency APIs & high‑throughput pipelines.

Collaborate with research and product on evaluation and UX.

Build and test Python‑based scripts, APIs, and microservices supporting GenAI workflows.

Assist in prompt engineering, data preparation, and evaluation of GenAI models (e.g., GPT, Claude, Gemini, Llama).

Help design and run experiments to measure model quality, reasoning, and response consistency.

Collaborate with project and solution teams to prototype new GenAI use cases.

Document findings, test cases, and improvement ideas for continuous learning.

Technical & Required Skills

Strong Python (FastAPI, async/await, Redis, PostgreSQL).

1‑3 years of hands‑on experience with LLM prompting, RAG, embeddings, vector search.

Comfort with APIs, distributed systems, caching, observability.

Familiarity with GCP/AWS/Azure or similar cloud services, Docker, Git, CI/CD.

Clear communicator, self‑driven, team player.

Bachelor's degree in Computer Science, Data Science, or related field (or equivalent practical experience).

Proficiency in Python (experience with libraries like Pandas, Requests, or LangChain a plus).

Familiarity with LLMs, prompt engineering, and GenAI applications.

Eagerness to learn and experiment with new tools and APIs.

Strong problem‑solving skills, curiosity, and team mindset.

Preferred Skills And Experience

Exposure to RESTful APIs, cloud platforms (GCP, AWS, Azure), or vector databases.

Interest in evaluating or improving AI model performance (QA, safety, relevance).

TypeScript/Node.js (NestJS), React/Next.js, familiarity with FAST API, Streamlit and similar frameworks.

Recommender systems exposure.

Embedding model evaluation skills.

Soft Skills

Excellent communication, presentation, and collaboration skills.

Strong time management and organizational abilities.

Self‑starter attitude with a customer‑centric mindset.

Ability to work in a multicultural and fast‑paced environment.

Minimum Education Requirements

Bachelor's degree or higher in Computer Science, Artificial Intelligence, Machine Learning, Linguistics, Localization or a related field.

Equal Opportunity Employer

We are an equal opportunity employer committed to fostering an inclusive, respectful, and diverse workplace. We welcome and encourage applications from individuals of all backgrounds and are dedicated to employment equity and building a team that reflects the diverse communities in which we live and operate.

Accessibility for Ontarians with Disabilities Act (AODA)

In accordance with the Accessibility for Ontarians with Disabilities Act (AODA), we are committed to providing accommodations throughout the recruitment and selection process. If you require an accommodation, please let us know, and we will work with you to meet your needs.

Job Scam Notice

Please be aware of recruitment scams involving individuals or organizations falsely claiming to represent employers. Innodata will never ask for payment, banking details, or sensitive personal information during the application process. To learn more on how to recognize job scams, please visit /consumer.ftc.gov/articles/job-scams. If you believe you've been targeted by a recruitment scam, please report it to Innodata at *** and consider reporting it to the FTC at ReportFraud.ftc.gov.

•