Junior Software Engineer – AI/LLM Systems

At Epiq , your work contributes to complex, global legal outcomes. You’ll join a values‑driven community where integrity guides decisions, relentless service sets the bar, and we thrive on big challenges together. We invest in your growth with enterprise‑wide learning and mobility. We celebrate who you are, and we respect life beyond work with flexibility that’s recognized externally.

Enabled by modern platforms and AI, you’ll do the most meaningful work of your career and see your impact at scale.

Job Description

Job Summary

We’re building cutting‑edge AI‑powered products and need a junior engineer who is eager to learn about large‑language‑model (LLM) technology while helping us ship new features. If you enjoy working on real‑world products and want to grow your skills in AI, this role is for you.

Essential Job Responsibilities

• Build and ship AI features with LLMs, retrieval‑augmented generation (RAG) pipelines, embeddings, and simple multi‑model workflows under guidance from senior teammates.
• Help design low‑latency, high‑accuracy systems that can scale reliably in production.
• Support cloud operations on AWS/Azure, learning how to keep costs under control.
• Create prompt libraries and participate in evaluation pipelines, guardrails, and automated quality checks.
• Collaborate with product and linguistics experts to translate user stories into concrete rules and domain logic.
• Run benchmarks and tweak models for accuracy, performance, latency, and cost, reporting findings to the team.
• Build internal tools for prompt iteration, dataset curation, and model evaluation with guidance from more experienced engineers.

Qualifications & Requirements

Education

• Required: Bachelor's degree in Computer Science, Information Technology, or a related field.
• Preferred: Master's degree in Computer Science or a related field.

Skills

• Production‑grade software engineering – Proven experience building, testing, and deploying code in live environments.
• Python mastery – Comfortable writing clean, idiomatic Python (3.x), using core libraries and data‑science tools (e.g., pandas, NumPy, scikit‑learn, FastAPI, Django).
• Cloud‑native development – Hands‑on experience with cloud platforms (AWS, GCP, or Azure), including IaC (Terraform, CloudFormation), serverless functions, container orchestration (Kubernetes), and CI/CD pipelines.
• Basic ML/LLM awareness – A foundational grasp of machine‑learning concepts and large‑language‑model principles, paired with a genuine curiosity to dive deeper.
• Observability & performance – Familiarity with monitoring, logging, and tracing in distributed systems (Prometheus, Grafana, ELK stack, OpenTelemetry).
• Optional advanced exposure – Experience with vector databases, retrieval‑augmented generation, or prompt engineering is a plus, but not mandatory.
• Product‑oriented mindset – Ability to translate technical ideas into user‑centric features that delight customers.
• Growth‑oriented teamwork – Eager to learn, proactive, and thrives in a collaborative environment where mentorship and support for junior talent are core values.

The Compensation range for this role is 80,000 to 95,000 USD annually and may be eligible for an annual bonus.

In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.

Must be authorized to work in the United States for any employer.

Your specific salary will be determined based on several factors:

• Location-based market rate for the role
• Your abilities in relation to the job specification
• Performance during screening and interview
• Pay parity with the wider team in the considered location

Further details about the package will be provided during the initial screening call with the Talent Acquisition Team.

Click Here To Learn About Epiq's Benefits.

Epiq Leadership Compass

Fosters Relationships & Collaboration

Builds trust and alignment through open communication, shared goals, and strong partnerships to drive collective success.

• Build trust-based partnerships
• Nurture long-term relationships
• Remove collaboration barriers
• Celebrate cross-team success

Engages & Influences

Inspires action and alignment through clear communication, purposeful influence, and a compelling vision.

• Use storytelling to build buy-in
• Align communication with organ