Sr. Software Engineer II - AI

About the Role

The Sr. Software Engineer II - AI will lead the development of GenAI-powered product experiences and the shared AI platform infrastructure that supports them. This includes building RAG pipelines over the iHerb catalog and customer reviews, implementing LLM-driven personalization, creating a conversational Wellness Agent, developing agentic workflow systems, and establishing the evals and MLOps layer necessary for production-grade and repeatable AI features. Specializations within this track include RAG and personalization, agent framework and tool use, evals and guardrails, and LLM application development for internal business functions like marketing automation and BI agents.

Responsibilities

• Design, build, and operate production AI features, including RAG pipelines, LLM-driven recommendations, conversational agents, or agentic workflow automation.
• Construct the shared AI platform layer, encompassing retrieval infrastructure, evaluation frameworks, model monitoring, guardrails, and observability.
• Develop LLM applications and integrations with marketing platforms, BI tools, or customer-facing product surfaces.
• Evaluate model and feature quality using structured evaluation frameworks; iterate on prompts, retrieval strategies, and model selection based on data.
• Utilize AI-driven SDLC tooling (e.g., Claude Code) as a daily practice for both AI and non-AI code development.
• Coordinate with the Personalization team to align GenAI product features with existing ML personalization signals.
• Document AI system design decisions, evaluation results, and operational lessons in the shared knowledge base.
• Own the observability of AI systems built, including latency, cost, quality drift, and error rates; participate in on-call rotations and respond to production incidents.

Requirements

• AI-driven SDLC: Hands-on experience shipping production code with AI-assisted development tools (e.g., Claude Code, GitHub Copilot, Cursor). Daily use in delivering real software is the benchmark.
• Full-Stack Awareness: Comfortable contributing across layers of the stack when needed; purely single-layer specialists are not the target profile.
• Production Ownership: Experience owning features end-to-end from spec through deployment, observability, and on-call. Engineers own what they ship, with no separate ops handoff.
• Code Quality Fundamentals: Strong grasp of software design principles, automated testing, code review, and CI/CD.
• Fully autonomous; drives technical decisions within the team and mentors junior engineers.
• Python proficiency; comfortable building and operating production LLM applications.
• Hands-on experience with at least one specialization: RAG and retrieval systems, LLM evaluation, agentic frameworks (LangChain, LlamaIndex, or similar), or LLM-based workflow automation.
• Understanding of prompt engineering, context window management, and LLM output quality tradeoffs.
• Familiarity with vector databases, embedding models, or semantic search.
• High degree of accuracy and attention to detail.
• Excellent organization skills and ability to multi-task.

Preferred Qualifications

• Exposure to MLOps tooling or model deployment pipelines.
• Contributions to internal developer tooling, golden path standards, or SDLC process improvements.
• Experience with e-commerce platforms, product catalogs, or high-traffic consumer applications.
• Experience working in globally distributed teams.
• Track record of documenting architectural decisions, writing RFCs, or contributing to engineering wikis.

Equipment Knowledge

• Experience with Microsoft Office Suite (Word, Excel, PowerPoint).
• Experience with Google Business Suite (Gmail, Drive, Docs, Sheets, Forms) preferred.

Experience Requirements

• Generally requires a minimum of 10+ years of software engineering experience.

Education Requirements

• Bachelor’s Degree in Computer Science or related field preferred, or a combination of education and equivalent work experience.

Judgment/Reasoning Ability

• Ability to identify, troubleshoot, and resolve problems quickly using sound judgment, poise, and diplomacy.
• Ability to use judgment and reasoning skills and determine when to escalate issues in a timely manner.

Physical Demands

• The physical demands described are representative of those required to perform essential job functions. Regularly required to talk and hear. Frequently required to sit, walk, climb stairs, use hands/fingers, bend, stoop, and reach. May occasionally lift or move office products and supplies up to 25 pounds. Reasonable accommodations may be made for individuals with disabilities.

Work Environment

• Moderate noise level.
• Hectic, fast-paced with multi-level distractions.
• Professional, yet casual work environment.
• Office / Warehouse environment.
• Ability to work extended hours as required.

Compensation & Benefits

• Anticipated Pay Scale: $187,000—$235,000 USD
• Benefits: Eligible for medical, dental, vision, basic life insurance programs, 401(k) plan, Time Off, Paid Sick Leave, and paid holidays. Eligibility criteria apply.
• Additional: Potential for Restricted Stock Units and annual bonuses based on eligibility and performance criteria.
• For more information on iHerb benefits, visit us at iHerbBenefits.com.

About iHerb

iHerb is on a mission to make health and wellness accessible to all, offering Earth’s best-curated selection of health and wellness products at the best possible value, delivered with the most convenient experience. As the world’s largest eCommerce platform dedicated to vitamins, minerals, and supplements, iHerb has been simplifying the purchase of high-quality products for over 25 years, shipping over 50,000 products from 1,800+ brands to customers in 180+ countries. Their vision is to become the #1 destination for health and wellness globally. iHerb's 5 Shared Values unite their global team: Focus on the Customer, Empower Our People, Be Entrepreneurial & Pivot Quickly, Embrace Diversity & Inclusion, and Strive for Simplicity.

Equal Opportunity Employer

iHerb is an Equal Opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status. iHerb provides equal employment opportunities to all applicants and prohibits discrimination and harassment.