The Associate Engineer - AI position involves designing scalable software systems, developing LLM solutions, collaborating with teams, and ensuring code quality. Responsibilities include utilizing cloud platforms, implementing DevOps practices, and engaging in the entire software development lifecycle.
ZS is a place where passion changes lives. As a management consulting and technology firm focused on improving life and how we live it, we transform ideas into impact by bringing together data, science, technology and human ingenuity to deliver better outcomes for all. Here you'll work side-by-side with a powerful collective of thinkers and experts shaping life-changing solutions for patients, caregivers and consumers, worldwide. ZSers drive impact by bringing a client-first mentality to each and every engagement. We partner collaboratively with our clients to develop custom solutions and technology products that create value and deliver company results across critical areas of their business. Bring your curiosity for learning, bold ideas, courage and passion to drive life-changing impact to ZS.
LLM Engineer
We are seeking a highly skilled LLM Engineer with 1-4 years of experience in software development and 1-2 years in LLM solution development,. The ideal candidate will have strong experience working with Python, LLM solution patterns and tools (RAG, Vector DB, Agentic workflows, LoRA, etc.) cloud platforms (AWS, Databricks and Azure), and DevOps tools. They will be responsible for designing and developing scalable software solutions, leading architecture design, and ensuring the performance and reliability of our systems.
What You'll Do:
What You'll Bring:
Hybrid working model:
ZS is committed to a Flexible and Connected way of working. ZSers are on-site at clients or ZS offices three days a week. Combined flexibility to work remotely two days a week is also available. The magic of ZS culture and innovation thrives in both planned and spontaneous face-to-face connections.
How you'll grow:
Perks & Benefits:
At ZS, your growth matters. We offer a comprehensive total rewards package that supports your health and well-being, financial future, time away, and professional development. With robust skills-building programs, multiple career progression paths, internal mobility, and a deeply collaborative culture, you'll have the opportunity to do meaningful work, expand your capabilities, and thrive as part of a global community. For details on total rewards in Canada , visit ZS Canada office locations | Where we work | ZS .
Hybrid working model:
We are committed to giving our employees a flexible and connected way of working. A flexible and connected ZS allows us to combine work from home and on-site presence at clients/ZS offices for the majority of our week. The magic of ZS culture and innovation thrives in both planned and spontaneous face-to-face connections.
Travel:
Travel is a requirement at ZS for client facing ZSers; business needs of your project and client are the priority. While some projects may be local, all client-facing ZSers should be prepared to travel as needed. Travel provides opportunities to strengthen client relationships, gain diverse experiences, and enhance professional growth by working in different environments and cultures.
Considering applying?
At ZS, we honor the visible and invisible elements of our identities, personal experiences, and belief systems-the ones that comprise us as individuals, shape who we are, and make us unique. We believe your personal interests, identities, and desire to learn are integral to your success here. We are committed to building a team that reflects a broad variety of backgrounds, perspectives, and experiences. Learn more about our inclusion and belonging efforts and the networks ZS supports to assist our ZSers in cultivating community spaces and obtaining the resources they need to thrive.
If you're eager to grow, contribute, and bring your unique self to our work, we encourage you to apply.
ZS is an equal opportunity employer and is committed to providing equal employment and advancement opportunities without regard to any class protected by applicable law.
To complete your application:
Candidates must possess or be able to obtain work authorization for their intended country of employment. An on-line application, including a full set of transcripts (official or unofficial), is required to be considered.
NO AGENCY CALLS, PLEASE.
Find Out More At:
www.zs.com
Salary: $75,000.00 - $90,250.00
LLM Engineer
We are seeking a highly skilled LLM Engineer with 1-4 years of experience in software development and 1-2 years in LLM solution development,. The ideal candidate will have strong experience working with Python, LLM solution patterns and tools (RAG, Vector DB, Agentic workflows, LoRA, etc.) cloud platforms (AWS, Databricks and Azure), and DevOps tools. They will be responsible for designing and developing scalable software solutions, leading architecture design, and ensuring the performance and reliability of our systems.
What You'll Do:
- Take ownership of architecture design and development of scalable and distributed software systems
- Translate business to technical requirements
- Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation
- Data driven decision making skills with focus on achieving product goals
- Design, develop and deploy LLM based pipelines involving patterns like RAG, Agentic workflows, PEFT (e.g. LORA, QLORA, etc.)
- Responsible for the complete software development lifecycle, including requirements analysis, design, coding, testing, and deployment.
- Utilize AWS services/ Azure services like IAM, Monitoring, Load Balancing, Autoscaling, Database, Networking, storage, ECR, AKS, ACR etc.
- Utilize Databricks capabilities, esp. Unity Catalog and be able to architect the governance layer from data all-the-way to the AI model output
- Design, develop and deploy prompt and response guardrails to enable responsible AI requirements
- Implement DevOps practices using tools like Docker, Kubernetes to ensure continuous integration and delivery. Develop DevOps scripts for automation and monitoring.
- Collaborate with cross-functional teams, conduct code reviews, and provide guidance on software design and best practices.
What You'll Bring:
- Bachelor's degree in computer science, Information Technology, or a related field (or equivalent work experience).
- 1-5 years of experience in software development, with relevant work experience in LLM app development.
- Strong coding skills with proficiency in Python and Javascript
- Experience with API frameworks both stateless and stateful such as Fast API, Django
- Proficient in cloud platforms, specifically AWS, Databricks and Azure
- Proficient in Infra-as-Code, esp. focused on developing Terraform scripts and Cloudformation
- Knowledge and hands-on experience with front-end development (React JS, Next JS, Tailwind CSS) preferred
- Strong experience in LLM patterns like RAG, Vector DB, Hybrid Search, Agent development, Agentic workflows, prompt engineering, etc.
- Strong experience with LLM APIs (Open AI, Anthropic, AWS Bedrock), SDKs (Langchain, DSPy)
- Hands-on experience with DevOps tools including Docker, Kubernetes, and AWS services (Redshift, RDS, S3).
- Hands-on experience with Databricks solutions including Unity Catalog.
- Experience in production deployments involving thousands of users, esp with capabilities like Redis, Vector Search, etc.
- Strong understanding of scalable application design principles and experience with security best practices and compliance with privacy regulations.
- Good knowledge of software engineering practices like version control (GIT), DevOps (Azure DevOps preferred) and Agile or Scrum.
- Strong communication skills, with the ability to effectively convey complex technical concepts to a diverse audience.
- Experience of SDLC and best practices while development
- Experience with Agile methodology for continuous product development and delivery
Hybrid working model:
ZS is committed to a Flexible and Connected way of working. ZSers are on-site at clients or ZS offices three days a week. Combined flexibility to work remotely two days a week is also available. The magic of ZS culture and innovation thrives in both planned and spontaneous face-to-face connections.
How you'll grow:
- Cross-functional skills development & custom learning pathways
- Milestone training programs aligned to career progression opportunities
- Internal mobility paths that empower growth via s-curves, individual contribution and role expansions
Perks & Benefits:
At ZS, your growth matters. We offer a comprehensive total rewards package that supports your health and well-being, financial future, time away, and professional development. With robust skills-building programs, multiple career progression paths, internal mobility, and a deeply collaborative culture, you'll have the opportunity to do meaningful work, expand your capabilities, and thrive as part of a global community. For details on total rewards in Canada , visit ZS Canada office locations | Where we work | ZS .
Hybrid working model:
We are committed to giving our employees a flexible and connected way of working. A flexible and connected ZS allows us to combine work from home and on-site presence at clients/ZS offices for the majority of our week. The magic of ZS culture and innovation thrives in both planned and spontaneous face-to-face connections.
Travel:
Travel is a requirement at ZS for client facing ZSers; business needs of your project and client are the priority. While some projects may be local, all client-facing ZSers should be prepared to travel as needed. Travel provides opportunities to strengthen client relationships, gain diverse experiences, and enhance professional growth by working in different environments and cultures.
Considering applying?
At ZS, we honor the visible and invisible elements of our identities, personal experiences, and belief systems-the ones that comprise us as individuals, shape who we are, and make us unique. We believe your personal interests, identities, and desire to learn are integral to your success here. We are committed to building a team that reflects a broad variety of backgrounds, perspectives, and experiences. Learn more about our inclusion and belonging efforts and the networks ZS supports to assist our ZSers in cultivating community spaces and obtaining the resources they need to thrive.
If you're eager to grow, contribute, and bring your unique self to our work, we encourage you to apply.
ZS is an equal opportunity employer and is committed to providing equal employment and advancement opportunities without regard to any class protected by applicable law.
To complete your application:
Candidates must possess or be able to obtain work authorization for their intended country of employment. An on-line application, including a full set of transcripts (official or unofficial), is required to be considered.
NO AGENCY CALLS, PLEASE.
Find Out More At:
www.zs.com
Salary: $75,000.00 - $90,250.00
Top Skills
AWS
Azure
CloudFormation
Databricks
Docker
JavaScript
Kubernetes
Next Js
Python
React Js
Tailwind Css
Terraform
ZS Foster City, California, USA Office
ZS San Francisco (Foster City) Office

950 Tower Lane, Suite 1500, Foster City, CA, United States, 94404
ZS South San Francisco, California, USA Office
ZS San Francisco (South) Office

611 Gateway Blvd, Suite 1000, South San Francisco, CA, United States, 94080
Similar Jobs at ZS
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
Design and develop Large Language Model-based applications within Pharma R&D, focusing on client collaboration and technical excellence while ensuring production readiness and performance optimization.
Top Skills:
AWSCi/CdDockerMl FrameworksPythonReactRest ApisSQLVue
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The associate conducts market research and leverages problem-solving skills to create data-driven solutions for clients, synthesizing insights and collaborating on implementations.
Top Skills:
AccessConfirmitData AnalyticsExcelProprietary Software
Artificial Intelligence • Healthtech • Professional Services • Analytics • Consulting
The Decision Analytics Associate develops statistical models, leverages data analytics for decision-making, designs custom analyses, communicates results, and maintains client relationships.
Top Skills:
ExcelHadoopJavaPythonRSASTableauVisual Basic
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine



