PwC Logo

PwC

US Tech - AI Evaluation Engineer - Manager

Posted 48 Minutes Ago
Be an Early Applicant
Remote or Hybrid
3 Locations
212K-244K Annually
Senior level
Remote or Hybrid
3 Locations
212K-244K Annually
Senior level
The AI Evaluation Engineer - Manager leads AI solution teams, develops predictive models, supervises performance, and fosters a collaborative team environment while ensuring ethical AI practices and managing client relationships.
The summary above was generated by AI
At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth.
Those in data science and machine learning engineering at PwC will focus on leveraging advanced analytics and machine learning techniques to extract insights from large datasets and drive data-driven decision making. You will work on developing predictive models, conducting statistical analysis, and creating data visualisations to solve complex business problems.
Enhancing your leadership style, you motivate, develop and inspire others to deliver quality. You are responsible for coaching, leveraging team member's unique strengths, and managing performance to deliver on client expectations. With your growing knowledge of how business works, you play an important role in identifying opportunities that contribute to the success of our Firm. You are expected to lead with integrity and authenticity, articulating our purpose and values in a meaningful way. You embrace technology and innovation to enhance your delivery and encourage others to do the same.
Examples of the skills, knowledge, and experiences you need to lead and deliver value at this level include but are not limited to:
Analyse and identify the linkages and interactions between the component parts of an entire system.
Take ownership of projects, ensuring their successful planning, budgeting, execution, and completion.
Partner with team leadership to ensure collective ownership of quality, timelines, and deliverables.
Develop skills outside your comfort zone, and encourage others to do the same.
Effectively mentor others.
Use the review of work as an opportunity to deepen the expertise of team members.
Address conflicts or issues, engaging in difficult conversations with clients, team members and other stakeholders, escalating where appropriate.
Uphold and reinforce professional and technical standards (e.g. refer to specific PwC tax and audit guidance), the Firm's code of conduct, and independence requirements.
The Opportunity
As part of the People Tech & AI team you will lead teams delivering governed Generative AI solutions, designing testing strategies, evaluation frameworks, and governance controls to promote reliable, ethical, and scalable AI agents. As a Manager you will supervise teams, manage client accounts, and apply leading practices across AI platforms, data pipelines, and integrations, while upholding PwC's values and professional standards. This role offers the chance to drive innovation in AI technology while fostering a collaborative environment that empowers team members and enhances client relationships.
Responsibilities
- Foster a collaborative environment to enhance team performance
- Uphold professional standards and PwC values in every deliverable
- Drive innovation in AI technology to meet client needs
- Supervise team members and support their professional development
What You Must Have
- Bachelor's Degree
- At least 6 years of experience in AI/ML engineering, data engineering, or software engineering
- In lieu of a Bachelor's Degree, demonstrating, in addition to the minimum years of experience required for the role, three years of specialized training and/or progressively responsible work experience in technology for each missing year of college
What Sets You Apart
- Master's Degree preferred
- Proven experience leading AI solution teams
- Demonstrating understanding of LLMs and agent architectures
- Possessing experience with Microsoft Power Platform
- Bringing prior consulting or professional services experience
- Establishing testing and validation standards for AI agents
- Managing and coaching teams for continuous development
- Building trusted client relationships and translating requirements
- Designing and overseeing automated testing frameworks for Microsoft Copilot Studio and Google AgentSpace, including unit, integration, end-to-end, and regression testing, as well as low-code workflows, connectors, plugins, and grounding data
- Leading governance of end-to-end AI agent pipelines and data flows, verifying integration correctness and resiliency, data quality, lineage, transformation accuracy, and embedded automated quality gates across CI/CD pipelines
The salary range for this position is: $73,500 - $212,280. For residents of Washington state the salary range for this position is: $73,500 - $244,000. Actual compensation within the range will be dependent upon the individual's skills, experience, qualifications and location, and applicable employment laws. All hired individuals are eligible for an annual discretionary bonus. PwC offers a wide range of benefits, including medical, dental, vision, 401k, holiday pay, vacation, personal and family sick leave, and more. To view our benefits at a glance, please visit the following link: https://pwc.to/benefits-at-a-glance
As PwC is an equal opportunity employer, all qualified applicants will receive consideration for employment at PwC without regard to race; color; religion; national origin; sex (including pregnancy, sexual orientation, and gender identity); age; disability; genetic information (including family medical history); veteran, marital, or citizenship status; or, any other status protected by law.
PwC does not intend to hire experienced or entry level job seekers who will need, now or in the future, PwC sponsorship through the H-1B lottery, except as set forth within the following policy: https://pwc.to/H-1B-Lottery-Policy.
Learn more about how we work: https://pwc.to/how-we-work
For only those qualified applicants that are impacted by the Los Angeles County Fair Chance Ordinance for Employers, the Los Angeles' Fair Chance Initiative for Hiring Ordinance, the San Francisco Fair Chance Ordinance, San Diego County Fair Chance Ordinance, and the California Fair Chance Act, where applicable, arrest or conviction records will be considered for Employment in accordance with these laws. At PwC, we recognize that conviction records may have a direct, adverse, and negative relationship to responsibilities such as accessing sensitive company or customer information, handling proprietary assets, or collaborating closely with team members. We evaluate these factors thoughtfully to establish a secure and trusted workplace for all.
Applications will be accepted until the position is filled or the posting is removed, unless otherwise set forth on the following webpage. Please visit this link for information about anticipated application deadlines: https://pwc.to/us-application-deadlines
#LI-Remote
#LI-Hybrid
#BI-Hybrid

PwC San Francisco, California, USA Office

405 Howard Street Suite 600, San Francisco, CA, United States, 94105

PwC San Jose, California, USA Office

488 Amaden Boulevard, San Jose, CA, United States, 95110

Similar Jobs at PwC

48 Minutes Ago
Remote or Hybrid
3 Locations
212K-244K Annually
Senior level
212K-244K Annually
Senior level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
As an AI Engineering Manager at PwC, you will lead the design and operation of AI-powered platforms, mentor engineers, and ensure project delivery excellence while focusing on security and scalability.
Top Skills: AIAzureAzure Bot Framework SdkAzure Cognitive ServicesCloud EngineeringConversational AiData VisualizationDevOpsMachine Learning
48 Minutes Ago
Remote or Hybrid
3 Locations
151K-187K Annually
Mid level
151K-187K Annually
Mid level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
The role involves developing, testing, and validating Generative AI agents and maintaining automated testing standards. Responsibilities include mentoring junior associates, analyzing complex issues, and applying governance controls in AI-driven solutions.
Top Skills: AIAutomated TestingCi/CdData EngineeringLlmsMlPower Automate
48 Minutes Ago
Remote or Hybrid
3 Locations
151K-187K Annually
Mid level
151K-187K Annually
Mid level
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
As a Senior Associate, you'll design and develop AI solutions, mentor junior staff, and analyze complex problems to support transformation initiatives for clients.
Top Skills: Azure Bot FrameworkAzure ServicesCognitive ServicesLuisOrchestrator

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account