Upwork Logo

Upwork

Lead Data Engineer

Posted 4 Days Ago
Easy Apply
Hybrid
Palo Alto, CA
152K-216K Annually
Senior level
Easy Apply
Hybrid
Palo Alto, CA
152K-216K Annually
Senior level
As a Lead Data Engineer, you'll design and implement AI-powered data systems, focusing on natural language queries and scalable frameworks. Collaborate with teams to optimize data access and enhance reporting tools.
The summary above was generated by AI

Upwork Inc.’s (Nasdaq: UPWK) family of companies connects businesses with global, AI-enabled talent across every contingent work type including freelance, fractional, and payrolled. This portfolio includes the Upwork Marketplace, which connects businesses with on-demand access to highly skilled talent across the globe, and Lifted, which provides a purpose-built solution for enterprise organizations to source, contract, manage, and pay talent across the full spectrum of contingent work. From Fortune 100 enterprises to entrepreneurs, businesses rely on Upwork Inc. to find and hire expert talent, leverage AI-powered work solutions, and drive business transformation. With access to professionals spanning more than 10,000 skills across AI & machine learning, software development, sales & marketing, customer support, finance & accounting, and more, the Upwork family of companies enables businesses of all sizes to scale, innovate, and transform their workforces for the age of AI and beyond.

Since its founding, Upwork Inc. has facilitated more than $30 billion in total transactions and services as it fulfills its purpose to create opportunity in every era of work. Learn more about the Upwork Marketplace at Upwork.com and follow us on LinkedIn, Facebook, Instagram, TikTok, and X; and learn more about Lifted at Go-Lifted and follow on LinkedIn.

As a Lead AI Engineer on our Data Platform & Services (DPS) team, you will bridge deep data engineering expertise with emerging AI capabilities to build production-grade AI-powered systems. You’ll design and deploy agentic frameworks, natural language querying (NLQ) capabilities, and prompt/LLM evaluation strategies that unlock insights at scale across Upwork. This is an opportunity to deliver tangible impact, enabling faster decision-making, democratizing data access, and empowering analysts and stakeholders throughout the company.

Responsibilities:
  • Design and implement scalable agentic frameworks that coordinate multiple AI agents to deliver accurate and reliable outcomes.
  • Build and optimize natural language query solutions that provide compliant, intuitive, and self-service access to enterprise data.
  • Develop and maintain evaluation frameworks for LLMs and prompts, driving measurable improvements in accuracy, scalability, and resilience.
  • Partner with data engineering peers to integrate AI orchestration with Python, SQL, and Snowflake pipelines.
  • Contribute to AI-powered summarization and explanation tools that enhance reporting, insights, and executive reviews.
  • Collaborate cross-functionally with product, analytics, and business teams to ensure solutions meet measurable business goals.
What it takes to catch our eye:
  • Proven experience delivering AI-powered data systems in production, including hands-on expertise with LLMs and prompt engineering.
  • Strong foundation in modern data engineering, with proficiency in Python, SQL, and platforms such as Snowflake.
  • Demonstrated ability to design agentic orchestration frameworks that scale across diverse business scenarios.
  • A collaborative problem-solver with strong communication skills, able to align stakeholders and create clarity across teams.
  • Growth mindset—excited to learn, iterate, and deliver measurable business outcomes through applied AI.
Come change how the world works.

At Upwork, you’ll shape the future of work for a global, remote-first workforce, creating economic opportunities for professionals worldwide. While we have a physical office in Palo Alto, we currently hire full-time employees in 21 U.S. states, making it easier than ever to join our mission from wherever you call home.

Our culture is built on trust, risk-taking, customer focus, and excellence, all in service of our core mission: to create economic opportunities so people have better lives. We embrace authenticity and inclusion, encouraging everyone to bring their whole selves to work. Personal and professional growth is a priority here, supported through development programs, mentorship, and our Upwork Belonging Communities.

We’re proud to offer benefits that go beyond the basics, including comprehensive medical coverage for you and your family, unlimited PTO, a 401(k) plan with matching, 12 weeks of paid parental leave, and an Employee Stock Purchase Plan. Visit our Life at Upwork page to learn more about our values, working principles, and the overall employee experience.

Ready to help shape the future of work? Check out our Careers page and follow us on LinkedIn, Facebook, Instagram, TikTok, and X to learn more about life at Upwork.

Upwork is an Equal Opportunity Employer committed to recruiting and retaining a diverse and inclusive workforce. We do not discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, or other legally protected characteristics under federal, state, or local law.

Please note that a criminal background check may be required once a conditional job offer is made. Qualified applicants with arrest or conviction records will be considered in accordance with applicable law, including the California Fair Chance Act and local Fair Chance ordinances.

The annual base salary range for this position  is displayed below. The range displayed reflects the minimum and maximum salary for this position, and individual base pay will depend on your skills, qualifications, experience, and location. Additionally, this position is eligible for the annual bonus plan or sales incentive plan and eligibility to participate in our long term equity incentive program.

Annual Base Compensation
$151,500$215,500 USD

Upwork is an Equal Opportunity Employer committed to recruiting and retaining a diverse and inclusive workforce. We do not discriminate based on race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, or other legally protected characteristics under federal, state, or local law.

Please note that a criminal background check may be required once a conditional job offer is made. Qualified applicants with arrest or conviction records will be considered in accordance with applicable law, including the California Fair Chance Act and local Fair Chance ordinances. The Company is committed to conducting an individualized assessment and giving all individuals a fair opportunity to provide relevant information or context before making any final employment decision.

To learn more about how Upwork processes and protects your personal information as part of the application process, please review our Global Job Applicant Privacy Notice

Top Skills

Python
Snowflake
SQL
HQ

Upwork San Francisco, California, USA Office

475 Brannan St. Suite 430 , San Francisco, CA, United States, 94107

Similar Jobs

5 Days Ago
Remote or Hybrid
USA
75K-323K Annually
Senior level
75K-323K Annually
Senior level
Consumer Web • Coupons • Healthtech • Social Impact • Pharmaceutical
The Lead Data Engineer will develop robust data pipelines and solutions, ensuring data integrity and accessibility while collaborating cross-functionally within GoodRx.
Top Skills: BigQueryCloud FunctionsDatabricksDbtDockerGitGCPJIRAPythonRedshiftSnowflakeSQLTerraform
Yesterday
In-Office
Century City, Los Angeles, CA, USA
124K-209K Annually
Mid level
124K-209K Annually
Mid level
Fintech
The Lead Data Engineer will shape enterprise data solutions, lead a team in building data pipelines, ensure project execution meets standards, and mentor team members while focusing on scalability and performance improvements.
Top Skills: Azure Data FactoryAzure DatabricksGitHadoopJavaPower BIPythonRScalaSnowflakeSparkSQLTableau
6 Days Ago
Easy Apply
In-Office or Remote
Riverside, CA, USA
Easy Apply
150K-190K Annually
Senior level
150K-190K Annually
Senior level
AdTech • Big Data • Consumer Web • Digital Media • Marketing Tech
Lead scalable data engineering efforts to provide reliable data for BI and analytics, while mentoring peers and optimizing processes.
Top Skills: AthenaAWSDockerGlueKinesisPrestoPythonS3SparkSQL

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account