Leads the architecture and delivery of large-scale, cloud-native data pipelines supporting search and personalization. Owns ingestion, transformation, orchestration, testing, deployment, monitoring, data quality, lineage, and reliability for batch and streaming systems. Provides technical leadership and mentorship, partners with machine learning and product teams, establishes architecture standards, and drives innovation across data engineering infrastructure.
Position Summary...What you'll do...
About the team: The team owns the data pipeline framework supporting Search and Personalization at Walmart. They build and maintain systems that ingest user interaction signals, catalog data, and other key sources, transforming them into high-quality features and datasets. These datasets power the machine learning models that drive search relevance and personalized shopping experiences at scale. The team builds robust, scalable solutions using modern data engineering and cloud-native architecture, with collaboration and technical excellence central to delivering impactful results.
What you'll do:
About Walmart Global Tech:
Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That’s what we do at Walmart Global Tech. We’re a team of software engineers, data scientists, cybersecurity expert's and service professionals within the world’s leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered.
We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.
Flexible, hybrid work
We use a hybrid way of working with primary in office presence coupled with an optimal mix of virtual presence. We use our campuses to collaborate and be together in person, as business needs require and for
development and networking opportunities. This approach helps us make quicker decisions, remove location barriers across our global team, be more flexible in our personal lives.
Benefits:
Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include a host of best-in-class benefits maternity and parental leave, PTO, health benefits, and much more.
Equal Opportunity Employer:
Walmart, Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing diversity- unique styles, experiences, identities, ideas and opinions – while being inclusive of all people.
The above information has been designed to indicate the general nature and level of work performed in the role. It is not designed to contain or be interpreted as a comprehensive inventory of all responsibilities and qualifications required of employees assigned to this job. The full Job Description can be made available as part of the hiring process.
At Walmart, we offer competitive pay as well as performance-based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more. You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable. For information about PTO, see https://one.walmart.com/notices. Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms.
For information about benefits and eligibility, see One.Walmart.
The annual salary range for this position is $143,000.00 - $286,000.00 Additional compensation includes annual or quarterly performance bonuses. Additional compensation for certain positions may also include :
- Stock
Option 2: 7 years’ experience in software engineering or related area.Preferred Qualifications...
Walmart is seeking a Principal Data Engineer to lead the design and evolution of large-scale data pipeline infrastructure, delivering scalable, cloud-native data solutions that power search and personalization across Walmart's e-commerce platform. This role owns the full data engineering lifecycle — from ingestion and transformation to feature/dataset delivery — ensuring high availability, data quality, and fault tolerance at scale. The position requires strategic technical leadership, mentorship, and cross-functional collaboration to align data engineering efforts with business and ML objectives. The successful candidate will champion innovation, set data architecture standards, and drive continuous improvement while upholding Walmart's commitment to integrity and operational excellence.
About the team: The team owns the data pipeline framework supporting Search and Personalization at Walmart. They build and maintain systems that ingest user interaction signals, catalog data, and other key sources, transforming them into high-quality features and datasets. These datasets power the machine learning models that drive search relevance and personalized shopping experiences at scale. The team builds robust, scalable solutions using modern data engineering and cloud-native architecture, with collaboration and technical excellence central to delivering impactful results.
**Immigration Sponsorship support will NOT be available for this
position**
position**
What you'll do:
- Lead the architecture and delivery of scalable, cloud-native data pipelines and reusable data infrastructure aligned to strategic roadmaps.
- Own the end-to-end data engineering lifecycle: ingestion, transformation, orchestration, testing, deployment, and monitoring of large-scale distributed data systems.
- Design and build high-throughput, low-latency pipelines (batch and streaming) that produce ML-ready features and datasets for search and personalization models.
- Provide technical leadership and mentorship across data engineering teams, promoting best practices in data modeling, pipeline design, and architectural consistency.
- Partner with ML, search, and product stakeholders to translate business and model requirements into scalable data solutions and measurable success metrics.
- Ensure data quality, lineage, and reliability through observability, validation frameworks, and SLA ownership across pipelines.
- Drive continuous improvement through innovation, knowledge sharing, and adoption of emerging data engineering technologies.
What you'll bring:
- Extensive experience leading large-scale data engineering initiatives, including distributed data processing, data modeling, and cloud-native data platforms.
- Proven expertise with big data technologies (e.g., Spark, Kafka, Hadoop) and data pipeline orchestration tools (e.g., Airflow).
- Strong programming skills in Python, Java, or Scala, with experience building production-grade ETL/ELT and streaming pipelines.
- Deep understanding of data warehousing, feature engineering, and data infrastructure supporting ML/AI systems.
- Experience with cloud platforms (Azure, GCP, or AWS) and CI/CD practices for data systems.
- Demonstrated ability to mentor engineers and influence data architecture decisions across teams.
- Excellent collaboration and communication skills with cross-functional and ML stakeholders.
- Commitment to data quality, continuous improvement, and engineering excellence.
About Walmart Global Tech:
Imagine working in an environment where one line of code can make life easier for hundreds of millions of people. That’s what we do at Walmart Global Tech. We’re a team of software engineers, data scientists, cybersecurity expert's and service professionals within the world’s leading retailer who make an epic impact and are at the forefront of the next retail disruption. People are why we innovate, and people power our innovations. We are people-led and tech-empowered.
We train our team in the skillsets of the future and bring in experts like you to help us grow. We have roles for those chasing their first opportunity as well as those looking for the opportunity that will define their career. Here, you can kickstart a great career in tech, gain new skills and experience for virtually every industry, or leverage your expertise to innovate at scale, impact millions and reimagine the future of retail.
Flexible, hybrid work
We use a hybrid way of working with primary in office presence coupled with an optimal mix of virtual presence. We use our campuses to collaborate and be together in person, as business needs require and for
development and networking opportunities. This approach helps us make quicker decisions, remove location barriers across our global team, be more flexible in our personal lives.
Benefits:
Beyond our great compensation package, you can receive incentive awards for your performance. Other great perks include a host of best-in-class benefits maternity and parental leave, PTO, health benefits, and much more.
Equal Opportunity Employer:
Walmart, Inc. is an Equal Opportunity Employer – By Choice. We believe we are best equipped to help our associates, customers and the communities we serve live better when we really know them. That means understanding, respecting and valuing diversity- unique styles, experiences, identities, ideas and opinions – while being inclusive of all people.
The above information has been designed to indicate the general nature and level of work performed in the role. It is not designed to contain or be interpreted as a comprehensive inventory of all responsibilities and qualifications required of employees assigned to this job. The full Job Description can be made available as part of the hiring process.
At Walmart, we offer competitive pay as well as performance-based bonus awards and other great benefits for a happier mind, body, and wallet. Health benefits include medical, vision and dental coverage. Financial benefits include 401(k), stock purchase and company-paid life insurance. Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting. Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more. You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes. The amount you receive depends on your job classification and length of employment. It will meet or exceed the requirements of paid sick leave laws, where applicable. For information about PTO, see https://one.walmart.com/notices. Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart.
Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms.
For information about benefits and eligibility, see One.Walmart.
The annual salary range for this position is $143,000.00 - $286,000.00 Additional compensation includes annual or quarterly performance bonuses. Additional compensation for certain positions may also include :
- Stock
ㅤ
ㅤ
ㅤ
ㅤ
Minimum Qualifications...Outlined below are the required minimum qualifications for this position. If none are listed, there are no minimum qualifications.
Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 5 years’ experience in software engineering or related area.Option 2: 7 years’ experience in software engineering or related area.Preferred Qualifications...
Outlined below are the optional preferred qualifications for this position. If none are listed, there are no preferred qualifications.
Master’s degree in computer science, computer engineering, computer information systems, software engineering, or related area and 3 years' experience in software engineering or related area., We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly. The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart’s accessibility standards and guidelines for supporting an inclusive culture.Primary Location...815 Eleventh Ave, Sunnyvale, CA 94089-4731, United States of AmericaWalmart and its subsidiaries are committed to maintaining a drug-free workplace and has a no tolerance policy regarding the use of illegal drugs and alcohol on the job. This policy applies to all employees and aims to create a safe and productive work environment.Walmart Global Tech Sunnyvale, California, USA Office
840 W California Ave, Sunnyvale, CA, United States, 94086
Similar Jobs
Big Data • Cloud • Logistics • Machine Learning • Retail
Designs, develops, and improves advertising optimization algorithms for budgeting, pacing, bidding, ranking, and campaign performance. Collaborates with data scientists, product teams, and engineering organizations to build scalable, low-latency services and prediction models. Develops simulation and dark-canary systems for safe iteration, provides technical leadership, mentors engineers, and drives reliable, observable platform infrastructure and architectural standards.
Top Skills:
Assistive TechnologiesC++Feedback Control AlgorithmsJavaLow-Latency Data PipelinesOffline SimulationOnline Dark Canary SystemsPythonReinforcement LearningWcag 2.2 Aa
Big Data • Cloud • Logistics • Machine Learning • Retail
Lead the technical strategy, architecture, development, and operational excellence of Walmart’s large-scale experimentation platform. Design reliable backend services and pipelines, guide cross-organizational initiatives, mentor senior engineers, and partner with data science, product, and engineering leaders. Drive experimentation capabilities, feature-flag deployments, incident resolution, observability, security, emerging-technology adoption, and alignment between platform architecture and long-term business objectives.
Top Skills:
A/B TestingCloud ComputingExperimentation PlatformsFeature FlagsJavaLuaObservabilityRustScalaWcag 2.2 Aa
Big Data • Cloud • Logistics • Machine Learning • Retail
Leads complex, cross-functional software engineering projects from requirements through design, development, testing, and delivery. Oversees architecture, code quality, root cause analysis, reliability improvements, and cloud-native solutions. Manages and mentors distributed engineering teams, collaborates with business stakeholders, and drives continuous improvement. The team develops scalable dependency-management systems, automates CI/CD diagnosis and remediation using AI and machine learning, and enforces software lifecycle, security, and compliance policies.
Top Skills:
Ai And Machine LearningCi/CdCloud-Native ArchitectureCompliance AutomationDistributed SystemsJ2EeJavaJvmRestful Web ServicesService-Oriented ArchitectureSoftware SecuritySpringWcag 2.2 Aa
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
