itD Logo

itD

Data Engineer – Data Infrastructure & eDiscovery-6387

Posted Yesterday
In-Office
San Jose, CA, USA
Mid level
In-Office
San Jose, CA, USA
Mid level
Build and maintain complex ETL pipelines, data warehouses, monitoring systems, and alerting infrastructure for legal and eDiscovery data. Develop advanced SQL and Python solutions, lead cross-functional engineering initiatives, collaborate with attorneys and Data Scientists, and identify AI and automation opportunities while maintaining privacy and security standards.
The summary above was generated by AI
Data Engineer – Data Infrastructure & eDiscovery

itD is seeking an experienced Data Engineer to build, enhance, and maintain high-complexity data pipelines, data warehousing infrastructure, and monitoring and alerting systems supporting its Legal and eDiscovery team. The ideal candidate will bring deep expertise in SQL, Python, ETL pipeline development, and workflow orchestration, with a proven track record of leading end-to-end data engineering initiatives across cross-functional teams. This individual will help deliver scalable, reliable, and secure data infrastructure while partnering with technical and non-technical stakeholders, including attorneys and Data Scientists.

Location: Remote – California. Candidates located in or near the San Francisco Bay Area are preferred. Candidates must indicate their willingness to occasionally work onsite in San Francisco.

Duration: 6 months

We provide comprehensive medical benefits, a 401(k) plan, paid holidays, and more.

Please note that we are only considering direct W2 candidates at this time, as we are unable to offer sponsorship.

Responsibilities
  • Design, develop, and maintain complex ETL pipelines to support large-scale data extraction, transformation, and processing across enterprise data environments.
  • Build and enhance scalable data warehousing solutions, ensuring efficient querying and management of massive datasets.
  • Lead end-to-end development of high-complexity monitoring, alerting, and data pipeline systems to proactively identify and prevent infrastructure issues.
  • Develop and optimize advanced SQL queries using technologies such as Presto, PostgreSQL, and MySQL.
  • Collaborate with attorneys, Data Scientists, and cross-functional technical teams to understand data requirements, identify relevant data sources, and deliver reliable data solutions.
  • Lead cross-functional engineering initiatives by defining project plans, coordinating stakeholders, preparing technical documentation, and driving successful implementation.
  • Identify opportunities to leverage AI and automation to streamline workflows, improve operational efficiency, and support non-technical stakeholders while maintaining strong privacy and security standards.
Internal Responsibilities
  • Attend regular internal practice community meetings.
  • Collaborate with your itD practice team on industry thought leadership.
  • Complete client case studies and learning material (blogs, media material).
  • Build out material to contribute to the Digital Transformation practice.
  • Attend internal itD networking events (in person and virtual).
  • Work with leadership on career fast-track opportunities.
Required Qualifications and Skills
  • 3+ years of professional experience in Data Engineering.
  • Expert-level proficiency in SQL, including experience with relational databases such as Presto, PostgreSQL, or MySQL.
  • Expert-level proficiency in Python.
  • Expert-level experience building, managing, and optimizing ETL/data pipelines.
  • Expert-level proficiency with workflow orchestration and data pipeline tools such as Apache Airflow or similar technologies.
  • Demonstrated experience leading end-to-end data engineering initiatives involving large, cross-functional teams and diverse technical and non-technical stakeholders.
  • Strong written and verbal communication skills, with the ability to communicate complex technical concepts clearly and concisely.
  • Experience navigating ambiguous requirements and independently driving technical projects to completion.
Preferred Qualifications and Skills
  • Demonstrated experience leveraging AI to accelerate project delivery or developing AI-powered solutions to automate workflows for non-technical stakeholders.
  • Experience working in highly regulated industries, including legal, compliance, finance, security, or privacy.
  • Previous experience supporting legal technology, eDiscovery, data privacy, or compliance-related initiatives.
  • Experience with data loss prevention and remediation.
  • Experience mentoring and supporting junior engineering team members.
  • Previous experience working in startups, small-to-mid-sized organizations, or environments requiring adaptability and broad ownership.
  • Experience working with attorneys, legal teams, or law firms through professional, internship, or volunteer experience.
Education

Bachelor’s degree in a relevant field or equivalent work experience required.

Company Description
About itD: We are part of a new generation of consulting and software development company that blends diversity, innovation, and integrity with real business results. Our structure rejects any strong hierarchy, empowering us to deliver excellent results. We are a woman- and minority-led firm. Every day, we challenge ourselves to be considerate, fair and to re-think what great outcomes mean for our customers. This permeates down to how we approach every interaction, on every project, for every client. You’ll thrive here if you are a dynamic self-starter, a difference-maker or someone who wants to deliver great results, without constraints.

The itD Digital Experience: Joining us means you’ll be part of our global community, you have a say about your own career journey, and you’ll get a chance to give back to causes that matter. You will experience working with Fortune 500 companies and high-performance teams across numerous industries. itD offers our employees excellent benefits such as medical, dental, vision, life insurance, paid holidays, 401K + matching, networking & career learning and development programs. We are growing and we want to see you grow! Visit https://itdtech.com/careers to learn more about what working at itD can mean for you.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability or protected veteran status, or any other legally protected basis, in accordance with applicable law. itD is committed to working with and providing reasonable accommodation to individuals with disabilities. If, because of a medical condition or disability, you need a reasonable accommodation for any part of the application process, or to perform the essential functions of a position, please contact us at [email protected] and let us know the nature of your request and your contact information.

Additional Info
Dynamic environment in a culture of respect, empowerment and recognition for a job well done, apply today!

HQ

itD Campbell, California, USA Office

300 Orchard City Dr, Campbell, California, United States, 95008 2946

itD San Francisco, California, USA Office

600 California St, San Francisco, California, United States, 94108 2704

Similar Jobs

11 Minutes Ago
Remote or Hybrid
United States
56K-76K Annually
Junior
56K-76K Annually
Junior
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Own customer support cases for Ivans digital products from initial contact through resolution. Troubleshoot configuration, data, integration, API, and potential product issues; perform root-cause analysis; guide onboarding and setup; document recurring solutions; and collaborate with Product, Engineering, and integration partners. Translate technical findings into clear customer communication and well-documented escalations.
Top Skills: APIsIvans Digital ProductsSaaSStructured Data Formats
Entry level
Events • Food • Travel • Hospitality • Hotels & Resorts
Provides professional massage and body treatments according to spa standards and guest preferences. Responds to guest requests, maintains clean and sanitized treatment areas, manages treatment supplies and inventory, completes required documentation, and supports daily spa operations while delivering exceptional hospitality.
48 Minutes Ago
In-Office
20-40 Hourly
Entry level
20-40 Hourly
Entry level
Events • Food • Travel • Hospitality • Hotels & Resorts
Cleans and maintains assigned guest rooms, including making beds, cleaning bathrooms, dusting, vacuuming, and deep cleaning. Replenishes linens and guest amenities, stocks and transports housekeeping supplies, responds courteously to guest requests, and disposes of waste and recyclables properly.

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account