Build and operate governed Finance data infrastructure on Databricks, including scalable pipelines, integrations, semantic layers, data-quality controls, observability, and AI-enabled services. Partner with analytics and enterprise teams on architecture, data contracts, security, recoverability, and production ownership. Optimize platform costs through FinOps practices and use AI coding assistants while validating performance, correctness, and security.
Shield AI is a venture-backed defense-tech company with the mission of protecting service members and civilians with intelligent systems. Its products include Hivemind autonomy software, V-BAT and X-BAT aircraft, and Aechelon simulation and synthetic reality technologies. With offices and facilities across the U.S., Europe, the Middle East, and Asia-Pacific, Shield AI’s technology actively supports operations worldwide. For more information, visit www.shield.ai. Follow Shield AI on LinkedIn, X, Instagram, and YouTube.
Shield AI is seeking a Data Engineer to build the reliable, governed data foundation for Finance's next generation of planning and decision support. Working on our Databricks platform, you will own reusable integrations, semantic-layer infrastructure, and production data services that support analytics and AI-enabled applications. You will combine engineering rigor with AI-assisted development to increase delivery speed, reliability, and cost efficiency.
What you'll do:
- Build and operate scalable pipelines and integrations connecting enterprise data to Finance products.
- Develop semantic-layer infrastructure and governed data access for analytics, planning, and AI applications.
- Establish end-to-end pipeline observability, data-quality controls, and resilient operations.
- Engineer the services and integrations behind Databricks Genie and other AI-enabled Finance workflows.
- Use AI coding assistants to accelerate development while validating correctness, security, and performance.
- Apply FinOps practices to manage platform spend and optimize cost without compromising service quality.
- Partner with analytics engineers and enterprise teams on architecture, data contracts, and sustainable ownership.
Required qualifications:
- Hands-on production data engineering experience with SQL and Python or PySpark.
- Experience with cloud data platforms, orchestration, data modeling, and governed serving patterns.
- Ability to design for observability, recoverability, security, and maintainability.
- Proficiency with AI coding assistants and independent validation of generated work.
- Practical experience enabling AI capabilities on enterprise data, ideally in Databricks; adjacent Snowflake Cortex or comparable experience is welcome.
- Strong cross-functional collaboration and production ownership.
Preferred qualifications:
- Experience with Databricks, Delta Lake, cloud infrastructure, and deployment automation.
- Experience developing AI application backends, model integrations, or LLM-based workflows.
- Experience with FinOps, financial data, or enterprise-system integrations.
#LI-RS3
#LB
Full-time regular employee offer package:
Pay within range listed + Bonus + Benefits + Equity
Temporary employee offer package:
Pay within range listed above + temporary benefits package (applicable after 60 days of employment)
Salary compensation is influenced by a wide array of factors including but not limited to skill set, level of experience, licenses and certifications, and specific work location. All offers are contingent on a cleared background and possible reference check. Military fellows and part-time employees are not eligible for benefits. Please speak to your talent acquisition representative for more information.
###
Shield AI is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, marital status, disability, gender identity or Veteran status. If you have a disability or special need that requires accommodation, please let us know.
Similar Jobs at Shield AI
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software • Defense Technology
Supports the design, integration, prototyping, testing, and release of mechanical systems for autonomous aircraft. Responsibilities include CAD modeling, drawings, bills of materials, tolerance analysis, engineering calculations, preliminary FEA, component selection, prototype testing, aircraft integration, troubleshooting, and root-cause analysis. Collaborates with multidisciplinary engineering, manufacturing, and test teams while completing defined tasks under guidance.
Top Skills:
3D CadFinite Element AnalysisFmeaGd&TMatlabMil-Std-810NxPythonRtca Do-160
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software • Defense Technology
Develop and maintain automated test frameworks, CI/CD pipelines, and validation infrastructure for distributed autonomy software and hardware systems. Build Python tooling, UI and API test automation, simulators, test harnesses, and hardware-in-the-loop solutions. Analyze failures, improve coverage and observability, and collaborate with engineering teams on verification strategies for safety-critical aerospace software. The role also evaluates AI-assisted development tools for test generation, debugging, log analysis, and workflow automation.
Top Skills:
APIsCC++Ci/CdClaude CodeCodexConanGitlab CiGoHardware-In-The-Loop (Hil)Large Language Models (Llms)LinuxNixPipPoetryPythonSetuptoolsShell ScriptingTypescriptYaml
Aerospace • Artificial Intelligence • Machine Learning • Robotics • Software • Defense Technology
Leads a distributed infrastructure team and owns strategy, architecture, operations, modernization, and lifecycle management across hybrid enterprise, data center, lab, manufacturing, and engineering environments. Oversees compute, storage, virtualization, servers, backup, disaster recovery, PLM infrastructure, vendors, budgets, incidents, security, compliance, and infrastructure readiness. Partners with cloud, network, cybersecurity, facilities, and application teams while developing technical talent and ensuring reliable, scalable services.
Top Skills:
Active DirectoryAnsibleBashCmmcCohesityDcimEntra IdHyper-VInfrastructure As CodeItarKvmLinuxNetappNist 800-171PowershellPythonTeamcenterTerraformVMwareWindows
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
