Build and operate an AWS-native data lake and AI gateway. Implement and maintain lakehouse architecture (Iceberg) using Glue, Athena, and S3; manage infrastructure as code (Terraform); run reliable data pipelines; operate LLM gateway/Bedrock; enforce security, IAM, networking, and secrets controls; partner with IT and Security.
Role
Build and operate Sembi's AWS-native data lake and AI gateway. This is a hands-on IC role focused on infrastructure-as-code, cloud data services and the platform layer that supports internal AI enablement. You will own the plumbing that makes data and model access reliable, secure, and self-service for the rest of the org.
What you'll do- Build and maintain the AWS-native lakehouse foundation using Python, Glue, Athena and S3, including medallion-style layering from raw through curated tables (Iceberg).
- Manage all infrastructure through code (Terraform or equivalent), with version control, review, and repeatable deployments as the default.
- Build and maintain data pipelines that move and transform data into the lake reliably, with monitoring and clear failure handling.
- Operate/support the internal AI platform including LLM gateway, Bedrock, custom utilities and zero-trust access controls.
- Enforce security and access baselines across data and model layers, including IAM scoping, network controls, and secrets handling.
- Partner with IT, Security, and Engineering to keep the platforms aligned with broader operations standards.
- Strong infrastructure-as-code experience (Terraform or equivalent) as a primary way of working, not an afterthought.
- Solid AWS fundamentals across IAM, networking (VPC, PrivateLink), and S3.
- Proficiency in Python for data pipelines, automation and tooling.
- Comfort operating production infrastructure independently as an IC and managing work through an Agile process.
- Platform experience with LLM gateways, API proxies, or Bedrock/model-serving infrastructure.
- Data engineering depth: pipeline design, Glue/Athena, and lakehouse patterns.
- You default to automation and reproducibility over manual fixes.
- You are direct about tradeoffs and gaps rather than papering over them.
- You can work independently across time zones while keeping CST hours for collaboration.
Similar Jobs
Fintech • Financial Services
Lead the design and execution of global total rewards programs, including compensation bands, benefits strategy, equity and incentive plans, job leveling, pay equity, and annual compensation cycles. Advise executives, HR business partners, and talent acquisition using market data, financial modeling, and internal equity analysis. Optimize total rewards systems and programs across a growing global organization.
Top Skills:
CandoriqPavePayscaleRippling
Healthtech
Build and maintain Customer Success and Implementation playbooks, SOPs, training programs, knowledge bases, presentation materials, and scalable workflows. Partner cross-functionally to communicate process and product changes, improve automation and efficiency, identify customer risks, and measure enablement effectiveness. Support implementation, launch readiness, customer health, escalations, business reviews, renewals, and expansion.
Top Skills:
NotionSalesforce
AdTech • Digital Media • Marketing Tech • Mobile
Own full-cycle global recruiting for technical, product, sales, business, and operational roles. Source and evaluate candidates, advise hiring managers, manage interview processes, and maintain hiring momentum. Oversee recruiting vendors and a global sales consultant program, including contracts, onboarding, CRM tracking, documentation, and follow-up. The role requires independent judgment, strong communication, business acumen, discretion, and experience working across time zones in a distributed company.
Top Skills:
CRM
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
