Build and operate an AWS-native data lake and AI gateway. Implement and maintain lakehouse architecture (Iceberg) using Glue, Athena, and S3; manage infrastructure as code (Terraform); run reliable data pipelines; operate LLM gateway/Bedrock; enforce security, IAM, networking, and secrets controls; partner with IT and Security.
Role
Build and operate Sembi's AWS-native data lake and AI gateway. This is a hands-on IC role focused on infrastructure-as-code, cloud data services and the platform layer that supports internal AI enablement. You will own the plumbing that makes data and model access reliable, secure, and self-service for the rest of the org.
What you'll do- Build and maintain the AWS-native lakehouse foundation using Python, Glue, Athena and S3, including medallion-style layering from raw through curated tables (Iceberg).
- Manage all infrastructure through code (Terraform or equivalent), with version control, review, and repeatable deployments as the default.
- Build and maintain data pipelines that move and transform data into the lake reliably, with monitoring and clear failure handling.
- Operate/support the internal AI platform including LLM gateway, Bedrock, custom utilities and zero-trust access controls.
- Enforce security and access baselines across data and model layers, including IAM scoping, network controls, and secrets handling.
- Partner with IT, Security, and Engineering to keep the platforms aligned with broader operations standards.
- Strong infrastructure-as-code experience (Terraform or equivalent) as a primary way of working, not an afterthought.
- Solid AWS fundamentals across IAM, networking (VPC, PrivateLink), and S3.
- Proficiency in Python for data pipelines, automation and tooling.
- Comfort operating production infrastructure independently as an IC and managing work through an Agile process.
- Platform experience with LLM gateways, API proxies, or Bedrock/model-serving infrastructure.
- Data engineering depth: pipeline design, Glue/Athena, and lakehouse patterns.
- You default to automation and reproducibility over manual fixes.
- You are direct about tradeoffs and gaps rather than papering over them.
- You can work independently across time zones while keeping CST hours for collaboration.
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Leads complex enterprise AI deployments and high-stakes go-live engagements, owns deployment playbooks and shared tooling, mentors engineers, establishes quality standards, captures reusable deployment knowledge, and partners with product and engineering teams. The role requires hands-on software development, customer-facing communication, AI and GenAI integration, prompt engineering, and production delivery experience.
Top Skills:
Ai AgentsGenerative AiJavaJavaScriptNow AssistPrompt EngineeringPython
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Leads global system integrator partnerships through joint business planning, executive alignment, co-selling, partner enablement, governance, and strategic solution development. Drives sourced and influenced revenue, pipeline expansion, deal collaboration, and multi-year growth plans across ServiceNow, partners, field sales, and customer outcome teams. Represents the partnership internally and externally while overseeing global-regional teams and operational execution.
Top Skills:
AIAutomationCloud ComputingSaaSServicenow
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Build and productionize AI agents, assistants, models, and reusable skills for Armis and its customers. Rapidly develop MVPs, collaborate with engineering to harden systems, and implement rigorous evaluations for quality, safety, and reliability. Design secure agentic workflows with guardrails and isolation, select appropriate frameworks and models, establish reusable AI development practices, consult across the organization, and document solutions for operation and evaluation.
Top Skills:
Ai AgentsAPIsAWSAzureClaude SdkDockerGoogle Ai SdkGoogle Cloud PlatformKubernetesMulti-Agent SystemsOpenai SdkPythonRetrieval-Augmented GenerationSkill.Md
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
