Build and operate an on-prem AI platform (Model-as-a-Service) including RAG pipelines, vector DBs, MCP tooling, agent repositories, CI/CD integration, and guardrails within MRM. Optimize large on-prem GPU infrastructure and translate business use cases into scalable platform services.
Role Overview
We are looking for an AI Platform Engineer—a builder who can architect the "factory" where AI is made.
Our goal is to build an internal, on-premises AI ecosystem that mimics the capabilities of AWS or Azure. You will be responsible for creating a horizontal platform used by various lines of business to deploy AI projects simultaneously.
Key Responsibilities
- Platform Architecture: Design and develop a "Model-as-a-Service" platform that allows non-experts to use drag-and-drop components to build AI solutions.
- RAG-as-a-Service: Build and optimize end-to-end Retrieval-Augmented Generation (RAG) pipelines, including sophisticated chunking strategies and vector database management.
- Tooling & Libraries: Develop and maintain MCP (Model Control Protocol) libraries, clients, and servers to connect various data sources to the AI engine.
- Infrastructure Management: Help manage and optimize one of the largest on-premise GPU farms in the U.S. banking sector (500+ Nvidia nodes).
- Agentic AI: Build a repository for Agentic AI where users can select existing agents or build custom ones for specialized tasks.
- CI/CD Integration: Integrate AI deployment pipelines with enterprise-level CI/CD tools like Jenkins and Ansible.
- Compliance & Guardrails: Implement corporate-level guardrails and work within Model Risk Management (MRM) frameworks to ensure all AI deployments are secure and compliant.
Required Technical Skills
- Expert Python: Deep, hands-on knowledge is mandatory.
- Data Engineering: Extensive experience in massive data ingestion and processing.
- RAG Expertise: Deep understanding of vector databases, inferencing, and advanced chunking strategies.
- Platform Engineering: Proven experience building tools/platforms that other developers or business units use.
- Infrastructure Knowledge: Experience mimicking cloud capabilities (AWS/Azure) within a strictly on-premise environment.
- DevOps: Familiarity with Jenkins, Ansible, and automated deployment pipelines.
Experience & Qualifications
- Seniority: This is a senior-level role. We are looking for someone with a proven track record of building production-grade platforms (10-15+ years)
- Industry Knowledge: You must stay current with the "latest and greatest" in AI (e.g., rag-less inferencing, agentic frameworks).
- Problem Solver: Must be able to take a use case from a business unit and translate it into a scalable platform service.
- Experience with Scale: Experience working with large-scale GPU farms and high-volume data environments is highly preferred.
Compensation, Benefits and Duration
Minimum Compensation: USD 48,000
Maximum Compensation: USD 168,000
Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.
Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.
This position is available for independent contractors
No applications will be considered if received more than 120 days after the date of this post
Photon San Francisco, California, USA Office
San Francisco, United States
Similar Jobs
Information Technology • Internet of Things • Energy • Utilities • Infrastructure as a Service (IaaS) • Grid Utilities • Water Utilities
Lead new-business sales for CrescoNet’s managed AMI service across Florida, Georgia, and North Carolina. Build territory and pipeline plans, develop senior utility relationships, create complex new-logo opportunities, and manage deals from initial engagement through business case, contract, and first revenue. The role requires direct software or managed-services sales experience with US electric utilities, strong utility-industry knowledge, hands-on prospecting, and the ability to close complex opportunities independently.
Top Skills:
AdmsAmiAsset Management SystemsCisDermsGrid AnalyticsGrid CybersecurityGridwide OneHesMdmsOmsSaaSUtility IotWork Management Systems
Fintech • Financial Services
Manages affluent consumer and business relationships, acquires and deepens a book of business, and provides integrated guidance across deposits, lending, investments, credit, and banking services. Conducts discovery-based consultations, develops financial strategies, coordinates referrals with Wealth, Home Lending, and Business Banking, promotes digital adoption, supports branch colleagues, and maintains rigorous documentation, compliance, and risk controls.
Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Handle inbound calls and warm leads, consult customers on insurance needs, recommend appropriate property and casualty coverage, and convert prospects into policyholders. Complete paid training and obtain a Property and Casualty license if needed. Representatives must work designated weekday and weekend schedules, maintain a professional home workspace, and meet wired internet requirements.
Top Skills:
Cable InternetDslFiber InternetPcWired High-Speed Internet
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
