SoFi Logo

SoFi

Senior Staff Software Engineer, AI Developer Experience

Posted An Hour Ago
Be an Early Applicant
Easy Apply
Hybrid
San Francisco, CA, USA
173K-297K Annually
Senior level
Easy Apply
Hybrid
San Francisco, CA, USA
173K-297K Annually
Senior level
Leads architecture and technical strategy for enterprise AI developer experience, including AI gateways, model routing, evaluation platforms, harness vending, and AI economics. Drives cross-team initiatives, resolves distributed-system bottlenecks, establishes engineering standards, leads incident response, evaluates AI tooling, and mentors senior and staff engineers. Requires hands-on experience with LLM architectures, model APIs, AI-assisted development tools, evaluation pipelines, dynamic routing, platform infrastructure, and infrastructure economics.
The summary above was generated by AI

Employee Applicant Privacy Notice

Who we are:

Shape a brighter financial future with us.

Together with our members, we’re changing the way people think about and interact with personal finance.

We’re a next-generation financial services company and national bank using innovative, mobile-first technology to help our millions of members reach their goals. The industry is going through an unprecedented transformation, and we’re at the forefront. We’re proud to come to work every day knowing that what we do has a direct impact on people’s lives, with our core values guiding us every step of the way. Join us to invest in yourself, your career, and the financial world.

The role:

SoFi's AI Platform team builds the foundation that lets every engineer at SoFi ship faster, safer, and with more leverage from AI. Our AI Developer Experience (AI DevEx) team owns SoFi's interactive coding strategy and the underlying infrastructure: AI economics, coding harnesses and harness vending, our evaluation platform, the AI Gateway, and intelligent model routing. 

As a founding Senior Staff Software Engineer, you'll be the technical lead and subject matter expert for this area across AI Platform: setting architecture, shaping the interactive coding strategy, and leading work across Autonomous Coding, CI/CD, Code Factory, and our customer engineering teams.

What you’ll do:

  • Set Technical Direction: Define and drive the architecture for the enterprise AI Gateway, model routing, automated evaluation platform, and harness vending, ensuring seamless support for interactive and autonomous workflows across multiple business units.

  • Shape Strategy & Roadmaps: Proactively identify systemic developer productivity bottlenecks, translate opportunities into a 12–24 month technical roadmap, and execute high-impact design and build initiatives.

  • Lead AI Economics Engineering: Architect cost models, metering systems, telemetry, and adaptive routing policies that balance model accuracy, latency, and operational spend across the engineering organization.

  • Drive Cross-Group Initiatives: Plan and technically lead initiatives spanning multiple engineering teams; establish shared interfaces and platform contracts with Autonomous Coding, CI/CD pipelines, and Code Factory.

  • Resolve Architectural Deficiencies: Identify and remediate root causes of complex architectural bottlenecks (latency, throughput, state management, dependencies) across distributed systems.

  • Evaluate Build-vs-Buy Choices: Continuously assess emerging AI tooling and foundational models, recommending vendor-neutral, future-proof integration patterns.

  • Represent Group Architecture: Lead department-level technical planning, establish architectural RFC standards, and facilitate rigorous design reviews across product areas.

  • Raise Operational Excellence: Set production standards for resilience, testing, and deployment; act as a lead incident resolver capable of coordinating responses to high-severity incidents and driving post-incident reviews to root-cause prevention.

  • Mentor & Elevate Talent: Actively coach and develop Senior (IC3) and Staff (IC4) engineers, cultivating an engineering culture of craft, ownership, and psychological safety.

What you’ll need:

  • Education & Minimum Experience Requirements: Bachelor’s Degree + 4+ Years of Experience OR Master’s Degree + 3+ Years of Experience in software engineering, computer science, or a related technical field.

  • Proven track record of technical leadership on software initiatives spanning multiple teams and complex distributed architectures.

  • Adept system design capability with large-scale, high-availability distributed systems, platform infrastructure, and cross-domain APIs.

  • Hands-on engineering experience building with LLM-based architectures, model APIs, and AI-assisted development tools (coding agents, developer harnesses, prompt/context evaluation, tool integration).

  • Hands-on experience designing or operating model evaluation pipelines, AI proxies/gateways, or dynamic routing systems.

  • Demonstrated ability to analyze infrastructure unit economics, capacity trade-offs, and operational telemetry.

  • Exceptional communication and cross-functional leadership skills, with a track record of driving technical alignment across engineering squads and leadership.

  • Commitment to engineering best practices, security guardrails, data privacy, and maintainable software design.

AI-Assisted Engineering Expectations:

  • Use AI tools responsibly to accelerate prototyping, explore new architectures, and streamline ramp-up across new domains.

  • Review AI-generated code and architecture critically, enforcing rigorous automated testing, safety, and long-term maintainability.

  • Adhere strictly to data-handling and security protocols to safeguard proprietary and member data.

  • Elevate team productivity by sharing effective AI development workflows, spec templates, and evaluation guardrails.

Nice to have:

  • Experience designing or scaling internal developer platforms (IDPs) and developer tooling at enterprise scale.

  • Practical exposure to FinOps frameworks for tracking and optimizing cloud or AI compute spend.

  • Direct experience developing autonomous agentic workflows or deep integrations into engineering development lifecycle tools.

  • Background in financial technology, banking platforms, or regulated engineering environments.

Compensation and Benefits
The base pay range for this role is listed below. Final base pay offer will be determined based on individual factors such as the candidate’s experience, skills, and location. 
 
To view all of our comprehensive and competitive benefits, visit our Benefits at SoFi page!
SoFi provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion (including religious dress and grooming practices), sex (including pregnancy, childbirth and related medical conditions, breastfeeding, and conditions related to breastfeeding), gender, gender identity, gender expression, national origin, ancestry, age (40 or over), physical or medical disability, medical condition, marital status, registered domestic partner status, sexual orientation, genetic information, military and/or veteran status, or any other basis prohibited by applicable state or federal law.The Company hires the best qualified candidate for the job, without regard to protected characteristics.Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.New York applicants: Notice of Employee RightsSoFi is committed to an inclusive culture. As part of this commitment, SoFi offers reasonable accommodations to candidates with physical or mental disabilities. If you need accommodations to participate in the job application or interview process, please let your recruiter know or email [email protected].We are unable to accommodate remote work from Hawaii, Alaska or Puerto Rico at this time.
Internal Employees
If you are a current employee, do not apply here - please navigate to our Internal Job Board in Greenhouse to apply to our open roles.
HQ

SoFi San Francisco, California, USA Office

Our new headquarters opened in 2019. The office provides an open work environment, an all-hands area, a café, library, coffee points on every floor, and executive conference rooms. The game room and roof-top lounge area provide space to take a break and look at the incredible downtown view.

Similar Jobs at SoFi

An Hour Ago
Easy Apply
Hybrid
San Francisco, CA, USA
Easy Apply
154K-264K Annually
Mid level
154K-264K Annually
Mid level
Fintech • Mobile • Software • Financial Services
Lead the design, development, and operation of SoFi’s AI developer experience platform, including AI Gateway, model routing, evaluation systems, harness vending, and cost telemetry. Establish engineering standards, guide architecture and cross-team execution, improve CI/CD and operational reliability, mentor engineers, and partner with internal developers to drive adoption of AI coding tools. Ensure secure, compliant use of AI systems and maintain the platform’s technical vision.
Top Skills: Ai-Assisted Developer ToolingAutonomous AgentsAWSCi/CdCloud InfrastructureContainerizationDistributed SystemsGCPGoJavaKotlinLlmsModel RoutingPrompt EngineeringPythonScala
3 Hours Ago
Easy Apply
Hybrid
San Francisco, CA, USA
Easy Apply
198K-341K Annually
Expert/Leader
198K-341K Annually
Expert/Leader
Fintech • Mobile • Software • Financial Services
Own the company-wide cloud networking strategy and architecture across AWS, multi-region and multi-cluster environments. Lead network automation, AI-enabled infrastructure operations, progressive delivery, observability, security standards, and major incident response. Partner with engineering, security, compliance, SRE, and executives to deliver resilient, scalable networking. Mentor senior technical staff and guide multi-year, cross-functional initiatives.
Top Skills: AIAWSBgpCdnDdos ProtectionDnsFfiecGoHTTPInfrastructure As CodeKubernetesL4/L7 Load BalancingMcp ServersNetwork AutomationPci DssPkiPythonService MeshesSoc 2Tcp/IpTlsWaf
Yesterday
Easy Apply
Hybrid
Easy Apply
173K-297K Annually
Senior level
173K-297K Annually
Senior level
Fintech • Mobile • Software • Financial Services
Leads the engineering organization building a scalable insurance platform. Owns technical vision, architecture, distributed services, API strategy, delivery, testing, observability, incident response, and security. Manages hiring, team structure, performance, and career development while partnering with Product, Design, Data Science, Compliance, Risk, and Operations. Drives zero-to-one product delivery, cross-functional alignment, responsible AI-assisted engineering, and communication of technical roadmaps to senior leadership.
Top Skills: Apache KafkaAWSCi/CdDistributed SystemsDockerGCPJavaKotlinKubernetesMicroservicesRest ApisSpring BootTerraform

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account