Role Summary:
We’re seeking a Staff Software Engineer with deep expertise in back-end development and scalable platform architecture. This role is ideal for someone passionate about building high-performance systems that enable AI innovation through robust infrastructure, intuitive tooling, and seamless integration of cutting-edge models. You’ll be at the forefront of operationalizing AI—designing services and data systems that empower teams to build, deploy, and iterate on intelligent applications with speed and reliability.
What you will be doing:
- Platform Architecture & Back-End Development:
Architect and implement microservices-based platforms with a strong focus on scalability, performance, and reliability. Develop core services using Python, Java, and Spring Boot, and ensure seamless integration with AI and data workflows. - Cloud & Containerization:
Build and deploy applications on AWS leveraging services for compute, storage, and networking. Implement containerized deployments using Docker and Kubernetes to support CI/CD pipelines and automated scaling. - Data Systems & ETL:
Collaborate with data engineering teams to design and optimize SQL-based data systems, ETL pipelines, and feature workflows that feed AI models at scale. - Reliability & Observability:
Drive platform reliability through monitoring, logging, and performance tuning. Implement best practices for CI/CD, automated testing, and infrastructure-as-code. - AI Tooling & Integration:
Build developer tools and abstractions for integrating LLMs and AI models, including orchestration services and prompting frameworks. - Innovation & Scalability:
Push the boundaries of platform scalability and performance, ensuring systems can handle large-scale data processing and high-throughput workloads.
Please note this is a hybrid role based out of our Palo Alto office and requires a minimum of 4 days in office.
What we are looking for:
- Bachelor’s or Master’s in Computer Science, Engineering, or related field.
- 8+ years of experience in back-end software engineering, with proven ability to design and scale distributed systems.
- Strong proficiency in Python and Java, with experience in Spring Boot and object-oriented design.
- Hands-on experience with AWS cloud services, Docker, and Kubernetes in production environments.
- Solid understanding of SQL databases, data modeling, and performance optimization.
- Familiarity with microservices architecture, CI/CD pipelines, and infrastructure automation.
- Excellent communication and collaboration skills across engineering and product teams.
Preferred:
- Experience with large-scale data pipelines (e.g., Apache Spark, Kafka).
- Knowledge of MLOps principles and AI/ML frameworks (TensorFlow, PyTorch).
- Certifications in cloud platforms or container orchestration.
- Awareness of AI ethics, data privacy, and security best practices
The anticipated annual pay scale for this position is $150,000-$250,000. Actual salaries will vary depending on factors including but not limited to location, experience, and performance. The range listed is just one component of Globality's total compensation package for employees. This information is provided per the California Equal Pay Act. We are an equal opportunity employer and a participant in the E-Verify program. We believe diversity makes teams better and that discrimination based on race, gender, or anything else is self-defeating.
Top Skills
Globality, Inc. Palo Alto, California, USA Office
395 Page Mill Road , Palo Alto, CA, United States, 94306
Similar Jobs
What you need to know about the San Francisco Tech Scene
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine


