Build scalable backend services and APIs (Python/Go) for enterprise AI deployments. Work on distributed systems, databases, cloud integrations, observability, and production reliability while collaborating with product and AI teams.
About Realm Labs
What You’ll Do
What We’re Looking For
Technologies We Use
What We Value
Why Join Realm Labs?
Realm Labs is building the infrastructure that makes AI safe for enterprises. Our platform helps organizations securely deploy, monitor, and govern AI applications through real-time detection, policy enforcement, and security controls.
Our systems process billions of AI tokens across production workloads and solve challenging problems in distributed systems, inference infrastructure, security, and developer tooling.
We’re a small, engineering-driven team where every engineer owns meaningful pieces of the product and works directly with customers.
As a Software Engineer at Realm Labs, you’ll build production systems that power enterprise AI deployments. Your work will span backend services, distributed systems, infrastructure, and customer-facing features.
Responsibilities include:
- Design and build scalable backend services in Python or Go.
- Develop APIs and internal services used by enterprise customers.
- Work with distributed systems, asynchronous processing, and message queues.
- Design efficient database schemas and optimize query performance.
- Build reliable integrations with cloud services and AI platforms.
- Debug production issues and improve system reliability and observability.
- Collaborate closely with product, infrastructure, and AI engineers to ship features quickly.
- Participate in code reviews and help maintain a high engineering bar.
What We’re Looking For
Required
- 2+ years of professional software engineering experience.
- Strong programming skills in Python, Go, Java, C++, or a similar language.
- Solid understanding of computer science fundamentals, including:
- Data structures and algorithms
- Operating systems
- Concurrency and multithreading
- Experience designing and consuming REST or gRPC APIs.
- Experience working with relational databases such as PostgreSQL or MySQL.
- Understanding of distributed systems concepts such as replication, consistency, caching, partitioning, queues, and fault tolerance.
- Experience with cloud platforms (AWS, GCP, or Azure).
- Strong debugging and problem-solving skills.
- Excellent communication skills and ability to work in a fast-moving startup.
Nice to Have
- Experience building distributed systems at scale.
- Experience with Docker and Kubernetes.
- Familiarity with Redis, RabbitMQ, Kafka, or similar technologies.
- Experience with observability tools (OpenTelemetry, Prometheus, Grafana).
- Experience with AI/LLM infrastructure.
- Experience working in startups or shipping customer-facing products.
Technologies We Use
You don’t need experience with everything below, but you’ll likely work with many of them:
- Python
- Go
- PostgreSQL
- Redis
- Docker & Kubernetes
- AWS, GCP, Azure
- FastAPI
- Terraform
- GitHub Actions
- OpenTelemetry
- LLM APIs and inference infrastructure
What We Value
We’re looking for engineers who:
- Take ownership from idea to production.
- Care about writing clean, maintainable code.
- Think systematically about reliability and scalability.
- Enjoy learning new technologies.
- Move quickly without sacrificing quality.
- Are excited about building products in the AI infrastructure and security space.
Why Join Realm Labs?
- Build foundational infrastructure for the next generation of AI applications.
- Solve challenging distributed systems and infrastructure problems.
- Work directly with experienced engineers from companies like Google, Apple, Microsoft, and leading security organizations.
- High ownership with significant impact from day one.
- Competitive salary and meaningful equity.
- Opportunity to help define the future of enterprise AI security.
Similar Jobs
Artificial Intelligence • Big Data • Healthtech • Machine Learning • Analytics • Biotech • Generative AI
Lead design and development of Java/Spring and React applications for genomic variant identification and clinical reporting. Architect data models, APIs, and search strategies for large-scale variant data. Partner with scientific and clinical experts, drive technical direction, mentor engineers, troubleshoot production issues, and improve reliability, observability, and performance.
Top Skills:
Ai-Assisted Development ToolsAWSAzureCi/CdDynamoDBElasticsearchGCPJavaMongoDBMySQLOpensearchPostgresReactRestful ApiSpring
Big Data • Cloud • Software • Database
Build and maintain agent skills, tooling, and evaluation infrastructure: CLIs, libraries, CI workflows, metrics, safety gates, and observability for agent behavior. Design evaluation datasets, investigate failures, and collaborate with product and security teams to ship reliable, reusable internal systems.
Top Skills:
C#Ci/CdClisGithub ActionsGoJavaJavaScriptLlmsMongoDBPythonStatic AnalysisTypescript
.png)
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Design, build, and operate cloud-native, device-agnostic distributed systems using Go. Own architecture decisions, mentor engineers, promote testing and clean code, diagnose production issues, collaborate on roadmaps, and work with SRE to automate and improve reliability.
Top Skills:
Cloud-NativeDistributed SystemsGoMicroservice ArchitectureTest Driven Development (Tdd)
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
