Macroscope Logo

Macroscope

Applied ML Engineer

Reposted One Month Ago
In-Office
San Francisco, CA, USA
170K-280K Annually
Mid level
In-Office
San Francisco, CA, USA
170K-280K Annually
Mid level
Build and improve ML systems powering core AI capabilities: create and maintain evaluation datasets, design experiments, train and fine-tune models (including RL approaches), analyze results to drive product decisions, participate in research, and partner with product and backend teams to integrate models into production.
The summary above was generated by AI
About Macroscope

Macroscope is building the infrastructure for the next generation of software development, where engineers direct fleets of agents, every change is automatically reviewed and verified, and organizations have a clear understanding of how their products and codebases are evolving.

Our mission is to give engineers more leverage and leaders more clarity, so teams can build better software, faster.

Macroscope is founded by former entrepreneurs who have started and sold multiple companies, and operated as product/engineering executives at public tech companies. We're fortunate to be supported by the best VC firms and angels in the business, including Lightspeed Venture Partners, Thrive Capital, Google Ventures, and Adverb.

About the role

We're looking for an Applied ML Engineer to improve the models and ML systems behind Macroscope's core AI capabilities. You'll work closely with our founders and engineering team to build evaluation datasets, run experiments, train and fine-tune models, and determine what meaningfully improves model performance.

You'll have ownership across the ML lifecycle, including model evaluation, reinforcement learning, and bringing new approaches into production. You'll also explore emerging research and training techniques that can push what's possible with AI for software engineering.

Our technology stack: TypeScript/React (front end), Golang (backend), Temporal, Google Cloud (GCP), Postgres, Terraform, and custom-built AST "code walkers" in Golang, TypeScript, Swift, Python, and Rust.

Qualifications
  • 3+ years of experience in applied machine learning, AI, or related engineering roles.

  • Experience building, training, fine-tuning, or evaluating modern ML models in production or research environments.

  • Experience with reinforcement learning for LLMs, including RLHF, RLAIF, GRPO, PPO, DPO, or similar techniques.

  • Strong experience with dataset creation, curation, benchmarks, labeling strategies, and evaluation methodologies.

  • Experience designing rigorous experiments and using results to improve model performance.

  • Familiarity with LLMs, reasoning models, and the evolving open-source model ecosystem.

  • Strong software engineering skills and experience building reliable ML pipelines and tooling.

  • Comfortable working in a fast-paced, high-agency startup environment.

  • Golang experience is a plus, but not required.

  • Bonus: Experience with distributed training, preference optimization, synthetic data generation, evaluation frameworks, GCP, Temporal, or internal ML tooling.

The base pay for the Applied ML Engineer position ranges from $170,000 to $280,000 per year. Pay is based on several factors and may vary depending on job-related knowledge, skills, and experience.

About you
  • You are extremely high agency. We are a small startup and we intend to keep an extremely flat organizational structure for as long as possible. Instead of relying on people managers, product managers and heavy processes, we rely on exceptionally talented individuals with high agency to be self-motivated towards contributing to our mission.

  • You want to work at an early stage startup. The default state of any startup is failure. The only way to overcome the daunting odds of making a startup venture successful is for a densely packed group of insanely hard working and talented people to work together to build something useful to and loved by customers. If you're not willing to work extremely hard on something high risk, this startup isn't for you.

  • You act like an owner. You put immense care and craft into what you build because you take responsibility for all parts of the product. You don't walk past broken windows.

  • You care about what we're building. Life's too short to work on something you're not passionate about. We are a small group of ambitious people who want to build something insanely great that we want to use, and that we think every company will want to use. If our mission and product don't resonate with you, we understand and would encourage you to find something that does.

HQ

Macroscope San Francisco, California, USA Office

103 Montgomery St, San Francisco, California, United States, 94129 1714

Similar Jobs

15 Days Ago
In-Office or Remote
7 Locations
277K-415K Annually
Expert/Leader
277K-415K Annually
Expert/Leader
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
Build and operate production machine learning systems for ranking, retrieval, recommendations, search, propensity, churn, LTV, and next-best-action decisioning. Design reliable signal contracts covering freshness, provenance, confidence, eligibility, and calibration. Lead feature pipelines, model serving, experimentation, monitoring, and feedback loops while evaluating fairness, risk, compliance, trust, and long-term customer impact. Collaborate across product, growth, data, platform, modeling, risk, and compliance teams.
Top Skills: Ai AgentsBatch PipelinesData LakehousesData WarehousesEmbeddingsEvent StreamsExperimentation SystemsFeature StoresJavaKotlinKubernetesLarge Language ModelsLightgbmModel-Serving InfrastructureObservability ToolingPythonPyTorchRecommendation SystemsSemantic SearchSQLTensorFlowWorkflow OrchestrationXgboost
16 Days Ago
Remote or Hybrid
7 Locations
277K-415K Annually
Expert/Leader
277K-415K Annually
Expert/Leader
Blockchain • Fintech • Mobile • Payments • Software • Financial Services
Build and operate production machine learning systems for ranking, retrieval, recommendations, search, propensity, churn, lifecycle intelligence, and next-best-action decisioning. Design reliable signal contracts with freshness, provenance, confidence, and calibration guarantees. Lead experimentation, monitoring, feedback loops, and impact evaluation focused on fairness, trust, risk, compliance, and long-term engagement. Partner across product, growth, data, platform, modeling, risk, and compliance teams.
Top Skills: JavaKotlinKubernetesLightgbmPythonPyTorchSQLTensorFlowXgboost
Yesterday
In-Office
2 Locations
232K-258K Annually
Senior level
232K-258K Annually
Senior level
Logistics • Transportation • 3PL: Third Party Logistics
Lead the technical strategy and architecture for foundation models powering search, recommendations, personalization, and conversational AI across Uber’s Mobility and Delivery products. Own cross-team initiatives involving retrieval, ranking, embeddings, and LLM assistants; guide build-versus-buy decisions; influence product strategy; deliver large-scale ML systems; and mentor senior engineers while connecting model improvements to business outcomes.
Top Skills: Conversational AiDistributed TrainingEmbedding ArchitecturesFoundation ModelsGenerative AiLarge-Scale Deep LearningPersonalizationPyTorchRanking SystemsRetrieval SystemsTransformers

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account