Multiple employees collaborating on work
Atlassian Logo

Atlassian

Senior Machine Learning Engineer

Reposted 6 Days Ago
In-Office or Remote
Hiring Remotely in 94104, San Francisco, CA, USA
171K-269K Annually
Senior level
In-Office or Remote
Hiring Remotely in 94104, San Francisco, CA, USA
171K-269K Annually
Senior level
Build and lead production machine learning and evaluation systems for Atlassian’s Rovo AI agents. Responsibilities include developing datasets, simulations, automated judges, experimentation platforms, and quality signals; advancing reasoning, planning, retrieval, memory, and tool use; identifying and correcting systemic failures; and balancing quality, safety, latency, reliability, and cost. The role requires hands-on technical leadership, cross-functional influence, architectural decision-making, mentorship, and delivery of measurable customer outcomes at scale.
The summary above was generated by AI
Engineering | San Francisco, United States | Remote, Remote
Working at Atlassian
Atlassians can choose where they work - whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity.Your future team
Atlassian is betting that the next era of teamwork will be shaped by people and AI agents working together, with Rovo as the intelligent teammate that understands an organization's context and helps move work forward. Turning Rovo's reach into lasting customer value, experiences people trust, return to, and rely on, is central to Atlassian's ambition to lead in AI and to our next chapter of growth. Getting quality right is what turns that ambition into customer success, deeper adoption, and durable business impact.
You'll join the Rovo Chat Quality team within Atlassian's Rovo + AI organization. We are the team that turns "make Rovo better" into something we can measure, understand, and ship. We build the evaluation systems, datasets, quality signals, and production ML capabilities that reveal where Rovo succeeds, where it falls short, and which changes make it meaningfully more useful to customers.
What you'll do
As a Senior Machine Learning Engineer, you'll tackle the open-ended technical problems that determine whether customers trust Rovo with increasingly complex and consequential work. You'll remain deeply hands-on while setting direction across teams: driving advances in models, agents, and evaluation and turning them into measurable improvements for millions of active users.
  • Architect and build production ML and evaluation systems that operate at scale, including datasets, simulations, automated judges, regression suites, experimentation platforms, and online quality signals.
  • Advance the state of Rovo's agentic capabilities across reasoning, planning, tool selection and use, action correctness, retrieval, memory, and long-horizon execution.
  • Close the loop between evaluation and product impact: identify systemic failure modes, develop interventions, ship them to production, and establish whether they improved customer outcomes.
  • Make high-leverage technical decisions across model choice, prompting, fine-tuning, data strategy, system architecture, and inference; balancing quality with latency, reliability, safety, and cost.
  • Lead ambitious, cross-organizational initiatives with ML, engineering, product, analytics, research, and design partners, creating clarity and momentum where neither the problem nor the solution is well defined.
  • Establish reusable methods, systems, and quality standards that raise the bar not only for Rovo Chat, but for AI-powered experiences across Atlassian.
  • Multiply the impact of other engineers through technical leadership, design reviews, mentorship, and a compelling long-term vision for how we build and evaluate world-class AI products.

Your background
We expect you to bring:
  • A track record of architecting and shipping large-scale ML or AI systems that deliver measurable customer and business impact.
  • Deep experience with LLM-powered products, agentic systems, model evaluation, experimentation, and dataset development.
  • Strong production engineering skills and the ability to remain hands-on in a modern ML stack.
  • Technical leadership: setting direction, influencing across teams, and leading complex initiatives from ambiguity to production.
  • Excellent product and technical judgment, including balancing quality, speed, reliability, safety, latency, and cost.
  • The ability to communicate complex ideas clearly and raise the effectiveness of engineers around you through mentorship and technical leadership.

At Atlassian, we strive to design equitable, explainable, and competitive compensation programs. We follow consistent hiring practices and account for each candidate's skills, knowledge, and experience when setting base pay within the range.
Please visit
HQ

Atlassian San Francisco, California, USA Office

Atlassian believes the future of work is distributed and offers our people the flexibility to help them do what’s important to them. And with few exceptions, we hire people anywhere we have a legal entity as long as they have eligible work rights and sufficient team time zone overlap.

Atlassian Mountain View, California, USA Office

301 E Evelyn Ave., Mountain View, CA, United States, 94041

Similar Jobs at Atlassian

6 Days Ago
In-Office or Remote
3 Locations
171K-269K Annually
Senior level
171K-269K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Develop and deploy machine learning and LLM capabilities for agentic search, query understanding, search planning, and retrieval. Build evaluation datasets, improve model behavior through experimentation and fine-tuning, and optimize quality, latency, cost, and reliability. Collaborate across search, product, infrastructure, and AI teams while owning projects through production and mentoring engineers.
Top Skills: AWSDatabricksInformation RetrievalLarge Language Models (Llms)Machine LearningNatural Language Processing (Nlp)PythonRetrieval-Augmented Generation (Rag)Search RelevanceSpark
6 Days Ago
In-Office or Remote
3 Locations
171K-269K Annually
Senior level
171K-269K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Develop and deploy scalable machine-learning solutions, particularly deep-learning forecasting models for company top-line metrics. Lead the full ML lifecycle from problem definition and experimentation through production deployment and improvement. Design production-grade architectures, evaluate and improve models, collaborate with cross-functional teams, explain technical concepts to varied audiences, and mentor junior engineers.
Top Skills: Deep LearningMachine LearningMachine Learning Infrastructure
6 Days Ago
In-Office or Remote
94104, San Francisco, CA, USA
171K-269K Annually
Senior level
171K-269K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Build and operate scalable machine learning systems for personalized recommendations, growth journeys, cross-product expansion, and sales experiences. Design models, datasets, features, evaluation frameworks, and decisioning services; run offline policy evaluations and online experiments; and monitor attribution, latency, quality, and fairness. Partner with product, engineering, data science, analytics, marketing, and sales teams to turn ambiguous growth opportunities into measurable production capabilities and strategic ML initiatives.
Top Skills: SparkAWSDatabricksJavaPythonSQLTypescript

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account