BJAK Logo

BJAK

Principal Machine Learning Engineer

Posted Yesterday
Be an Early Applicant
Remote
Hiring Remotely in United States
Expert/Leader
Remote
Hiring Remotely in United States
Expert/Leader
Design, build, and operate large-scale ML systems across data, training, evaluation, inference, and deployment. Lead GPU-optimized training and inference pipelines, ensure reliability, performance, safety, and seamless integration into products. Own production deployments, monitoring, and cross-functional best practices to drive measurable model improvements and efficient research-to-production cycles.
The summary above was generated by AI
About A1

There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. Our mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows, with minimal prompting.

Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. The system must handle multi-step reasoning, interact with external tools, and remain reliable despite non-deterministic model behavior. Our objective is to help users complete tasks daily enjoyable with over ~90%* reduced time.

 
Role

As a Principal Machine Learning Engineer, you are a deep technical authority responsible for designing and evolving the most critical ML systems in the company.

You operate across training, inference, evaluation, and infrastructure, solving the hardest architectural and performance problems. While Technical Leads may own execution at the team level, you set the technical standard and shape how ML systems are built across the organization.

This is a hands-on, high-impact role focused on depth.

 
Focus
  • Architect and build large-scale ML systems spanning data, training, evaluation, inference, and deployment.

  • Design reproducible, high-performance training pipelines across GPU infrastructure.

  • Architect inference systems that balance latency, throughput, cost, and reliability at scale.

  • Design and maintain data systems for high-quality synthetic and real-world training data.

  • Implement evaluation pipelines covering performance, robustness, safety, and bias, in partnership with research leadership.

  • Own production deployment, including GPU optimization, memory efficiency, latency reduction, and scaling policies.

  • Collaborate closely with application engineering to integrate ML systems cleanly into backend, mobile, and desktop products.

  • Make pragmatic trade-offs and ship improvements quickly, learning from real usage.

  • Work under real production constraints: latency, cost, reliability, and safety

 
Requirements
  • Strong background in deep learning and transformer-based architectures.

  • Hands-on experience training, fine-tuning, or deploying large-scale ML models in production.

  • Proficiency with at least one modern ML framework (e.g. PyTorch, JAX), and ability to learn others quickly.

  • Experience with distributed training and inference frameworks (e.g. DeepSpeed, FSDP, Megatron, ZeRO, Ray).

  • Strong software engineering fundamentals – you write robust, maintainable, production-grade systems.

  • Experience with GPU optimization, including memory efficiency, quantization, and mixed precision.

  • Comfort owning ambiguous, zero-to-one ML systems end-to-end.

  • A bias toward shipping, learning fast, and improving systems through iteration.

 
Ideal Experience
  • Experience with LLM inference frameworks such as vLLM, TensorRT-LLM, or FasterTransformer.

  • Contributions to open-source ML or systems libraries.

  • Background in scientific computing, compilers, or GPU kernels.

  • Experience with RLHF pipelines (PPO, DPO, ORPO).

  • Experience training or deploying multimodal or diffusion models.

  • Experience with large-scale data processing (Apache Arrow, Spark, Ray).

 
Outcomes
  • ML systems (training, inference, evaluation) are reliable, scalable, and meet defined performance targets.

  • Models deployed to production achieve measurable quality improvements and meet user-impact goals.

  • Production issues are proactively monitored, debugged, and resolved with clear root-cause analysis.

  • Team and cross-functional collaborators benefit from clear guidance, best practices, and scalable ML solutions.

  • Research-to-production cycles are efficient, safe, and continuously improve the product experience.

 
How We Work

The best products today in the world were built by small, world class teams. We are a high talent density and hands-on team. We make decisions collectively, move at rapid speed, striking a balance between shipping high quality work and learning. Joining our team requires the ability to bring structure, exercise judgment, and execute independently. Our goal is to put in hands of our users a truly magical product

 
Interview process

If there appears to be a fit, we'll reach to schedule 3, but no more than 4 interviews.

Applications are evaluated by our technical team members. Interviews will be conducted via virtual meetings and/or onsite.

We value transparency and efficiency, so expect a prompt decision. If you've demonstrated the exceptional skills and mindset we're looking for, we'll extend an offer to join us. This isn't just a job offer; it's an invitation to be part of a team that's bringing AI to have practical benefits to billions globally.

Similar Jobs

8 Days Ago
Remote
US
283K-453K Annually
Senior level
283K-453K Annually
Senior level
Cloud • Fintech • Food • Information Technology • Software • Hospitality
Lead technical direction and deliver large-scale ML platform infrastructure including feature store, model serving, experimentation, and training pipelines. Drive architecture, mentor engineers, coordinate cross-team initiatives, resolve system-wide issues (latency, reliability, GPU utilization), and define safe ML deployment paths from registration through rollout, monitoring, and rollback.
Top Skills: DatabricksFlinkGpuJavaKafkaKotlinLlmsMlflowSagemakerSpark StreamingTecton
19 Hours Ago
In-Office or Remote
174K-274K Annually
Expert/Leader
174K-274K Annually
Expert/Leader
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead technical strategy and multi-year roadmap for search and vector infrastructure powering Atlassian AI. Drive cross-team initiatives for semantic search, agentic retrieval, and RAG; ensure scalable, cost-effective ML serving with strong reliability and FinOps discipline; mentor senior engineers and raise organizational engineering craft.
Top Skills: Agentic RetrievalAi GatewayConfluenceDistributed SystemsEmbeddingsFinopsJIRAMl ServingProduction Ml ServingQuery Embedding CachingRetrieval-Augmented Generation (Rag)RovoSearch ServingSemantic SearchSlosVector DatabasesVector InfrastructureVector Search
3 Days Ago
Remote
USA
195K-217K Annually
Expert/Leader
195K-217K Annually
Expert/Leader
Healthtech • Software
Lead technical vision and roadmap for a company-wide ML platform: define reference architectures, MLOps best practices, security, observability, and integrations; mentor engineers and drive cross-team platform initiatives.
Top Skills: AWSAzureAzure Machine LearningDatabricksDockerGCPJavaKubeflowKubernetesMlflowModel-Serving FrameworksPythonRay

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account