Deccan AI Logo

Deccan AI

Founding Engineer - Machine Learning

Reposted 2 Days Ago
In-Office
Mountain View, CA, USA
Mid level
In-Office
Mountain View, CA, USA
Mid level
The Founding ML Engineer will build and scale machine learning systems, focusing on ML pipelines, model implementation, and collaboration with teams to drive measurable impact.
The summary above was generated by AI

About Us

Deccan AI is a model training and eval startup headquartered in the Bay Area. We are founded by IIT Bombay, IIM Ahmedabad and ex-Google alumni, and work with some of the top AI frontier labs in the world, e.g. Google Deepmind, Snowflake, and many more. We are backed by Prosus Ventures, and our India delivery office is in Hyderabad. Most of our roles are on-site i.e. Bay Area / Hyderabad.
About the Role

We’re looking for a Founding ML Engineer to build and scale core machine learning systems from the ground up. This is a hands-on role for someone who can move fast between experimentation and deployment — blending research intuition with engineering execution.

You’ll work closely with the founders to design, train, and ship production-grade ML models while setting the foundation for our technical culture, infrastructure, and research practices.

What You’ll Do
  • Build and optimize end-to-end ML pipelines — from data ingestion to deployment.

  • Implement and fine-tune LLMs, embeddings, and generative models for real-world applications.

  • Develop efficient training and inference systems leveraging distributed compute.

  • Partner with the data and product teams to translate ideas into measurable ML impact.

  • Contribute to model monitoring, evaluation, and continual learning frameworks.

  • Establish best practices in model versioning, reproducibility, and scalability.

What You’ll Bring
  • 3–7 years of experience as an ML Engineer / Applied Scientist / Research Engineer.

  • Proficiency in Python, PyTorch, TensorFlow, or JAX.

  • Strong grasp of ML fundamentals — data preprocessing, feature engineering, model training, and optimization.

  • Experience with distributed systems, cloud ML infra (AWS, GCP, or Azure), and MLOps tools (Weights & Biases, MLflow, etc.).

  • Comfortable working with large datasets and high-throughput systems.

  • Bias for action, ability to work autonomously, and eagerness to shape something from scratch.

Similar Jobs

13 Days Ago
In-Office or Remote
San Francisco, CA, USA
250K-395K Annually
Expert/Leader
250K-395K Annually
Expert/Leader
Big Data • Blockchain • Internet of Things • Software
Founding ML Performance Engineer will write custom CUDA kernels, optimize end-to-end model inference for sub-50ms latency, drive 10x stack performance (memory bandwidth, kernel fusion, scheduling), implement zero-copy multi-GPU/multi-node memory, own GPU utilization and memory management, profile and benchmark pipelines, and build performance tooling and standards.
Top Skills: CublasCudaCuda KernelsCuteFlash-AttentionInfinibandNcclNvlinkPyTorchPytorch DistributedRayRoceTensorrtTensorrt-LlmTilelangTritonVllm
13 Days Ago
In-Office or Remote
San Francisco, CA, USA
200K-350K Annually
Senior level
200K-350K Annually
Senior level
Big Data • Blockchain • Internet of Things • Software
Founding ML infrastructure engineer to design and scale a GPU compute platform (1,000+ GPU clusters), build multi-tenant scheduling and marketplace infrastructure, own production reliability, architect feature stores/model registries and experiment tracking, and develop resource orchestration and scheduling to optimize throughput, cost, and latency.
Top Skills: AWSAzureCustom SchedulersCuteGCPInfinibandKubernetesNcclRoceSglangSlurmTensorrt-LlmTilelangTritonVllm
14 Days Ago
In-Office
Menlo Park, CA, USA
Senior level
Senior level
Artificial Intelligence • Robotics • Industrial • Automation
Train, fine-tune, and deploy vision-language-action and robot manipulation models across the full pipeline. Handle data curation, pre-training and fine-tuning, sim-to-real distillation, debugging, evaluation, and iterative autonomous improvement on physical robots.
Top Skills: ActDiffusion PoliciesDistillation TechniquesDistributed TrainingFlow MatchingGemmaGenesisImitation LearningIsaac SimJaxLlavaMixed PrecisionMujocoOctoPaliPythonPyTorchRt-XSim-To-Real TransferVla Architectures (OpenvlaΠ₀)

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account