Curate web-scale datasets and design data synthesis pipelines to support foundation-model training. Develop automated data quality assessment, trace data impact on model capabilities, optimize data-model co-design, and contribute to research publications and conferences.
About the Institute of Foundation Models
We are a dedicated research lab for building, understanding, using, and risk-managing foundation models. Our mandate is to advance research, nurture the next generation of AI builders, and drive transformative contributions to a knowledge-driven economy.
As part of our team, you’ll have the opportunity to work on the core of cutting-edge foundation model training, alongside world-class researchers, data scientists, and engineers, tackling the most fundamental and impactful challenges in AI development. You will participate in the development of groundbreaking AI solutions that have the potential to reshape entire industries. Strategic and innovative problem-solving skills will be instrumental in establishing MBZUAI as a global hub for high-performance computing in deep learning, driving impactful discoveries that inspire the next generation of AI pioneers.
The Role
As a Research Scientist in the Data team, your primary responsibility is to curate high quality data at the web-scale to fuel the development of next generation foundation models. You will work on exploring andconsolidatingdata sources and collaborate with cross-functional teams to conduct in-depth data research, contributing to MBZUAI’s mission of driving impactful AI discoveries and positioning the institution as a leader in the global AI research community. Your expertise will be key in enhancing the performance of large-scale machine learning models, while supporting the development of transformative AI tools that can influence industries worldwide.
Key Responsibilities
- Pioneer web-scale data collection and curation methodologies for LLMs and multi-modal foundation models.
- Design and implement novel data synthesis pipelines for code, mathematics, and agentic reasoning datasets.
- Trace the impact of data from pre-training to final model capabilities and create automated quality assessment frameworks for massive datasets
- Design data recipes that maximize model capabilities across diverse domains.
- Optimize data-model co-design for improved training dynamics.
- Contribute to research papers and represent MBZUAI at industry conferences and events, showcasing the institution’s AI research and innovation.
Academic Qualifications
- Minimum: Master’s in Computer Science, Data Science, or a related technical field, or equivalent practical experience required.
- Preferred: PhD or equivalent research experience in Machine Learning, NLP, or Data Science with a focus on LLMs and data is preferred.
Professional Experience
- Experience working with large language models, including evaluation, fine-tuning, and prompt engineering.
- Strong Python development skills with a focus on research-grade code and scalable data pipelines.
- Familiarity with collecting and processing large-scale datasets from open-source and web resources.
- Demonstrated ability to work with ML infrastructure (e.g., model evaluation, optimization, debugging).
- Proactive mindset with the ability to identify impactful research questions and execute on them with minimal supervision.
- Effective communication and collaboration skills for working in cross-functional teams.
- Prior research experience in areas such as web data curation and mixing, synthetizing complex datasets for training, LLM evaluation, post-training data, efficient inference, LLM-as-a-judge, tokenization.
- Strong publication record in leading AI conferences (e.g., NeurIPS, ICLR, ICML, EMNLP) and/or prior contributions to open-source AI research or data tools.
- Hands-on experience training language/mutli-modal models from scratch.
Preferred
Visa Sponsorship
This position is eligible for visa sponsorship.
Benefits Include
*Comprehensive medical, dental, and vision benefits
*Bonus
*401K Plan
*Generous paid time off, sick leave and holidays
*Paid Parental Leave
*Employee Assistance Program
*Life insurance and disability
Similar Jobs
Artificial Intelligence • Healthtech • Machine Learning • Software
Lead end-to-end clinical outcomes research using large EHR datasets: design observational and quasi-experimental studies, run causal inference analyses, interpret results, publish findings, and partner with clinicians, data science, and commercial teams to shape product and demonstrate impact.
Top Skills:
Billing DataClaims DataEhr SystemsPython
Information Technology
Design, build, and own large-scale data pipelines and ML data curation for multimodal (text, image, audio, video) model training. Partner with research teams to ingest, label, filter, augment, store, and ensure dataset quality, compliance, and scalability. Optimize distributed data processing for training, prototype dataset tools, and integrate research advances into production systems.
Top Skills:
AWSAzureGCPHadoopPysparkPythonRaySparkSQL
Artificial Intelligence • Big Data
Design datasets and evaluation frameworks for foundation models, run experiments exposing failure modes across domains, improve annotator behavior, and develop quantitative metrics for dataset quality and downstream model impact. Partner with lab research teams to translate objectives into data and evaluation specs for RLHF/RLVR and LLM training pipelines.
Top Skills:
Dataset DesignEvaluation FrameworksLlmsReinforcement LearningReward ModelingRlhfRlvr
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
