Pathway (pathway.com) Logo

Pathway (pathway.com)

AI Benchmark & Datasets Engineer/ Researcher Internship

Posted Yesterday
Be an Early Applicant
In-Office
Palo Alto, CA, USA
Internship
In-Office
Palo Alto, CA, USA
Internship
The intern will support benchmarking processes for model evaluation by curating benchmarks, running evaluations, documenting results, and contributing to public demos, influencing AI development at Pathway.
The summary above was generated by AI
About Pathway

Pathway builds the first post-transformer frontier model that solves AI's fundamental memory problem. While transformers wake up in the same state every time—like Groundhog Day—our architecture enables true continuous learning, infinite context reasoning, and real-time adaptation. We're not optimizing yesterday's technology; we're building what comes after transformers.

Our breakthrough architecture outperforms Transformer and provides the enterprise with full visibility into how the model works. Combining the foundational model with the fastest data processing engine on the market, Pathway enables enterprises to move beyond incremental optimization and toward truly contextualized, experience-driven intelligence. We are trusted by organizations such as NATO, La Poste, and Formula 1 racing teams.

Pathway is led by co-founder & CEO Zuzanna Stamirowska, a complexity scientist who created a team consisting of AI pioneers, including CTO Jan Chorowski who was the first person to apply Attention to speech and worked with Nobel laureate Geoff Hinton at Google Brain, as well as CSO Adrian Kosowski, a leading computer scientist and quantum physicist who obtained his PhD at the age of 20. 

The company is backed by leading investors and advisors, including Lukasz Kaiser, co-author of the Transformer (“the T” in ChatGPT) and a key researcher behind OpenAI’s reasoning models. Pathway is headquartered in Palo Alto, California.


The Opportunity

We are currently seeking AI Benchmark & Dataset Engineering interns to support the definition and execution of benchmarking processes for model evaluation.

You Will
  • Proactively identify, prioritize, and curate relevant public and client-driven benchmarks across our target use cases and markets.
  • Evaluate candidate benchmarks for clarity, data quality, evaluation methodology, and fit with our model roadmap.
  • Run benchmarks with baseline models to validate setup, uncover edge cases, and de‑risk R&D runs.
  • Hand off “benchmark-ready” packages to R&D (specs, data, evaluation scripts, expected metrics, constraints)
  • Maintain a shared vocabulary and documentation around benchmarks, datasets, and evaluation formats that GTM and R&D can both use.
  • Track and organize benchmark results, model leaderboards, and “what good looks like” for different customers and scenarios.
  • Contribute to demos and public‑facing proof points based on benchmark outcomes.

You will play a key role in defining and driving the benchmarking process for AI model evaluation. Your work will directly influence what we build, how we talk about it, and how customers and the market experience BDH.


Requirements

Cover letter

It's always a pleasure to say hi! If you could leave us 2-3 lines, we'd really appreciate that.

You are expected to meet at least one of the following criteria:

  1. You were an ICPC World Finalist, or an IOI, IMO, IOAI or IPhO medalist in High School.
  2. You have published a research paper at an A-rated o A*-rated venue (according to ICORE).
  3. You have completed coding projects - ideally with a GitHub repository showcasing previous work.
  4. You were an intern at a leading Machine Learning research center (e.g. at: Google Brain / Deepmind, Apple, Meta, Anthropic, Nvidia, MILA).
  5. You can get a warm recommendation from you university faculty member.

You

  • Have experience with ML/LLM evaluation, data science, or technical product roles, ideally around benchmarks or experimentation.
  • Are comfortable reading papers, leaderboards, and Github repos, and turning them into clear, repeatable benchmark specs.
  • Can talk comfortably with both engineers and customers, and translate between technical detail and business value.
  • Care about high‑quality data, reproducible experiments, and crisp documentation
  • Are respectful of others.
  • Are fluent in English.

Benefits

Why You Should Apply

  • Join an intellectually stimulating work environment.
  • During your internship, you will collaborate on a cutting edge research project.
  • Be a pioneer: you get to work with a new type of "Live AI" challenges.
  • Be part of one of an early-stage AI startup that believes in impactful research and foundational changes.

Further details
  • Preferable joining date: July 2026. The positions are open until filled – please apply immediately.
  • Duration: 3-6 months
  • Compensation: based on profile and location.
  • Location: Hybrid - regular presence in our office in Palo Alto, CA is required. Possibility to work or meet with other team members in one of our other offices: Paris, France or Wroclaw, Poland. As a general rule, permanent residence will be required in the EU, UK, US, or Canada.

If you meet our broad requirements but are missing some experience, don’t hesitate to reach out to us.

Top Skills

Git
Llm
Ml

Similar Jobs

53 Minutes Ago
In-Office
191K-253K Annually
Mid level
191K-253K Annually
Mid level
Aerospace • Artificial Intelligence • Hardware • Robotics • Security • Software • Defense
The Director of Business Development will lead initiatives to grow the UAS business line, generate opportunities, engage clients, and inform product development in a dynamic defense environment.
Top Skills: AIComputer VisionLattice OsSensor Fusion
53 Minutes Ago
Hybrid
75K-90K Annually
Entry level
75K-90K Annually
Entry level
Artificial Intelligence • Hardware • Information Technology • Security • Software • Cybersecurity • Big Data Analytics
The Applications Engineer-I supports sales engineering efforts by performing technical analysis, product development, and customer support, requiring some travel for in-person assistance.
Top Skills: C/C++LinuxMultimetersPythonSignal GeneratorsSpectrum AnalyzersTcp/Ip
53 Minutes Ago
Remote or Hybrid
United States
102K-169K Annually
Senior level
102K-169K Annually
Senior level
Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
The Senior Data Scientist will lead advanced analytics and AI/ML model development, collaborating on projects, mentoring junior members, and applying statistical expertise for strategic insights.
Top Skills: AWSPower BIPythonPyTorchScikit LearnSQLTableauTensorFlow

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account