Astera Logo

Astera

Research Scientist: Hierarchical RL Agents

Reposted One Month Ago
Be an Early Applicant
Hybrid
Emeryville, CA, USA
150K-300K Annually
Expert/Leader
Hybrid
Emeryville, CA, USA
150K-300K Annually
Expert/Leader
Develop foundational principles of Artificial General Intelligence (AGI) and work on hierarchical reinforcement learning. Collaborate with neuroscientists and engineers to create scalable systems.
The summary above was generated by AI
Position Summary

We are seeking brilliant, unconventional thinkers to join us. In this role, you will not be chasing incremental gains on standard benchmarks. Instead, you will be tasked with developing the foundational principles of Artificial General Intelligence. We believe that understanding the "code of the brain" is the most viable path to building truly intelligent machines, and we are looking for scientists who can bridge the gap between biological intelligence, computational theory, and building at scale.

Core Responsibilities
  • Fundamental Research on Hierarchical World Model Learning from Experience: Develop and implement new architectures and learning/inference algorithms for hierarchical RL that supports hierarchical world modeling and hierarchical planning.

  • Ethologically constrained learning: Design tasks to evaluate the agent in ethologically constrained environments, and benchmark different agent designs. Design experiments to test hypotheses regarding high-level cognition, causal representations, sensory-motor integration, active inference, and unsupervised learning.

  • Cross-Disciplinary Collaboration: Work alongside neuroscientists and software engineers to translate abstract mathematical frameworks into scalable systems.

  • Contribute to Open Science: Help innovate new publication models that incentivize speedy dissemination, open source code releases, free open access, and impact measurements based on uptake.

Desired Qualifications
  • Technical Depth: Preferred: PhD in Computer Science, Electrical Engineering, Neuroscience, Physics, or a related quantitative field. We are always open to considering exceptional candidates, even those with non-traditional educational histories.

  • Theoretical Rigor: Strong foundations in deep learning, graphical models, and information theory.

  • Coding Proficiency: Expert-level skills in deep learning frameworks (PyTorch/JAX), with a focus on clean, reproducible research code.

  • AGI Mindset: A demonstrated interest in the "big questions" of AI—robustness, generalization, and common-sense reasoning.

  • Curious About the Brain: A genuine passion for exploring the computational and architectural principles of the mammalian brain.

  • Startup DNA: Ability to thrive in a lean, fast-paced environment where you have high autonomy and a direct influence on research direction.

Why Join Us?
  • We recognize the need for fundamental research: No pressure to align research with quarterly revenue goals, market competition, or product roadmaps. We can focus on solving the core problems and achieving breakthroughs that enable the next generation of AGI technology.

  • Mission-First: Your work contributes directly to the global pool of knowledge and the safe development of AGI.

  • Collaborative culture: We work in teams, organized around challenge problems and attack paths, without big-company inertia or politics.

Compensation

The posted salary range is based on location in the Bay Area. The successful candidate will receive a competitive compensation package, commensurate with their experience and location.

  • Benefits summary

Similar Jobs

27 Minutes Ago
Hybrid
15-22 Hourly
Junior
15-22 Hourly
Junior
eCommerce • Fashion • Retail • Sales • Wearables • Design
Provides customer service and sales support in a luxury retail store. Responsibilities include operating POS systems, handling cash, assisting customers, promoting products and gift cards, receiving and organizing shipments, replenishing inventory, maintaining stockrooms, supporting visual merchandising, and following loss prevention and housekeeping standards.
Top Skills: InternetIpadLaptopMobile PosPos SystemsWalkie-Talkie
3 Hours Ago
In-Office or Remote
Mountain View, CA, USA
145K-228K Annually
Senior level
145K-228K Annually
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead a global onboarding team for Atlassian's Teamwork Collection, driving early customer outcomes in the first 60–90 days through change management, success planning, technical guidance, risk mitigation, scaling onboarding programs, and cross-functional collaboration while maintaining operational excellence in Gainsight.
Top Skills: ConfluenceGainsightJIRASalesforceSuccess-AiTableau
4 Hours Ago
Hybrid
19-38 Hourly
Junior
19-38 Hourly
Junior
eCommerce • Fashion • Retail • Sales • Wearables • Design
Supports the Store Manager in driving sales, operational excellence, customer service, and team development. Responsibilities include forecasting, KPI management, recruiting and coaching employees, omnichannel engagement, scheduling, payroll and HR processes, loss prevention, visual merchandising, compliance, vendor relationships, and cross-functional collaboration. Requires flexible scheduling, physical ability to lift up to 50 pounds occasionally, and retail leadership experience.
Top Skills: Clienteling StrategiesMS OfficeOmnichannel ServicesRetail Systems

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account