Pulley (withpulley.com) Logo

Pulley (withpulley.com)

Applied AI Engineer

Posted One Month Ago
Hybrid
San Francisco, CA, USA
230K-350K Annually
Senior level
Hybrid
San Francisco, CA, USA
230K-350K Annually
Senior level
Build and own production AI features for permitting workflows, including document extraction, retrieval, agentic systems, evaluation, observability, deployment, and iteration. Define quality standards, improve LLM reliability, make product and architecture decisions, mentor engineers, and work directly with users. The role requires substantial production LLM experience and in-person work four days weekly in the San Francisco Bay Area.
The summary above was generated by AI

About Pulley

Pulley helps the country’s top architects, builders, and retailers speed up every project in their portfolio. With AI-powered permitting intelligence and expert guidance, we eliminate costly delays and bring predictability across the full lifecycle of commercial projects.

Today, permitting is the slowest, most uncertain part of building, spread across 19,000+ jurisdictions with different rules, timelines, and surprises. Pulley gives project teams the clarity and predictability they need to move from planning to opening without delays.

We support rollout programs for brands like J.Crew, Solidcore, and Hibbett Sports, as well as major data center buildouts, EV charging networks, and other commercial projects. Our platform dramatically reduces approval timelines, improves forecasting accuracy, and removes thousands of hours of manual work from design and construction teams.

Founded in 2021, Pulley combines deep permitting expertise with purpose-built AI from people who have created products used by millions. We’re backed by CRV, Susa Ventures, Fifth Wall, and leaders from Plaid, Segment, ServiceTitan, and Procore.

What You'll Do

In this role, you will build the intelligence behind the product that gets stuff built. Permitting runs on messy inputs—scanned plan sets, jurisdiction code, reviewer comments, application forms that differ in every city—and turning that into something fast, structured, and trustworthy is the core technical problem at Pulley. As a senior-level AI engineer, you will:

  • Own AI-powered features end-to-end—from talking to users and defining what “correct” means for a permitting workflow, through prompt and pipeline design, evals, deployment, and iteration in production

  • Turn unstructured permitting documents, city regulations, and jurisdiction workflows into structured, reliable outputs—extraction, classification, retrieval, and agentic workflows over documents that were never designed to be machine-readable

  • Build the evaluation and observability foundation that lets us ship LLM-powered features with confidence: define ground truth, measure quality and regressions, and know when a model change is actually an improvement

  • Build with AI agents as a daily practice—directing, reviewing, and shipping agent-driven work at high velocity while owning the quality bar

  • Make technical and product decisions that have direct impact on our customers and their projects

  • Raise the bar for the engineers around you in how they build with LLMs, through design review, mentorship, and the standards you set in your own work

Who You Are
  • You thrive in ambiguity—you’d rather define the right problem than execute a spec, and you’re energized rather than paralyzed when the path isn’t laid out

  • You’re product-minded: you care whether the thing you built actually solved the customer’s problem, and you’ll talk to users to find out

  • You’re rigorous about what “working” means—you don’t trust a demo, you trust an eval, and you build the measurement before you build the feature

  • You have strong opinions about quality and velocity and don’t treat them as a tradeoff—you look for the tools, abstractions, and processes that buy both

  • You default to ownership: when something is broken or missing, your instinct is to fix it, not to file it as someone else’s problem

Need to Have
  • 4+ years of software engineering experience, with a substantial portion building production LLM or ML systems

  • Track record of owning an LLM-powered product surface end-to-end: requirements through production, including the unglamorous parts—data quality, eval design, cost and latency, failure handling

  • Deep hands-on experience with large language models in production—prompting, retrieval-augmented generation, structured extraction, tool use and agentic workflows, and knowing when each is the wrong tool

  • Experience designing evals and otherwise making LLM-powered features reliable in production

  • Real experience building with AI coding agents—not just autocomplete; you’ve shipped work where agents did substantial implementation under your direction

  • Ability to architect durable systems while making pragmatic tradeoffs

  • Based in the San Francisco Bay Area and willing to work in person 4 days a week

Nice to Have
  • Experience with document understanding at scale—OCR, layout-aware parsing, or vision-language models over scanned PDFs, drawings, or forms

  • Experience fine-tuning models or building data pipelines to produce training and eval sets from real-world usage

  • Experience in construction tech, govtech, proptech, or another domain where the hard part is messy real-world documents and processes

  • Experience with modern full-stack development—we use TypeScript, React, and Google Cloud—and an appetite for working in the application code that puts AI features in front of users

  • Startup experience at the stage where you helped build the team, not just the product

  • Experience mentoring engineers or leading technical direction across teams

HQ

Pulley (withpulley.com) San Francisco, California, USA Office

535 Mission Street, San Francisco, CA, United States, 94105

Similar Jobs

4 Days Ago
In-Office
San Francisco, CA, USA
174K-212K Annually
Junior
174K-212K Annually
Junior
Artificial Intelligence • Machine Learning • Natural Language Processing • Software • Conversational AI
Build and ship production backend services and AI-powered voice agent features. Own customer problems end to end, develop reusable agent modules, improve menu and catalog accuracy, contribute to model fine-tuning, run experiments, and integrate solutions into production. The role involves close customer collaboration, rapid experimentation, and working across Kotlin, Python, and TypeScript in an in-person San Francisco environment.
Top Skills: Artificial IntelligenceAudio ProcessingCloud ComputingKotlinMachine LearningModel Fine-TuningPythonSpeech-To-TextText-To-SpeechTypescriptVoice Agents
14 Days Ago
Easy Apply
Remote or Hybrid
Santa Clara, CA, USA
Easy Apply
180K-225K Annually
Senior level
180K-225K Annually
Senior level
Cloud • Information Technology • Security • Software • Cybersecurity
Build and deploy secure, production-grade AI solutions for go-to-market teams using retrieval, structured-data querying, and agentic workflows. Partner with GTM leaders to define AI strategy, roadmaps, and build-versus-buy decisions. Establish monitoring, evaluation, security, and ROI frameworks tied to revenue outcomes. Drive adoption through enablement and feedback loops, develop reusable AI architecture and data connectors, improve engineering standards, and mentor other engineers.
Top Skills: A/B TestingAgent-To-Agent (A2A) FrameworksAgentic WorkflowsCloud PlatformsGraphragKnowledge GraphsLlm-As-JudgeModel Context Protocol (Mcp)PythonRegression TestingRetrieval-Augmented Generation (Rag)
20 Days Ago
Hybrid
San Francisco, CA, USA
157K-252K Annually
Senior level
157K-252K Annually
Senior level
Security • Software • Cybersecurity • Automation
Lead applied AI research focused on information retrieval, RAG, agentic workflows, ranking, reasoning, and evaluation. Build prototypes, golden datasets, quality metrics, regression detection, and experimentation frameworks; investigate failure modes and validate improvements through rigorous testing. Collaborate with AI and software engineers to productionize successful approaches and stay current with research in RAG, agents, LLM evaluation, and relevance modeling.
Top Skills: A/B TestingCross-EncodersEmbedding ModelsGenerative AiGraph Link PredictionHybrid SearchInformation RetrievalKnowledge GraphsLearning-To-RankLlm RerankersMachine LearningNlpPythonRagSemantic RoutingVector Databases

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account