Top Tech Jobs & Startup Jobs in San Francisco Bay Area, CA

Lead evaluation and automatic optimization for AI models and agents, including benchmarks, LLM judges, simulations, trajectory analysis, regression tests, synthetic data pipelines, and post-training systems. Diagnose failures and convert findings into improvements to prompts, context, tools, rubrics, and agent harnesses. Apply current LLM research to production, collaborate with retrieval and product teams, mentor engineers, and guide Nova’s technical direction.

Design and build production machine learning systems for personalization, recommendations, and campaign optimization. Own the full model lifecycle, including experimentation, feature engineering, distributed training, deployment, latency monitoring, and online testing. Build scalable data pipelines and model-serving architectures with Databricks, Spark, AWS, Ray, and Kubernetes. Partner with platform teams, mentor engineers, and guide technical direction for machine learning capabilities.

Lead development of Iterable Nova’s retrieval and search systems for AI agents. Build hybrid retrieval across structured and unstructured data, semantic query understanding, entity and embedding pipelines, multi-hop search subagents, and evaluation frameworks. Improve relevance and grounding through ranking metrics, LLM judges, human labeling, regression testing, and online experiments. Mentor engineers and guide technical direction while taking systems from research through reliable production deployment.

Oversee revenue recognition, commissions, month-end close, account reconciliations, deferred revenue, and cash conversion processes. Review SaaS contracts for ASC 606 compliance, partner with cross-functional teams on deal structures, support audits, and communicate technical accounting guidance. Drive automation and AI adoption, own revenue accounting projects, and build scalable close procedures, controls, and processes.

Lead FP&A for company-wide forecasting, reporting, annual planning, scenario modeling, and long-range financial strategy. Own R&D finance, including budgets, headcount, product revenue, bookings, cost of revenue, and ROI analysis. Partner with Product, Engineering, Commercial, and executive leadership on pricing, monetization, AI investments, and unit economics. Prepare executive and Board materials, improve reporting processes, and guide strategic decisions through rigorous financial modeling and analysis.