The role involves building and deploying AI-native data solutions, focusing on LLM and agent development, automation workflows, and data analysis, while leveraging cloud technologies.
About Prophecy
The leader in AI-native data preparation and analysis, Prophecy is revolutionizing how the world’s top enterprises turn data chaos into reliable insights. We introduce the AI-native data lifecycle (generate, refine, deploy) where our industry leading AI agents and humans work hand-in-hand in visual and document interfaces to analyze, transform and prepare data, to ship trusted insights at enterprise scale.
Don’t miss the rocket ship—join Prophecy and build the next data revolution.
Must-Have Skills:
- Hands-on LLM/agent building (e.g., LangChain/Graph, CrewAI) and tuning to quality benchmarks.
- Experience with semantic search, RAG, and vector databases.
- Experience with prompt engineering and optimization
- Agentic Use Cases: Hands-on experience building and deploying agents in at least one of the following scenarios:
- Workflow Orchestration: Automating multi-step processes (e.g., ETL pipelines, supply chain optimization, or CRM workflows like Salesforce Agentforce).
- Code Generation/Assistance: Developing or debugging code autonomously (e.g., similar to Devin AI or GitHub Copilot extensions).
- Data Analysis/Transformation: Querying, manipulating, or analyzing data across sources (e.g., topic extraction, document analytics in vector DBs like Weaviate).
- Personalized Assistance: Tailoring recommendations or plans (e.g., e-commerce, education, or finance agents).
- Autonomous Decision-Making: Real-time decisions in domains like trading or healthcare (e.g., crypto trading, medical workflow optimization).
- Content Creation: Generating text, art, or media (e.g., social media automation, presentation creation).
- Multi-Agent Systems: Collaborative agents for simulations or transactions (e.g., policy-constrained evaluation, machine-to-machine commerce).
- Versatile software developer: fluency in Python, REST APIs, microservices in public cloud; some experience with Go, AWS, k8s, java, Scala.
- Builder mentality: Demonstrated experience taking ideas to production.
What Will Make You Stand Out
- Expertise in building and managing Knowledge Graphs, including entity extraction, linkage, and ontology design.
- Experience integrating Knowledge Graph with AI systems for retrieval, reasoning, and agent context (e.g., enriching with LLM).
- ML/LLM work in code generation (e.g., Codex, text-to-SQL), semantic extraction, or knowledge graphs (e.g., Neo4j, Neptune).
- Experience with big-data engines like Spark.
- Compiler development for languages like SQL, Python, or Scala.
- Optimization of ML models for low-latency, high-throughput production use.
- Contributions to open-source AI/ML projects (e.g., Hugging Face, PyTorch).
- Expertise in retrieval systems or vector databases (e.g., Pinecone, Weaviate).
- Skill in evaluating tech and driving build/buy decisions
Seniority: Staff or Principal
Location: This is a Hybrid role with 2-3 days a week in office. However, this can vary week to week.
Experience: 6+ years of Software Engineering experience minimum with 2+ of these being in AI/ML
Compensation: $250,000–$350,000 + Additional Equity
Reflected is the base pay range offered for this position. Pay may vary depending on factors including but not limited to achievements, skills, experience, or work location. The range listed is just one component of the compensation package offered to candidates.
Benefits and Perks
- Prophecy covers 99% of employee health insurance premiums and 75% for dependents
- We offer $200 per month towards remote work, wellness, gyms, massages, facials, and more!
- Flexible PTO
- Professional development allowance
- Company sponsored Long Term Disability and Life Insurance, FSA/HSA, dental, vision, and more
- Ability to have your fingerprint on an innovative platform
- End-to-end ownership of your projects.
*Benefits and perks may vary per country
Prophecy is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, national origin, age, disability, or veteran status.
Prophecy San Francisco, California, USA Office
San Francisco, CA, United States, 94105
Similar Jobs
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Build, ship, and operate end-to-end production AI/ML solutions for vehicle diagnostics, prognostics, and test analytics. Implement ML pipelines on Azure/Databricks, develop observable ML services, ensure model/data observability, and collaborate with SMEs to embed models into engineering workflows while mentoring other practitioners.
Top Skills:
Ci/CdDatabricksExperiment TrackingAzureMlflowModel RegistriesPythonPyTorchScikit-LearnSparkSQLTensorFlow
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Lead end-to-end ML and perception efforts for future sensing in autonomous vehicles: design sensor architectures, multi-modal fusion, model development, metrics, simulation-driven evaluation, system integration, and production readiness while mentoring engineers and building scalable data and training infrastructure.
Top Skills:
SparkCameraLidarNumpyPandasPythonPyTorchRadarSimulationSynthetic Data
AdTech • Artificial Intelligence • Gaming • Machine Learning • Software • Virtual Reality • Metaverse
Lead design and productionization of computer-vision and multi-modal AI models (transformers, diffusion, VLMs, JEPA). Translate research to scalable training and low-latency deployments across cloud and on-device targets, define KPIs, mentor engineers, and align ML architecture with product and runtime constraints.
Top Skills:
3DgsAdrenoApple Neural EngineArm MaliClipCoremlDetrDiffusion ModelsDiffusion SamplersFlashattentionFp16)Int4Knowledge DistillationLinear-AttentionMetalMlirNerfOnnx RuntimeOpengl EsPruningPythonPyTorchQualcomm HexagonQuantization (Int8SamStable DiffusionTensorrtTfliteTransformersTvmVitVulkanXla
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
