Build and maintain scalable data pipelines and Python automations for ingesting, processing, and enriching data. Integrate SaaS sources via APIs, use Databricks/PySpark/Delta Lake and AI tools to power lead generation, enrichment, deduplication, and entity resolution. Collaborate cross-functionally to translate business needs into automated, production-ready solutions.
About the Role
RequirementsTechnical Skills
BenefitsWhat We Offer:
We're looking for an AI-Enabled Data & Automation Engineer who thrives on solving complex data challenges through software and automation.
You'll be responsible for building scalable data pipelines, integrating data from multiple SaaS platforms, developing automation that powers lead generation and enrichment, and leveraging AI to dramatically accelerate development. You'll work with modern technologies including Python, Databricks, and LLM-powered tools to build solutions that directly impact business growth.
This role is ideal for someone who enjoys building, experimenting with new technologies, and continuously finding better and faster ways to solve problems.
Responsibilities- Design, build, and maintain scalable data pipelines for ingesting, processing, and enriching large datasets.
- Develop Python-based automation for data collection, transformation, validation, and workflow orchestration.
- Build and optimize data processing workflows using Databricks, PySpark, SQL, and Delta Lake.
- Integrate and process data from multiple SaaS platforms through REST APIs and other integrations.
- Develop scalable workflows for lead generation, company and contact enrichment, and sales intelligence.
- Implement processes for data cleansing, deduplication, entity resolution, normalization, and contact/company matching.
- Process structured, semi-structured, and JSON data from a variety of internal and external sources.
- Collaborate with product, engineering, and go-to-market teams to translate business requirements into scalable technical solutions.
- Identify opportunities to automate repetitive processes and improve operational efficiency.
- Continuously evaluate and adopt new AI tools and technologies that improve development speed and data quality.
RequirementsTechnical Skills
- 3–7+ years of experience in Data Engineering, Marketing Operations, Sales Operations, or a related technical field.
- Strong Python programming skills with experience in data processing, automation, and API integrations.
- Experience with Databricks, PySpark, SQL, and Delta Lake.
- Experience integrating and processing data from multiple SaaS platforms via APIs.
- Strong understanding of lead enrichment, data quality, deduplication, entity resolution, and contact/company matching.
- Experience working with structured, semi-structured, and JSON data.
- Familiarity with Git and modern software development practices.
- Undergraduate Degree in Computer Science, Engineering, Physics or other relevant degree
- Heavy user of AI coding tools such as Cursor, Claude Code, GitHub Copilot, ChatGPT, or similar AI development assistants.
- Demonstrated ability to leverage AI to accelerate software development, automate workflows, improve data quality, and increase productivity.
- Comfortable rapidly prototyping, testing, and iterating using AI-assisted development.
- Hands-on experience with lead generation and sales intelligence platforms such as Apollo, Clay, LinkedIn Sales Navigator, ZoomInfo, or similar tools.
- Experience with CRM platforms such as Salesforce or HubSpot.
- Familiarity with LLM APIs and AI-powered applications.
- Experience working in fast-paced startup environments.
- Strong communication skills with the ability to work cross-functionally and take ownership from concept through delivery.
Plum AI, Inc looks forward to applicants from US based candidates. We are not working with outside recruiters. We appreciate individual, not AI generated, applications. We may disqualify applicants who use AI in any part of the interview process.
BenefitsWhat We Offer:
- A fast-paced, collaborative startup culture with high visibility.
- Autonomy, flexibility, and a flat corporate structure that gives you the opportunity for your direct input to be realized and put into action.
- Opportunity to make a meaningful impact in building a company and culture.
- Equity in a financial technology startup.
- Generous health, dental, and vision coverage for employees and family members + 401K.
- Eleven paid holidays and unlimited discretionary vacation days.
- Competitive compensation and bonus potential.
PLUM Commercial Real Estate Lending San Francisco, California, USA Office
445 Bush Street, Suite 500, San Francisco, CA, United States, 94108
Similar Jobs
Automotive • eCommerce • Hardware • Music • Retail • Software • Wearables
Develop agentic workflows and automation for real-time audio machine learning research. Responsibilities include orchestrating training, evaluation, experimentation, reporting, data preparation, hyperparameter searches, benchmarking, regression testing, experiment tracking, artifact management, and reproducible execution. The role integrates LLM agents with research tools, datasets, repositories, evaluation suites, and GPU infrastructure while partnering with audio researchers to create reusable workflows and dashboards.
Top Skills:
Automated TestingCi/CdContainersCudaDigital Signal Processing (Dsp)Distributed TrainingExperiment TrackingGpu SchedulingLinuxLlm AgentsMlopsPythonPyTorch
Automotive • Big Data • Information Technology • Robotics • Software • Transportation • Manufacturing
Leads engineers and data scientists developing autonomy subsystem evaluation metrics, root-cause analyses, regression detection, and release decision tools. Owns roadmap, staffing, technical quality, and cross-functional alignment across planning, perception, prediction, and localization. Applies statistical evaluation, simulation and road data analysis, and VLMs/LLMs to determine how subsystem errors affect driving outcomes and communicate actionable findings to engineering and leadership.
Top Skills:
C++LlmsPythonSQLVlms
Fintech • Financial Services
Manages and grows relationships with affluent consumer and business customers through proactive outreach, discovery-based financial guidance, and multi-product recommendations across deposits, lending, investments, and banking services. Owns a book of business, coordinates referrals with Wealth, Home Lending, and Business Banking, promotes digital adoption, supports branch colleagues, and maintains strong documentation, regulatory compliance, and risk controls.
Top Skills:
Finra Series 6Finra Series 63Finra Series 65Lo/Cfpb RequirementsSafe RegistrationSecurities Industry Essentials (Sie)
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
