Lead development of a generative AI proof-of-concept and integrate AI solutions into software workflows. Mentor data engineers, design and implement Python-based generative AI applications, build scalable data pipelines, deploy models/APIs, and translate stakeholder requirements into technical solutions while staying current on AI and data engineering best practices.
Key Responsibilities:
- Lead the creation of a POC for using generative AI in software development, demonstrating its potential to improve efficiency, quality, and innovation.
- Collaborate with software development teams to integrate generative AI solutions into existing workflows.
- Lead and mentor a team of data engineers, providing technical guidance and fostering a collaborative team environment.
- Design, develop, and implement generative AI applications using Python.
- Work closely with stakeholders to understand business requirements and translate them into technical solutions.
- Drive the development and execution of data engineering strategies to support business objectives.
- Develop and maintain scalable data pipelines, API and model deployments, and workflows.
- Communicate complex analytical findings and insights to non-technical stakeholders in a clear and concise manner.
- Stay current with industry trends, best practices, and emerging technologies in data analytics, generative AI, and Python programming.
Qualifications:
- Bachelor’s or Master’s degree in Computer Science, Data Science, Statistics, Mathematics, or a related field.
- 5+ years of experience in data engineering and AI, with at least 2 years in a leadership or supervisory role.
- Proficiency in Python programming and its libraries (e.g. pandas, numpy, scikit-learn, matplotlib, seaborn).
- Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) and their data analytics and AI services.
- Strong understanding of statistical analysis, machine learning, and data mining techniques.
- Experience with generative AI models (e.g., GPT, GANs) and their applications in software development.
- Experience with big data technologies (e.g., Hadoop, Spark) and data visualization tools (e.g., Tableau, Power BI) is a plus.
- Solid experience with SQL and database management.
- Excellent problem-solving skills and the ability to work independently and as part of a team.
- Strong communication and interpersonal skills, with the ability to effectively convey technical concepts to non-technical stakeholders.
Preferred Qualifications:
- Knowledge of data governance and data privacy regulations.
- Experience in agile development methodologies.
Photon San Francisco, California, USA Office
San Francisco, United States
Similar Jobs
.png){kind=logo}
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Build and maintain automation and reliability for live video distribution across on-prem and cloud. Deploy and manage systems, develop monitoring and automated recovery, troubleshoot complex incidents, coordinate with vendors, document SOPs, support live broadcast components, and participate in L2 on-call rotation.
Top Skills:
AacAc3AnsibleAtscAvcAWSBashChefCloudFormationCmafDockerEksGitHevcHlsJavaScriptJSONKubernetesLinuxMicrosoft Graph ApiMpeg Transport StreamsPythonRistScte104Scte224Scte35SrtSsaiSt2022-7St2110StatmuxTerraformUnixXMLYmlZixi
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Architect, design, build, and deploy SAP Analytics Cloud and SAP HANA-based planning and analytics solutions. Lead requirements gathering, develop data models and pipelines, oversee testing and go-live, coach users, collaborate with Cloud/BTP/HANA admins and Data teams, support master data consistency, and participate in production support and stabilization efforts.
Top Skills:
AbapAbap Cds ViewsAoeAWSAzureGCPHana Native ModelingHana Smart Data IntegrationMdgMicrostrategyPower BIQlikviewSap Analytics Cloud (Sac)Sap BoSap BpcSap BtpSap Bw4/HanaSap Cloud AnalyticsSap DatasphereSap EccSap HanaSap S/4HanaSap SltTableau
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Design, deploy, and maintain scalable, resilient infrastructure and automation for live video distribution. Build IaC, CI/CD pipelines, containerized services, monitoring dashboards, and collaborate with operations and vendors. Participate in incident troubleshooting and on-call rotation to ensure 24/7 live content delivery.
Top Skills:
Ai AgentsAirlockAnsibleAWSAzureBashChefCi/CdCloudFormationCrowdstrikeDockerElkGCPGitGrafanaIp NetworkingJavaScriptJSONKubernetesLinuxPythonQualysSplunkTerraformUnixXMLYml
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
