Lead design and implementation of AWS-based data lake and pipelines (batch and streaming), build ML models on SageMaker, integrate foundation models via Bedrock, implement entity resolution, support Azure-to-AWS migrations, ensure data quality/security, and collaborate with cross-functional teams to deliver analytics and ML-powered solutions.
Capnexus is a comprehensive services provider. Our team consists of outstanding professionals, highly experienced in designing, building, and supporting retail software. We see ourselves as a build-as-a-service provider who follows a repeatable business pattern that can be applied to a variety of platforms and verticals. Having a culture built on outcomes and delivery at the core of the business, Capnexus is providing its customers with a complete suite of services for software development, system analysis, integration, implementation, and support, as well as the option to engage a single team to perform all the services they require.
Who You Are and What You'll Do:
Capnexus is looking for a highly skilled Senior AWS Data/ML Engineer to lead data architecture, pipeline development, and data integrations. This is an exciting opportunity to apply advanced cloud data engineering skills on a platform that leverages generative AI to automate and modernize enterprise workflows.
Responsibilities:
- Participate in data discovery workshops to inventory source systems including property management platforms, marketing channels, and CRM data, and translate findings into data lake architecture requirements.
- Design and implement a multi-zone enterprise data lake on Amazon S3 (raw, conformed, enriched, aggregated) with ingest, cleansing, and business layers aligned to the SOW architecture.
- Build batch and streaming data ingestion pipelines using AWS Glue, Amazon Kinesis, and AWS Data Pipeline across CDP, marketing, and property management data sources.
- Implement data transformation and orchestration frameworks using AWS Glue ETL and AWS Step Functions, including AWS Glue Data Catalog for metadata management and discovery.
- Configure Amazon Athena for serverless SQL querying across the data lake; support QuickSight integration with curated data sets for business analytics.
- Develop and deploy ML models on Amazon SageMaker for lead scoring, predictive maintenance, intelligent underwriting risk scoring, and AI-powered audience segmentation.
- Integrate Amazon Bedrock foundation models to enable generative AI capabilities including customer profile enrichment, hyper-personalization, and intelligent marketing automation.
- Use Kiro CLI to accelerate AI-assisted development workflows, spec-driven pipeline implementation, and automated code generation tasks.
- Design and implement entity resolution pipelines using Amazon Entity Resolution to identify, deduplicate, and merge customer records into unified golden records.
- Implement real-time and batch data synchronization pipelines between source systems and the Customer Data Platform (CDP).
- Support Azure data lake migration: conduct discovery, assess schemas and transformation logic, provision AWS target environments, execute migration via AWS DataSync, and perform data validation and reconciliation.
- Implement data lake security using AWS Lake Formation, including row-level security and column-level encryption.
- Build and maintain data models to support Customer 360 views, ML feature stores, and executive analytics dashboards.
- Ensure data quality, validation, and integrity across all pipeline stages and ML model outputs; support UAT for data-dependent features.
- Collaborate with Full Stack, DevOps/MLOps, and AWS engagement teams; contribute to architecture documentation, pipeline runbooks, and data governance documentation.
Qualifications:
- 5+ years of data engineering or ML engineering experience, with at least 2+ years in AWS cloud environments.
- Strong proficiency in Python and SQL; experience with AWS data services including S3, Glue, Athena, Kinesis, and Step Functions.
- Hands-on experience with Amazon SageMaker for model development, training, tuning, and endpoint deployment.
- Working knowledge of Amazon Bedrock for integrating and applying foundation models in production-grade pipelines.
- Experience designing and implementing multi-zone data lake architectures on Amazon S3, including lifecycle policies and Lake Formation governance.
- Familiarity with Kiro CLI or comparable AI-assisted/agentic development tooling.
- Experience with entity resolution, deduplication, or master data management concepts and tools.
- Solid understanding of data modeling, feature engineering, data quality practices, and ML integration testing.
- Experience with AWS Lambda and AWS Step Functions for serverless workflow orchestration.
- Familiarity with Amazon API Gateway for exposing data services and model endpoints.
- Strong analytical, problem-solving, and communication skills; comfortable working in Agile/Scrum teams alongside AWS Professional Services.
Nice to Have:
- Experience with Azure Data Lake, Azure Data Factory, or Azure Synapse — particularly in cloud-to-cloud migration contexts.
- Familiarity with Amazon Entity Resolution for customer identity and deduplication use cases.
- Experience with MLOps practices including model monitoring, drift detection, and automated retraining on SageMaker.
- Experience with LLM prompt engineering, RAG architectures, or fine-tuning workflows on Amazon Bedrock.
- Knowledge of Amazon QuickSight for analytics dataset preparation and embedded dashboard development.
- AWS Certification (Machine Learning Specialty, Data Analytics Specialty, or Solutions Architect).
- Background in real estate, property management, marketing technology, or insurance industries.
"Our Culture":
At Capstone, the central principles that we all adhere to, and the glue that holds us together, are our keystones. Our four keystones are:
"A Customer Obsessed, Delivery Focused, Culture"
- We’re driven to exceed our customers’ expectations by listening, leading, solving problems, and delivering what we promise
- We aim to be the most dependable and trusted partner serving our customers. TRUST = CONSISTENCY x TIME
"A Culture of Learning and Sharing"
- We value “Lifetime Learners”; those who are hungry, competitive, curious, and self-motivated in their pursuit of knowledge.
- Personal and professional growth depends on teamwork and continuous learning. By sharing knowledge, skills, ideas, and effort, we benefit our customers, ourselves, and our communities.
- We recognize that the thoughts, feelings, and backgrounds of others are as important as our own. Everyone has something to learn and everyone has something they can teach.
- Knowledge and ability are valued. Sharing knowledge and helping others learn new capabilities is valued exponentially.
"A Culture of Growth and Scalability"
- Growth comes from not establishing barriers in your role. “Cross functional skill sets are valued and help us deliver to our customers in a truly agile fashion. It comes with understanding that when asked to do something new, you will need support, have questions, and make some mistakes along the way.
- The most elegant solution is a simple solution. Simple doesn’t mean easy. It’s often more difficult to break a complex problem down into simple, scalable terms. We don’t appreciate, or value, over architected solutions or superfluous coding.
- Time is one of our most precious commodities. Scalability implies being respectful of this and passionate about making the most efficient use of each and every one of our team members time.
"All Work is Strategic"
- No matter how small a project or assignment appears, every single engagement is an opportunity for us to prove ourselves, build trust, and develop relationships that last and grow
- Every task, interaction, and commitment matters
- Big or small, we execute our plans and strategies with focus, commitment, and passion
We offer:
Job Type: Full-time, 1099
Benefits:
- Remote work
Capnexus is an equal opportunity employer. We embrace and celebrate diversity and are committed to creating an inclusive and safe environment for all employees. Experience comes in many forms, and we’re dedicated to adding new perspectives to the team. We encourage you to apply even if your experience doesn’t perfectly align with what we have listed. We look forward to hearing from you.
No Agencies Please!
Similar Jobs
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
Lead selection, implementation, and administration of marketing and sales technologies to drive growth and customer engagement. Manage and coach a team, execute digital marketing and creative campaigns, optimize marketing automation and Salesforce analytics, ensure data quality and validation, and partner with stakeholders to improve processes and deliverables from planning through completion.
Top Skills:
Adobe Data CollectionAdobe Experience Manager (Aem)Adobe Martech PlatformsAnalytics InstrumentationCdpCRMDom ManipulationHTMLJavaScriptMarketing AutomationSalesforce Crm AnalyticsSalesforce Marketing CloudTypescriptWeb Sdk
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
As a Financial Services Tax Manager, you'll supervise and develop teams, manage client accounts, analyze complex problems, and drive digitization in real estate tax services.
Top Skills:
Crm Systems
Artificial Intelligence • Professional Services • Business Intelligence • Consulting • Cybersecurity • Generative AI
As a Financial Services Tax Senior Associate, you'll advise clients on tax obligations, manage complex tax scenarios, mentor junior staff, and enhance efficiency through technology in a team-oriented setting.
Top Skills:
Data Visualization ToolsDigitization Solutions
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
