Cogniify Logo

Cogniify

Senior Data Engineer / Analyst - USA

Posted Yesterday
In-Office or Remote
2 Locations
103K-162K Annually
Senior level
In-Office or Remote
2 Locations
103K-162K Annually
Senior level
Lead design and delivery of production data platforms, pipelines, and analytics. Architect Snowflake/Databricks solutions, build ETL/streaming ingestion, implement dbt transformations, data quality, observability, and governance, support BI and AI/ML feature/data pipelines, and mentor engineers while driving DataOps and platform best practices.
The summary above was generated by AI

The Role

We’re looking for an experienced Senior Data Engineer/Analyst to lead the design and delivery of production-grade data platforms, pipelines, and analytics solutions that drive business intelligence and AI/ML capabilities across the organization. In this role, you will own critical data workstreams end to end, make key architectural decisions on data modeling, pipeline design, and platform selection, and collaborate with clients and stakeholders to translate business requirements into scalable data solutions. You will champion modern data stack practices using Snowflake, Databricks, dbt, and cloud-native services, while mentoring other engineers and driving the maturity of our data engineering, analytics, and DataOps capabilities.

What You’ll Do

  • Lead the design, development, and optimization of enterprise-grade data pipelines and transformation layers using dbt, Apache Spark, Airflow, Dagster, and cloud-native orchestration services.

  • Architect and manage data platforms on Snowflake and/or Databricks, including warehouse design, lakehouse architecture, compute optimization, access governance, and cost management.

  • Define and enforce data modeling standards across the organization using Kimball dimensional modeling, Data Vault 2.0, Activity Schema, or hybrid approaches.

  • Design and implement end-to-end data ingestion strategies from diverse sources: transactional databases (CDC via Debezium, Fivetran), APIs, event streams (Kafka, Kinesis, Spark Structured Streaming), SaaS platforms, and unstructured data sources.

  • Build and maintain curated data products, metrics layers, and semantic models that enable self-service analytics across the organization.

  • Implement comprehensive data quality, observability, and lineage frameworks using dbt tests, Great Expectations, Monte Carlo, Datafold, Elementary, or Soda.

  • Collaborate with clients and business stakeholders to gather requirements, translate them into data architecture decisions, and drive technical strategy from ideation to production.

  • Lead the adoption of DataOps practices including CI/CD for data pipelines (GitHub Actions, dbt Cloud, Databricks Asset Bundles), automated testing, and environment promotion workflows.

  • Design and optimize analytics solutions and advanced dashboards using Tableau, Looker, Power BI, or Sigma Computing, ensuring performance and usability at scale.

  • Support AI/ML initiatives by designing and maintaining feature stores, training datasets, and model input/output data pipelines in collaboration with ML engineers.

  • Mentor junior and mid-level data engineers and analysts, conduct architecture and code reviews, and drive knowledge sharing across the team.

  • Drive data governance initiatives including cataloging (Alation, Atlan, DataHub, Unity Catalog), lineage tracking, PII management, and regulatory compliance (GDPR, CCPA, HIPAA).

What We’re Looking For

  • Bachelor’s or Master’s degree in Computer Science, Data Science, Statistics, Mathematics, or a related field.

  • 5–8+ years of professional experience in data engineering, analytics engineering, or a closely related role with significant production delivery.

  • Deep expertise in SQL and advanced data transformation techniques across analytical databases and data warehouses.

  • Extensive hands-on experience with Snowflake and/or Databricks in production environments, including architecture design, performance tuning, and cost optimization.

  • Strong experience with dbt (data build tool) for production-grade transformation, testing, documentation, and CI/CD workflows.

  • Proficiency in Python (Pandas, PySpark, Polars) and Apache Spark for large-scale data processing.

  • Experience designing and operating workflow orchestration using Airflow, Dagster, Prefect, or cloud-native equivalents.

  • Strong knowledge of data ingestion patterns and tools: Fivetran, Airbyte, CDC (Debezium), streaming (Kafka, Kinesis, Flink).

  • Experience with data visualization and BI platforms: Tableau, Looker, Power BI, or Sigma at enterprise scale.

  • Proven ability to work directly with clients and stakeholders and translate ambiguous business requirements into concrete data solutions.

  • Demonstrated ability to mentor engineers, lead design reviews, and influence data architecture direction.

  • Strong understanding of data governance, cataloging, data quality, and compliance frameworks.

Preferred Qualifications

  • Snowflake SnowPro Advanced or Architect, Databricks Data Engineer Professional, or AWS Data Analytics Specialty certification.

  • Experience with lakehouse architectures using Delta Lake, Apache Iceberg, or Apache Hudi.

  • Familiarity with real-time analytics and streaming architectures: Kafka, Spark Structured Streaming, Flink, Materialize, or ksqlDB.

  • Experience with metrics/semantic layers at scale: dbt Semantic Layer, Cube, MetricFlow, or LookML.

  • Experience designing data platforms that serve AI/ML workloads, including feature stores (Feast, Tecton), vector databases (Pinecone, Weaviate), and RAG data pipelines.

  • Familiarity with data mesh or data product architecture patterns in large organizations.

  • Experience with cloud data infrastructure across AWS (S3, Glue, Athena, Lake Formation, Redshift Serverless), Azure (ADLS, Synapse, Fabric, Purview), or GCP (BigQuery, Dataflow, Dataplex).

  • Knowledge of cost optimization and FinOps for data platforms (Snowflake credit management, Databricks cluster policies, spot instances).

Why Join Cognify Analytics?

  • Join a team of industry veterans from Google, Meta, and top-tier tech companies.

  • Work on impactful, high-scale data and analytics projects with leading global clients.

  • Enjoy a flexible, remote-first culture focused on innovation and excellence.

  • Competitive salary, equity options, and continuous learning opportunities.

  • Shape the future of modern data platforms and AI-powered analytics at a rapidly growing company.

Salary Range
US East/West Coast: $121,700 - $162,200
US Remote: $103,400 - $137,900

Disclaimer: These salary ranges are estimates based on market data. Actual compensation may vary depending on factors including work experience, education, skills, and specific geographic location.

Perks And Benefits Of Working With Us

  • Unlimited PTO.

  • Please ask us about our very generous parental leave, much above industry standards!.

  • Entrepreneurial culture where pushing limits and taking risks is everyday business.

  • Open communication with management and company leadership.

  • Small, dynamic teams = massive impact.

  • Medical, Dental and Vision coverage for employees.

  • Access to Disability & Life insurance.

  • Mental health and wellbeing support

  • Annual bonus program

  • Employer Stock Purchase Program (ESPP)

  • Yearly Team building experiences

  • Mentorship and sponsorship opportunities

  • Manager resources and support

We are an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other protected characteristic.

Similar Jobs

18 Minutes Ago
Remote or Hybrid
San Francisco, CA, USA
220K-240K Annually
Senior level
220K-240K Annually
Senior level
Healthtech • Social Impact • Software
Lead and execute Grow Therapy's multi-year Security Engineering roadmap. Build secure-by-default infrastructure (auth, authZ, logging, egress), drive data security and systematic data tagging, develop org-wide security scorecards, enable automated least-privilege and vulnerability management, and influence AI-native security and security culture across product, platform, and compliance teams.
31 Minutes Ago
Remote
United States
250K-280K Annually
Senior level
250K-280K Annually
Senior level
Fintech • Information Technology • Software
Lead SentiLink's insurance vertical by prospecting and closing enterprise deals with carriers, MGAs, insurtechs, and platforms. Shape go-to-market strategy, define use cases, build executive relationships across fraud, underwriting, and risk teams, and partner cross-functionally to influence product and customer success.
46 Minutes Ago
Remote or Hybrid
60K-80K Annually
Mid level
60K-80K Annually
Mid level
Cloud • Insurance • Payments • Software • Business Intelligence • App development • Big Data Analytics
Manage and adapt implementation projects, lead setup/configuration and troubleshooting, own customer communication, build trust-based relationships, translate technical details for customers, act as product SME for complex multi-system implementations and coordinate cross-functional teams for smooth handoffs.
Top Skills: MS Office

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account