Datavations Logo

Datavations

Sr. Full-Stack Engineer, Data Systems

Posted One Month Ago
In-Office
New York, NY
150K-170K Annually
Senior level
In-Office
New York, NY
150K-170K Annually
Senior level
Own Datavations’ taxonomy and attribute systems end to end, including LLM extraction, dbt transformations, Dagster orchestration, full-stack applications, APIs, deployment, CI/CD, data quality, observability, and approval workflows. Build reliable AI systems with evaluation suites, versioned prompts, tool-calling, cost controls, and monitoring. Partner with the data platform team while establishing engineering standards, documentation, testing, runbooks, and scalable architecture.
The summary above was generated by AI

About Datavations  

Datavations is a leading New York-based data and AI software specializing in the $2.3 trillion dollar building materials industry. Datavations gives building materials and home improvement manufacturers real-time, store-level visibility into pricing, assortment, and inventory across major retailers, including Home Depot, Lowe’s, and Menards. Manufacturers use this data to make sharper decisions about pricing, distribution, and how they show up on the shelf. 

About the role

Product taxonomy and attributes form the foundation of every insight Datavations delivers to our customers. We are looking for an engineer to own this domain end-to-end—driving both the data systems that organize the market and the applications that enable our teams and customers to interact with them. This is a hands-on role with significant architectural latitude for someone who wants to take full ownership of a system that already powers the business.

WHAT YOU'LL OWN

  • The attribute extraction engine — LLM-based extraction at production scale, its configuration model, its quality gates, and its cost profile.
  • The transformation layer for this domain — the dbt models that turn extracted values into published attributes: standardization, and the override model that lets human judgment reliably beat the machine. Built on our ClickHouse warehouse alongside the data platform team.
  • Orchestration and reliability for these pipelines — the Dagster jobs, sensors, and schedules that run taxonomy and attribute processing, including run monitoring, retries, alerting, and recovery tooling. Reliability is not a separate team here; for this domain, it is this seat.
  • The applications — internal and customer-facing. You own the screens people actually use, not only the services behind them: the internal platform our teams run taxonomy and attributes from, and the customer-facing views of this data as they move onto it. React/Next.js front end, backend services and APIs, application architecture, deployment and CI/CD.
  • The write path — every change validated, logged, and visible before it ships, with approval where it matters.
  • Data quality and observability — automated testing on the data itself, plus statistical detection of what goes wrong quietly: outliers, drift, a retailer that stopped updating, a value that flips between runs.
  • Engineering standards for the domain — documentation, tests, runbooks, and review culture as the system and the team around it scale.

BUILDING WITH AI, SPECIFICALLY

  • A meaningful part of this platform is AI, and not bolted on the side: an LLM extraction engine already running at scale, a rules engine that produces a confidence score per item, and an in-app assistant that answers questions in natural language and proposes changes for review. We are looking for someone who has built this kind of system properly, not someone who has called a completion endpoint.
  • Evaluation before assertion — golden sets, regression suites that run when a prompt changes, and a defensible answer to “did that make it better?” Quality you can measure, not quality you claim.
  • Prompts and rules as versioned data — stored, diffable, testable, auditable, with a clear record of what changed and what it did. Not constants in a file that move on deploy.
  •  Tool-calling and MCP — exposing internal systems to agents safely: scoped, read-first, audited. It is how our teams will query and operate the platform, and how we already work internally.
  • Cost and latency as design constraints — model tiering, caching, batching, circuit breakers. Knowing what a run costs before it runs, and why a small model first is usually the right answer.

WHAT YOU'LL WALK INTO

  • A modernization already in motion, not a greenfield and not a rescue: a production system that has grown fast with the business, a detailed technical map of it, an engaged leadership team, a modern monorepo, and a new internal platform in its first release — with full air cover to do it properly. You own the taxonomy and attribute systems end to end; the warehouse, ingestion, and shared infrastructure are owned alongside you by the data platform team.

REQUIREMENTS

  • At least 5 years of experience in Cloud Infrastructure, Site Reliability Engineering (SRE), or Platform Engineering.
  • Strong expertise with Terraform and using infrastructure as code (IaC).
  • Experience with CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI/CD, ArgoCD).
  • Strong expertise in architecting solutions using AWS services.
  • Experience in Python, SQL, dbt, and modern orchestration tools (e.g., Dagster, Airflow, Prefect).
  • Proficiency with a columnar warehouse (e.g., ClickHouse, Snowflake, BigQuery).
  • Experience with full-stack development (TypeScript, Next.js or similar).
  • Experience building production data pipelines and maintaining observability/reliability.
  • Experience with AI/LLM-based systems, including evaluation and versioning of prompts.
  • Experience with data visualization tools (e.g., Tableau, Power BI) and project management tools (e.g., Jira).

YOU'RE A FIT IF

  • You think like a product person as well as an engineer — you form opinions about what the people using this should be able to do, and would rather understand the problem behind a request than build the ticket as written.
  • You build with AI daily — both in what you ship and in how you work. AI-assisted development is a habit, not a novelty.
  • You write things down by default, and can take ownership of an existing codebase without needing its original author in the room.
  • Bonus: retail, e-commerce, or point-of-sale data.

YOU'RE NOT A FIT IF

  • You want a greenfield with no history, or “it ran green” is your definition of done.

Preferred Location: NY, Chicago, Dallas, Cincinnati, Minneapolis


Why Join Datavations

  • Impact at Scale: Influence a $2.3 trillion industry by shaping how data science accelerates ROI for major manufacturers.
  • Autonomy & Growth: Enjoy the freedom to experiment with new technologies and see your ideas realized in production.
  • Collaborative Culture: Work alongside a supportive team that values positivity, proactive ownership, and continuous learning.

Our values 

  • Customer Obsession: We are integrated in the industry with a customer-first obsession.
  • Proactive Ownership: We have agency for our actions and embody an entrepreneurial mindset.
  • Bias for Action: We maintain momentum with a can-do attitude; we value progress over perfection.
  • Eager to Grow: We stay curious and hungry to learn, viewing every failure with humility as an opportunity to grow.
  • Foster Collaboration: We work across boundaries with quiet competence, welcoming diverse perspectives and offering help unselfishly.

Compensation 

The average range for this role is $150,000 - $170,000  depending on experience, skills, and alignment with the role’s responsibilities. This range reflects our current national expectations for qualified candidates. Exceptional candidates based in our NYC office may be considered for a higher range. Total compensation may also include equity, performance bonuses, and a comprehensive benefits package.

We’re committed to paying competitively and equitably, and we regularly review our compensation structures to ensure they align with the market and support our values

Similar Jobs

Yesterday
Remote or Hybrid
USA
151K-180K Annually
Senior level
151K-180K Annually
Senior level
Artificial Intelligence • Fintech • Machine Learning • Mobile • Payments • Retail • Software
Manage strategic enterprise accounts in the fuel and convenience-store industries, guiding onboarding, retention, growth, and expansion. Build account plans, conduct performance reviews, interpret data, create reports and case studies, monitor account health, address churn risks, and identify expansion opportunities. Partner with analytics, product, marketing, and operations teams while maintaining relationships with senior client stakeholders. The role includes up to 20% travel.
Top Skills: GongOutreachSalesforce
Yesterday
Hybrid
191K-334K Annually
Senior level
191K-334K Annually
Senior level
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Leads customer and partner engagements, applied research, thought leadership, and proofs of concept using the ServiceNow platform and emerging technologies. Develops workshops, technical collateral, strategic insights, operational frameworks, and portfolio initiatives while collaborating with engineers, futurists, product managers, account teams, and external stakeholders. Represents research through publications, presentations, conferences, and industry commentary to influence ServiceNow strategy and innovation.
Top Skills: AgileArtificial IntelligenceScrumServicenow Platform
Yesterday
Remote or Hybrid
US
130K-150K Annually
Senior level
130K-150K Annually
Senior level
AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech
Leads brand positioning and go-to-market narratives for CPG brands. Develops advertiser-facing materials and packages editorial opportunities using audience and marketplace insights. Partners with editorial, sales, strategy, design, and research teams to enable revenue-generating programs. Manages timelines, deliverables, storytelling quality, and process improvements across brand marketing workstreams.
Top Skills: KeynotePowerPoint

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account