Smarsh Logo

Smarsh

Data Engineer

Posted One Month Ago
Remote
Hiring Remotely in US
160K-180K Annually
Senior level
Remote
Hiring Remotely in US
160K-180K Annually
Senior level
Design and lead scalable, secure, highly available database infrastructure for multi-terabyte SQL Server environments. Set technical direction for data architecture, performance, real-time pipelines, security, and growth. Troubleshoot complex production issues, optimize queries and indexes, guide cross-functional projects, mentor engineers, review changes, reduce technical debt, and evaluate emerging technologies. Monitor database health using Splunk, Datadog, and Grafana while influencing engineering and Site Reliability strategy.
The summary above was generated by AI

As a Database Engineer on the Professional Archive team, you'll operate as a subject-matter expert for the data infrastructure that powers our platform – driving the architecture, scaling, and reliability decisions that keep high-velocity, compliance-critical systems performant and secure. You'll work with SQL Server environments spanning multi-terabyte data volumes, tables with billions of rows, and sustained throughput exceeding 100,000 transactions per second.

You'll work independently through ambiguous and unfamiliar problems, set technical direction for real-time data pipelines and system performance, and act as a go-to resource for engineers across the wider organization. Your work will directly shape how Smarsh clients meet their compliance needs through scalable, dependable data and search capabilities.

You'll partner with leaders across Product Management, Engineering, and Site Reliability, weighing a range of inputs to resolve complex challenges and influence strategy beyond your immediate team. We're looking for someone who brings deep technical judgment, mentors others, and is motivated to make an impact through thoughtful, high-leverage engineering.

How will you contribute?

  • Serve as a subject-matter expert for database architecture and performance, guiding engineers through complex or ambiguous technical problems where established principles don't fully apply
  • Set the technical approach for scalable data solutions, partnering with stakeholders across Product, Engineering, and Site Reliability to shape direction rather than simply implement it
  • Drive larger, cross-functional projects from design through delivery, proactively identifying and addressing upstream and downstream impacts before they become issues
  • Informally mentor other engineers, modeling sound engineering discipline and raising the technical bar for the wider team
  • Shape how the team adopts modern engineering practices, including Agile methodologies, CI/CD pipelines, and DevOps principles
  • Review code and database changes with an eye for systemic risk and performance, while also leading efforts to pay down technical debt across systems
  • Track emerging technologies and make the call on which are worth adopting, guiding the team's direction
  • Interpret database health and performance data (Splunk, Datadog, Grafana) to proactively flag and address risk before it surfaces as an incident

What will you bring?

    We're looking for a recognized subject-matter expert who operates independently, drives clarity through ambiguity, and raises the bar for those around them.

  • Advanced, wide-ranging experience with database systems, with the judgment to operate independently in unfamiliar or ambiguous situations
  • Deep expertise designing logical and physical data models, including schema design and data relationships, at a level others rely on for direction
  • A demonstrated ability to set database performance strategy by tuning queries and indexes and establishing standards that others follow
  • Strong command of data security practices (encryption, access controls, auditing), with the ability to shape how the team approaches them
  • A track record of independently troubleshooting complex issues in systems that require high availability, serving as an escalation point for others
  • Ability to plan for data growth and scale infrastructure with the full flow of work in mind, not just the immediate ask
  • The credibility and collaborative instinct to influence peers and cross-functional partners, not just execute their requests
  • Strong command of modern development practices and Agile methodologies, with a voice in how the team applies them
  • Ability to communicate technical direction, trade-offs, and risk clearly to stakeholders outside your immediate team
  • Comfort setting a course through evolving, ambiguous requirements rather than waiting for them to be resolved
  • A proactive approach to identifying and solving problems that cross team boundaries

Preferred Qualifications

  • If you don't meet every qualification listed below, we still encourage you to apply. We value diverse experiences and perspectives. Progression to this level reflects demonstrated ability to perform as a subject-matter expert, not years of experience alone.

  • 7+ years of hands-on experience with Microsoft SQL Server in a production environment, with demonstrated impact as a subject-matter expert
  • Deep expertise in schema and data model design, including normalization, partitioning, and indexing strategy for both OLTP workloads
  • Advanced proficiency in performance tuning, including T-SQL and stored procedure optimization, execution plan analysis, and query tuning at scale
  • Proven, hands-on experience managing and troubleshooting SQL Server databases at terabyte scale, including tables with billions of rows, and sustained throughput exceeding 100k transactions per second
  • Demonstrated ability to diagnose and resolve production capacity and contention issues at this scale, including lock/latch contention, TempDB performance, and transaction management
  • Experience designing for horizontal as well as vertical scalability, anticipating data growth before it becomes a production risk
  • Familiarity with NoSQL technologies (e.g., MongoDB, Cassandra, DynamoDB) is a plus
  • Experience with cloud database platforms (e.g., AWS RDS/Aurora, MongoDB Atlas) is a plus

What do we offer?

  • Healthcare insurance: We provide medical, dental, and vision insurance, and a flexible spending account that allows you to set aside pre-tax dollars to pay for eligible out-of-pocket expenses.
  • Stock options.
  • Personal time off: A healthy work-life balance is critical to your success at the office. Smarsh offers a “take-what-you-need” time off policy as well as flexible work arrangements.
  • 401K Match: Smarsh provides a 4% 401K match for which employees are fully vested on day one.
  • Sabbatical: The Smarsh sabbatical programme provides a time to recharge, study or simply do something you are passionate about away from the workplace. Employees are eligible after six years of service.
  • Recognition: We’re big on kudos for a job well done. Our employee-recognition programme enables co-workers to nominate their peers who best embody our core values for recognition.

Don't meet every requirement? Apply anyway! We value diverse candidates and encourage applications, even if you don't perfectly match the job description. Studies have shown that some strong candidates may self-select out of the interview process prematurely, at Smarsh we encourage an inclusive, high-performing environment.
 
Smarsh is an equal opportunity and affirmative action employer. Qualified applicants will receive consideration without regard to their race, colour, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran. Smarsh invites all qualified interested applicants to apply for career opportunities. Reasonable accommodations may be made to enable individuals with disabilities to perform essential functions. Including frequency of functions

Smarsh Pleasanton, California, USA Office

6701 Koll Center Parkway, 3rd Floor, Pleasanton, United States, 94566

Smarsh Redwood, California, USA Office

900 Veterans Blvd, 5th Floor, Redwood, CA, United States, 94063

Similar Jobs

9 Days Ago
Remote or Hybrid
USA
140K-215K Annually
Senior level
140K-215K Annually
Senior level
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Architects, deploys, and operates scalable data platform infrastructure supporting analytics. Responsibilities include administering Airflow and Superset, managing Terraform infrastructure, building CI/CD pipelines, implementing security and compliance controls, developing dbt data models, cataloging assets in OpenMetadata, automating with Python, and mentoring engineers. The role requires extensive infrastructure and data engineering experience, cloud expertise, container orchestration, and eligibility for CJIS clearance.
Top Skills: Ai TechnologiesApache AirflowApache SupersetAWSAzureCi/CdDbtDockerGCPIamKubernetesMachine Learning PipelinesOciOpenmetadataPythonSQLTerraform
10 Days Ago
In-Office or Remote
120K-215K Annually
Senior level
120K-215K Annually
Senior level
Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
Build and lead production AI/ML, Generative AI, and data engineering solutions for healthcare analytics and patient safety platforms. Develop full-stack applications, microservices, APIs, data pipelines, dashboards, self-service analytics, RAG systems, and event-driven architectures using cloud-native technologies. Apply engineering best practices including testing, CI/CD, observability, security, and performance optimization. Mentor engineers, lead technical initiatives, and collaborate with product, analytics, business, and platform teams.
Top Skills: Amazon KinesisAWSAzureAzure Event HubsCi/CdDatabricksDelta LakeGCPGenerative AiJavaJavaScriptKafkaLarge Language Models (Llms)Microsoft FabricMlopsPysparkPythonReactRest ApisRetrieval-Augmented Generation (Rag)SnowflakeSparkSpring BootSQLTypescriptVector Search
Yesterday
Remote or Hybrid
US
105K-150K Annually
Senior level
105K-150K Annually
Senior level
Information Technology
Designs, develops, validates, and documents analytics data solutions for diverse client environments. Builds Snowflake, SQL, dbt, and AWS ingestion and transformation pipelines; monitors data quality and performance; troubleshoots complex technology issues; and supports reporting and business insights. Manages project scope, budgets, documentation, governance, client communication, implementation planning, and quality assurance while collaborating across teams and identifying opportunities for additional solutions.
Top Skills: Analytics Data MartsAWSData GovernanceData IngestionData PipelinesData PrivacyData TransformationDbtMedallion ArchitectureQa TestingRelational DatabasesSnowflakeSQL

What you need to know about the San Francisco Tech Scene

San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.

Key Facts About San Francisco Tech

  • Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Google, Apple, Salesforce, Meta
  • Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
  • Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
  • Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
  • Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account