The role involves architecting intelligence infrastructure, building data pipelines, collaborating with other teams, and ensuring data accessibility and security for threat detection systems.
Transform raw signals into actionable intelligence. Build the pipelines that turn chaos into clarity.
At detections.ai, we believe that great detection starts with great data. We're looking for a data engineer who doesn't just move bytes—but architects the intelligence infrastructure that helps security teams see threats before they strike. This is your chance to build the data foundation that powers the future of threat detection.
You’ll Own:
- Backend services end-to-end – from first design sketch to production deployment.
- High-throughput data pipelines that transform messy security telemetry into clean, enriched streams.
- Integrations with SIEMs, EDRs, and security platforms that make our product the connective tissue of the modern security stack.
- Cross-team collaboration with frontend, AI, and detection engineers to ensure data becomes truly actionable.
- Core architecture and APIs that other engineers (and customers) will build on every day.
You’re a Fit If You:
- Have 5+ years building and scaling backend systems that handle real-world complexity.
- Are fluent in Python (FastAPI preferred) and cloud-native development on AWS or GCP.
- Can design data models and transformation logic for complex, real-time workflows.
- Build with resilience, security, and performance as first principles.
- Thrive in a high-context, low-process environment where speed and ownership matter.
You’ll Stand Out If You:
- Have hands-on experience with SIEMs, SOARs, detection pipelines, or IR tools.
- Have worked with event streaming/orchestration systems (Kafka, Kinesis, Airflow).
- Understand security-first architecture (RBAC, audit logs, multi-tenancy).
- Have built on OpenSearch or DynamoDB for large-scale, fast data access.
Tech Stack:
- Frontend: React.js, Tailwind CSS, TypeScript
- Middle Layer: Node.js, TypeScript
- Backend: Python (FastAPI)
- Infra & DevOps: AWS, GCP, Docker, Terraform, GitHub Actions
- Data: OpenSearch, DynamoDB
- AI Agents: Gemini, Anthropic, OpenAI
- Tooling: Figma, Storybook, CI/CD pipelines
The Offer:
- Remote-first with meaningful equity
- Build for real users: Work side-by-side with detection engineers.
- Own meaningful problems: Architect the systems that make detections possible.
- Move fast without red tape: Small, high-context team with outsized impact.
- Shape product and culture: Your work is foundational to the company’s success.
This isn't just another data engineering role—it's your chance to build the data foundation that powers the next generation of threat detection.
Similar Jobs
.png)
Artificial Intelligence • Blockchain • Fintech • Financial Services • Cryptocurrency • NFT • Web3
Build and operate low-latency market data systems for institutional trading, including feed handlers, normalization pipelines, venue connectivity, and distribution services. Develop high-throughput services, improve reliability and performance through observability and incident response, participate in on-call support, and collaborate with engineering and product teams. The role requires production backend engineering experience, market data infrastructure expertise, Java or C++, messaging frameworks, and exchange connectivity protocols.
Top Skills:
AeronC++FixItch/OuchJavaMulticastSbe
.png)
Artificial Intelligence • Cloud • Payments • Software • Business Intelligence • Generative AI • Automation
Define and govern enterprise-scale data architecture across batch, streaming, warehouse, lakehouse, transactional, and AI use cases. Establish standards for data quality, lineage, access, cataloging, governance, observability, and SLAs. Architect AI-enabled workflows, resolve complex architecture issues, influence roadmaps, and mentor engineers through hands-on technical leadership. The role requires 15+ years of software, data engineering, or architecture experience and expertise in large-scale data platforms and modeling.
Top Skills:
AIBatch ProcessingBigQueryData CatalogsData WarehousesDbtFeature StoresGCPLakehousesOlapOltpStreaming ArchitecturesVector Stores
Fintech • News + Entertainment • Software • Database • Financial Services
Lead the architecture and development of scalable AWS-based data ingestion, transformation, and orchestration pipelines. Build reliable data infrastructure using Python, SQL, Airflow, Lambda, ECS, SQS, and Terraform. Establish data modeling, quality, lineage, monitoring, testing, and observability practices while partnering with analysts, scientists, and backend engineers. Mentor senior engineers, guide technical decisions, and provide hands-on leadership for complex data platform initiatives.
Top Skills:
Amazon EcsAmazon KinesisAmazon RedshiftAmazon S3Amazon SqsApache AirflowApache FlinkAWSAws GlueAws LambdaBeautifulsoupCi/CdDatabricksDockerGreat ExpectationsKafkaMonte CarloMwaaPythonScrapySnowflakeSQLTerraform
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
