Build and maintain scalable ETL/ELT pipelines and data platform components. Integrate heterogeneous data sources, clean and transform inconsistent datasets, and implement record matching, deduplication, reconciliation, and entity resolution without reliable common identifiers. Design data models and data quality processes, monitor pipeline performance, investigate discrepancies, and improve data reliability.
About Lineate
Lineate is a US-based international software development company with over two decades of experience.
From Intelligent Document Processing(IDP) and Agentic RAG systems to scalable cloud architectures, we turn complex ideas into real, measurable results.
We deliver AI-driven custom solutions for FinTech, HealthTech, AdTech, and beyond, empowering businesses to grow smarter, faster, and more efficiently.
Our expertise falls into three main categories:
- Building Custom AI Solutions: Deploying high-impact, AI-enabled technology utilizing IDP, Agentic RAG.
- Cloud and Data Infrastructure: Optimizing business operations with our data management and cloud computing solutions.
- Team Augmentation: Providing specialized experts in FinTech, AdTech, and HealthTech to integrate seamlessly and accelerate project timelines.
- Our goal is not just to build technology, but to build the future operating model for our clients.
Product: A US-based real estate and mortgage technology platform that supports the home-buying journey from property search through closing. It combines property search, data integrations, workflow automation, real estate services, and home-buying rewards in a single customer journey.
Key Responsibilities
- Build and maintain reliable, scalable ETL/ELT pipelines and data platform components.
- Integrate data from multiple heterogeneous sources, including databases, APIs, files, and third-party systems.
- Clean, normalize, transform, and map messy, incomplete, and inconsistent data, often without reliable unique keys.
- Develop solutions for record matching, deduplication, reconciliation, and entity resolution across different data sources.
- Design data models and implement data quality, validation, and monitoring processes.
- Investigate data discrepancies, troubleshoot pipelines, and continuously improve data reliability and performance.
Requirements
- 6+ years of hands-on Data Engineering experience.
- Strong Python and SQL skills.
- Solid production experience with ETL/ELT, data integration, and data modeling.
- Hands-on experience cleaning and mapping incomplete, inconsistent, or duplicated data from multiple sources.
- Experience matching records without a reliable common ID, using composite keys, rule-based or fuzzy matching, entity resolution, or similar approaches.
- Production experience with modern data technologies such as Airflow, dbt, Spark, Kafka, ClickHouse, Snowflake, Databricks, or similar.
- Strong understanding of data quality and DWH/data platform principles.
We offer
- Freedom to Develop - equal opportunity to learn and grow professionally
- Clear career and professional path, strong performance management system
- Social Benefits Package
- Equipment
- English lesson
- Gym membership
- All the advantages of working in an international IT company
- Flexible vacation time
- Fun and inclusive in-person and digital events
Lineate is proud to be an Equal Opportunity Employer - We do not hire on the basis of race, colour, religion, creed, gender, national origin, citizenship, age, disability, veteran status, marital status, pregnancy, parental status, sex, gender expression or identity, sexual orientation, or any other basis protected by Georgian legislation. All employment is decided based on qualifications, merit, and business need. Learn more about Lineate at our website: www.lineate.com
Similar Jobs
Information Technology • Software
Designs and leads scalable data solutions on GCP, including data architectures, ETL/ELT pipelines, data lakes, lakehouses, warehouses, and batch or real-time processing. Develops data models, orchestration, monitoring, governance, and production deployments while collaborating with architects, engineers, analysts, DevOps teams, and customers. Requires strong Python and SQL skills, GCP expertise, cloud data warehouse experience, and familiarity with visualization, transformation, CI/CD, and infrastructure practices.
Top Skills:
Aws GlueAzure Data FactoryAzure Machine LearningBedrockBigQueryBigquery MlCi/CdCloud ComposerCloud FunctionsCloud RunCloud StorageDatabricksDataflowDataformDataprocDbtEmrGeminiGitGoogle Cloud Platform (Gcp)KafkaKinesisLookerPower BIPythonQuicksightRedshiftRiverySagemakerSQLSynapseTableauVertex Ai
HR Tech
Build and operate shared AI platform infrastructure for LLM applications, agents, RAG, tool calling, and AI workflows. Develop data and knowledge pipelines, secure enterprise integrations, reusable frameworks, deployment and observability standards, and developer tooling. Take AI systems from experimentation to reliable production while ensuring security, privacy, governance, scalability, quality, and cost efficiency. Collaborate across Engineering, Product, and IT to establish practical AI platform patterns and guardrails.
Top Skills:
Ai AgentsAirflowAPIsAWSAws BedrockDatabricksDbtEmbeddingsGenerative AiLangchainLanggraphLlmsMcpPythonRagSnowflakeSQLTool CallingVector Search
Financial Services
Design, implement, and test cloud-based server-side software in Python. Optimize code performance, maintain unit and integration tests, and work with AWS, Docker, DevOps, and CI/CD tools. Preferred experience includes reverse engineering public APIs, PostgreSQL, Django ORM and DRF, network protocols, and web or mobile technologies.
Top Skills:
AWSCi/CdDjango OrmDjango Rest FrameworkDockerPostgresPython
What you need to know about the San Francisco Tech Scene
San Francisco and the surrounding Bay Area attracts more startup funding than any other region in the world. Home to Stanford University and UC Berkeley, leading VC firms and several of the world’s most valuable companies, the Bay Area is the place to go for anyone looking to make it big in the tech industry. That said, San Francisco has a lot to offer beyond technology thanks to a thriving art and music scene, excellent food and a short drive to several of the country’s most beautiful recreational areas.
Key Facts About San Francisco Tech
- Number of Tech Workers: 365,500; 13.9% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Google, Apple, Salesforce, Meta
- Key Industries: Artificial intelligence, cloud computing, fintech, consumer technology, software
- Funding Landscape: $50.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Sequoia Capital, Andreessen Horowitz, Bessemer Venture Partners, Greylock Partners, Khosla Ventures, Kleiner Perkins
- Research Centers and Universities: Stanford University; University of California, Berkeley; University of San Francisco; Santa Clara University; Ames Research Center; Center for AI Safety; California Institute for Regenerative Medicine
