Sr/Lead Data Engineer

Job Description- Data Engineer Level 3 (Model Behavior, Azure, Databrix, Synapse)

Position Overview

• We are looking for a highly skilled, hands-on Senior Data Engineer to join our Data & Analytics team.

• In this role, you will play a key part in building and scaling client's behavioral and Ecommerce data platform, enabling trusted analytics and making AI-ready data available across the organization.

• You will be responsible for designing and implementing robust, scalable data pipelines, modeling complex, high-volume datasets, and delivering high-quality, well-structured data products to power business insights and future AI capabilities.

• This is a delivery-focused engineering position demanding deep technical expertise in Azure, Databricks, and Synapse, combined with experience managing large-scale behavioral data in enterprise environments.

• Translating business needs into technical specifications and platform capabilities is a critical part of this role.

​

Key Responsibilities

• Design, build, and maintain robust, scalable ELT/ETL pipelines and data transformations using Databricks, Spark, and Synapse.

• Model high-volume, complex event-level datasets (digital behavior, Ecommerce transactions, marketing interactions) to support dashboards, experimentation, ML models, and marketing activation.

• Enforce data governance, discover ability, and stewardship using Unity Catalog and Alation, ensuring compliance and lineage tracking.

• Validate and reconcile data pipelines against established behavioral datasets such as Adobe Customer Journey Analytics (CJA) and Adobe Analytics.

• Partner with data architects, analysts, data scientists, and marketing teams to deliver trusted, reusable, and well-structured datasets that power BI dashboards and decision making.

• Mature the data ingestion, processing, orchestration, and curation capabilities leveraging Delta Lake optimization, Databricks Workflows, and Synapse for analytical consumption.

• Support and optimize semantic models and data marts that enable self-service analytics through AI/BI Dashboards and Power BI.

• Participate in agile delivery processes (sprint planning, backlog refinement, documentation), collaborating through Jira and Confluence.

• Document data assets, transformations, and pipelines for discoverability, transparency, and long-term maintainability.

• Facilitate clear and continuous communication between business and engineering teams. Note to Vendors

• This contract role will be part of Customer Experience, supporting the Data & Analytics team.

•

​

Requirements

Required Qualifications

•7+ years of experience in data engineering or similar roles, with hands-on delivery of cloud-based data solutions.

• Preferred Engineering certifications: Microsoft Certified: Azure Data Engineer Associate and Databricks: Databricks Certified Data Engineer Professional

• Strong expertise in Databricks and Azure Synapse, with practical experience in Sparkbased data processing.

• Proficient in modern data architectures (Lakehouse, ELT/ETL pipelines, real-time data processing).

• Advanced SQL skills for data transformation and performance optimization.

• Proven ability to model and manage large-scale, complex behavioral and Ecommerce datasets.

• Expert in BI and best practices for data enablement and self-service analytics.

• Hands-on experience with Unity Catalog and data cataloging tools (e.g., Alation) for governance and metadata management.

• Working knowledge of behavioral analytics platforms (Adobe Analytics, Adobe Customer Journey Analytics).

• Excellent communication skills with a talent for translating technical concepts into business value.

• Experience operating in agile delivery environments, balancing speed, scalability, and solution quality.

• Proven leadership as a technical lead

Benefits

​