Title: Senior Data Engineer
Bangalore, KA, IN
Job Description
Must Have
Senior Data Engineer
Job Summary: We are looking for an experienced Senior Data Engineer to lead the design and optimization of our data infrastructure. This role requires strong expertise in AWS cloud architecture, scalable pipeline development, data modeling, and orchestration. The candidate will also mentor junior engineers and work closely with analytics and campaign teams to ensure data quality and actionable insights.
Title / Designation: Senior Data Engineer
The Job entails the following but not limited to:
• Architect, design, and optimize data platforms leveraging AWS services (S3, Redshift, Glue, Lambda).
• Build, scale, and maintain robust ETL/ELT pipelines for large-scale data ingestion and transformation.
• Design and implement data models to support analytics and reporting use cases.
• Develop and optimize advanced Python scripts and SQL queries for data processing.
• Implement workflow orchestration using Airflow or AWS Step Functions.
• Lead API integrations with internal and external platforms to enable seamless data exchange.
• Define and enforce data quality checks, validation rules, and monitoring processes.
• Collaborate with analysts, data scientists, and campaign managers to ensure high-quality datasets for analytics.
• Mentor junior engineers, provide technical guidance, and promote best practices in data engineering.
• Contribute to campaign analytics initiatives by ensuring accurate and timely data availability.
• Drive documentation standards by ensuring all pipelines, integrations, and processes are well-documented for maintainability and knowledge sharing.
Job Specification:
• Education/Background:
• Bachelor’s/master’s degree in computer science, Information Technology, Data Engineering or related field.
• 3-5 years of proven experience in data engineering.
• Prior experience in mentoring or leading junior engineers is highly desirable.
• Exposure to campaign analytics/CRM data is a strong plus.
Who are we looking for?
We are looking for people who have/can:
• Strong expertise in AWS architecture & optimization (S3, Redshift, Glue, Lambda).
• Advanced proficiency in Python (automation, ETL frameworks) and SQL.
• Experience in data modeling and building scalable data warehouses.
• Hands-on experience with Airflow or AWS Step Functions for orchestration.
• Proficiency in API development and integrations.
• Strong understanding of data quality frameworks and monitoring practices.
• Exposure to campaign analytics and marketing data platforms.
• Excellent problem-solving skills and ability to work in a fast-paced environment.
• Leadership skills with the ability to mentor and guide junior team members.
Nice to Have:
• Experience with Terraform/CloudFormation for infrastructure as code.
• Knowledge of streaming technologies (Kinesis, Kafka).
• Exposure to CRM integration (SFMC, MS Dynamics, Veeva).
• Familiarity with BI/reporting tools (Tableau, QuickSight).
• AWS Certified Data Analytics – Specialty
• AWS Certified Solutions Architect – Associate/Professional
Good to have
EQUAL OPPORTUNITY