Title:  Lead Data Engineer

Job Description

We are a technology-led healthcare solutions provider. We are driven by our purpose to enable healthcare organizations to be future-ready. We offer accelerated, global growth opportunities for talent that’s bold, industrious, and nimble. With Indegene, you gain a unique career experience that celebrates entrepreneurship and is guided by passion, innovation, collaboration, and empathy. To explore exciting opportunities at the convergence of healthcare and technology, check out www.careers.indegene.com Looking to jump-start your career? We understand how important the first few years of your career are, which create the foundation of your entire professional journey. At Indegene, we promise you a differentiated career experience. You will not only work at the exciting intersection of healthcare and technology but also will be mentored by some of the most brilliant minds in the industry. We are offering a global fast-track career where you can grow along with Indegene’s high-speed growth. We are purpose-driven.  We enable healthcare organizations to be future ready and our customer obsession is our driving force. We ensure that our customers achieve what they truly want. We are bold in our actions, nimble in our decision-making, and industrious in the way we work.

Must Have

Role: Lead Data Engineer - Databricks

Description:

•    Lead functional teams or projects, managing multiple data engineering initiatives simultaneously to ensure timely delivery.
•    Design, implement, and maintain scalable ETL pipelines using Databricks, PySpark, AWS Glue, and S3 to process and transform large datasets.
•    Query and analyze complex datasets using SQL and Python to support business intelligence and analytics initiatives.
•    Develop and document data models, schemas, and standards to ensure data consistency, usability, and governance.
•    Monitor, troubleshoot, and optimize data pipeline performance and reliability, minimizing downtime and maximizing efficiency.
•    Implement robust data validation and testing techniques to ensure high data quality and integrity.
•    Communicate potential risks, mitigations, and business impacts clearly and promptly to stakeholders.
•    Define technical requirements and design solutions leveraging existing technologies and industry best practices.
•    Solve complex data-related problems by analyzing multiple sources of information and applying innovative approaches.
•    Develop and maintain CI/CD pipelines and automate the deployment of data pipelines, ETL processes, and infrastructure updates.
•    Implement data quality checks and monitoring processes across data pipelines.
•    Ensure all data, processes, and pipelines adhere to security protocols and compliance standards.

 

Desired Profile:

•    7+ years of experience in data engineering, with a focus on Databricks and cloud ETL
•    Proficiency in Databricks, PySpark, SQL, and Python required
•    Should have experience in commercial datasets - IQVIA sales, Veeva CRM, HCP profiles, Marketing, etc, 
•    Demonstrated experience leading data engineering teams or projects.
•    Strong analytical and problem-solving skills, with the ability to handle complex data challenges.
•    Excellent communication and interpersonal skills, enabling collaboration with technical and non-technical stakeholders.
•    Deep understanding of data modeling, schema design, and database management.
•    Knowledge of data quality assurance techniques and compliance requirements.
•    Bachelor’s degree in computer science, Information Systems, or a related field; advanced degree preferred.
•    Pharmaceutical data knowledge is Plus
•    Certifications in relevant technologies Databricks Certified Data Engineer is nice to have.

 

Skills: 
Primary Skills    Databricks, Python, Datamodelling, SQL
Secondary Skills    Data Modelling, Pyspark, ETL, SQL

Good to have

EQUAL OPPORTUNITY

Indegene is proud to be an Equal Employment Employer and is committed to the culture of Inclusion and Diversity. We do not discriminate on the basis of race, religion, sex, colour, age, national origin, pregnancy, sexual orientation, physical ability, or any other characteristics. All employment decisions, from hiring to separation, will be based on business requirements, the candidate’s merit and qualification. We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, colour, religion, sex, national origin, gender identity, sexual orientation, disability status, protected veteran status, or any other characteristics.