
Senior Data Engineer
Creole Studios
Description
Engineering & Platform Development
-
Design, develop, and maintain scalable batch and real-time data pipelines.
-
Build and optimize ETL/ELT workflows using modern data engineering frameworks.
-
Develop and manage data lake, data warehouse, lake house architecture and snowflakes.
-
Implement data quality checks, validation frameworks, and monitoring solutions.
-
Optimize data processing jobs for performance, scalability, and cost efficiency.
-
Collaborate with analytics, BI, and AI teams to deliver trusted datasets.
-
Build and maintain cloud-native data platforms on AWS, Azure, or GCP.
-
Implement Infrastructure as Code (IaC) using Terraform or equivalent tools.
-
Support CI/CD implementation for data engineering workloads.
-
Ensure security, compliance, and governance standards across data platforms.
-
Work directly with stakeholders to understand business requirements and translate them into technical solutions.
-
Participate in architecture discussions, design reviews, and sprint planning.
-
Perform code reviews and mentor junior engineers.
-
Contribute to technical documentation, standards, and reusable assets.
Innovation & Practice Building
- Evaluate and recommend modern data engineering tools and frameworks.
- Contribute to internal accelerators, reusable components, and best practices.
- Support proof-of-concepts and emerging technology initiatives in analytics, AI, and data platforms.
Eligibility Criteria
- Design, develop, and maintain scalable batch and real-time data pipelines.
- Build and optimize ETL/ELT workflows using modern data engineering frameworks.
- Develop and manage data lake, data warehouse, lake house architecture and snowflakes.
- Implement data quality checks, validation frameworks, and monitoring solutions.
- Optimize data processing jobs for performance, scalability, and cost efficiency.
- Collaborate with analytics, BI, and AI teams to deliver trusted datasets.
- Build and maintain cloud-native data platforms on AWS, Azure, or GCP.
- Implement Infrastructure as Code (IaC) using Terraform or equivalent tools.
- Support CI/CD implementation for data engineering workloads.
- Ensure security, compliance, and governance standards across data platforms.
About Creole Studios
Creole Studios is an Indian IT services company specializing in web and mobile app development.
