P
Test : Data Integration Developer
Pearce Services
Mohali
Full-Time
0-3 Years experience
Description
We are seeking an experienced and talented Data Engineer to join our growing team. As a Data Engineer, you will be responsible for designing, implementing, and optimizing data solutions leveraging Snowflake. The ideal candidate should have a deep understanding of data engineering principles, expertise in Snowflake architecture, and a passion for building scalable and efficient data pipelines.
Responsibilities:
- Design and implement scalable data architectures using Snowflake, ensuring optimal performance, reliability, and scalability.
- Work to define best practices for data modeling, storage, and processing within the Snowflake environment.
- Develop, implement, and maintain robust ETL processes using Snowflake's native features and tools in collaboration with integration developers using an IPAAS like SnapLogic.
- Collaborate with data consumers to understand data requirements, ensure the availability of high-quality, well-organized data, and deliver effective solutions.
- Optimize and tune Snowflake data warehouses to achieve optimal query performance and resource utilization.
- Design and implement effective data models that align with business requirements and industry best practices.
- Ensure data models are optimized for Snowflake's unique capabilities, such as automatic clustering and metadata indexing.
- Implement and enforce data security measures in accordance with industry standards and organizational policies.
- Develop and maintain automated processes for data pipeline orchestration, monitoring, and alerting.
- Proactively identify and address performance bottlenecks and data inconsistencies.
- Create and maintain comprehensive documentation for data engineering processes, workflows, and Snowflake configurations.
Qualifications:
- Bachelor's degree in computer science, Information Technology, or a related field.
- Proven experience as a Data Engineer with a focus on Snowflake.
- Strong SQL proficiency and expertise in designing and optimizing complex queries.
- In-depth knowledge of Snowflake architecture, features, and best practices.
- Experience with scripting languages (Python or equivalent) for automation and data manipulation.
- Familiarity with data warehousing concepts, cloud computing, and distributed systems.
Preferred Skills:
- Snowflake certifications (e.g., SnowPro Core, SnowPro Advanced).
- Experience with other cloud platforms (AWS, Azure, GCP).
- Familiarity with data versioning and lineage tracking.
About Pearce Services
-
