Data Engineer

Job Title: Data Engineer

Job Description:

• Design, build, and maintain scalable data pipelines using PySpark and Python

• Develop and optimize complex SQL queries for large datasets

• Implement and manage ETL/ELT processes ensuring data quality and reliability

• Collaborate with business and product teams to translate data requirements into solutions

• Build and maintain data warehouse solutions

• Handle large-scale data processing using Hadoop/Big Data technologies

• Perform performance tuning and optimization of data workflows

Required Skills:

• Strong hands-on experience with PySpark and Python

• Advanced proficiency in SQL

• Solid experience in ETL processes and data warehousing

• Familiarity with Hadoop ecosystem and Big Data technologies

• Experience working with large datasets in distributed environments

• Good communication and business understanding

Good to Have:

• Experience with Apache Airflow

• Exposure to cloud platforms (AWS, GCP, Azure)

• Knowledge of data lakes and modern data architectures

• Experience with streaming tools (Kafka, Spark Streaming)