Sr. Software Engineer - Python Pysaprk

Job Description

• Skill Set : SQL,Python,pyspark,Airflow
• Total Experience : 4.00 to 8.00 Years
• No of Openings : 1
• Job Post Date : 04/08/2026
• Job Expiry Date : 30/09/2026
• Domain : IT
• Location : CHENNAI [India]
• Job Reference No : 4099616

A Bachelor's or Higher Degree is the minimum entry required for the position

Job Summary

Job Title: Data Engineer

Location: TechM Chennai ELCOT

Years of Experience: 2 5 Years

Job Summary:

We are seeking a skilled Data Engineer with a strong foundation in Python to join our dynamic team at TechM in Chennai. The ideal candidate will have 2 5 years of experience in data engineering, with a proven ability to design, develop, and maintain data pipelines and architectures. You will play a crucial role in transforming raw data into actionable insights, ensuring data quality, and supporting data driven decision making across the organization.

Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes to support data integration and analytics.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high quality data solutions.
• Implement data models and structures that optimize data storage and retrieval.
• Monitor and troubleshoot data pipeline performance, ensuring data accuracy and reliability.
• Utilize Python to automate data processing tasks and improve data workflows.
• Document data engineering processes, data flows, and system architecture for future reference.
• Stay updated with industry trends and best practices in data engineering and analytics.

Mandatory Skills:

• Strong proficiency in Python, with experience in data manipulation libraries such as Pandas and NumPy.
• Experience with SQL and relational databases (e.g., MySQL, PostgreSQL).
• Familiarity with data warehousing concepts and tools (e.g., Snowflake, Redshift).
• Knowledge of data pipeline orchestration tools (e.g., Apache Airflow, Luigi).
• Understanding of data modeling and data architecture principles.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) is a plus.

Preferred Skills:

• Experience with big data technologies (e.g., Hadoop, Spark).
• Familiarity with data visualization tools (e.g., Tableau, Power BI).
• Knowledge of machine learning concepts and frameworks.
• Experience with version control systems (e.g., Git).

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 2 5 years of experience in data engineering or a related role.
• Strong analytical and problem solving skills.
• Excellent communication and collaboration abilities.

If you are passionate about data and have a strong background in Python, we encourage you to apply and join our innovative team at TechM. We offer a collaborative work environment and opportunities for professional growth.