Data Engineer

About Crisil Limited

We are a leading, agile, and innovative global analytics company driven by our purpose to make markets function better. We are a bold organization powered by deep expertise, unparalleled analytics and relentless innovation. We collaborate seamlessly to deliver mission critical insights thereby instilling & amplifying client's success.

Life at Crisil

Be the impact

Drive growth with a strong sense of purpose.

Create lasting impact that affects individuals, businesses, and the society at large.

That's what 'Life@Crisil' is all about.

This is where you unlock the next chapter of your career - fueled by our caring culture which encourages you to learn and innovate, an environment that fosters positivity through our people-first approach and an attractive rewards & benefits program that puts your growth in the spotlight. An inspiring setting where you will find the brightest minds, inspiring you to unleash your potential.

Crisil is a place where your ideas and opinions are always welcome, and continuous learning is the norm. Because we know that's what it takes to solve the biggest real-world challenges and move the needle in the direction of unexplored future possibilities. All without compromising on our strong ethics.

So go ahead. Unlock the next chapter of your career.

Be the impact that transforms the world.

Job Description

Job Summary: We are seeking a highly skilled Database Software Engineer with 4-6 years of experience to join our team. The successful candidate will be responsible for designing, developing, and maintaining our database systems and ETL pipelines, ensuring high performance, scalability, and reliability. The Database Software Engineer will work closely with our development team to ensure that our database systems meet the requirements of our applications and services.

Key Responsibilities:

1. Database Design and Development:

• Design and develop database architectures to support business requirements
• Develop and maintain database models, including entity-relationship diagrams and schema definitions
• Implement database security measures to ensure data integrity and confidentiality

1. ETL Pipeline Development:

• Design and develop ETL pipelines to extract, transform, and load data from various sources
• Develop and maintain ETL scripts using Python and other programming languages
• Ensure data quality and integrity throughout the ETL process

1. Data Integration and Migration:

• Integrate data from various sources, including APIs, files, and databases
• Develop and execute data migration plans to ensure seamless data transition

1. Database Performance Optimization:

• Analyze and optimize database performance, including query optimization and indexing
• Implement caching and other techniques to improve database performance

1. Collaboration and Communication:

• Work closely with development teams to ensure database systems meet application requirements
• Communicate database design and implementation plans to stakeholders
• Provide technical guidance and support to junior team members

Technical Requirements:

1. Programming Languages:

• PLSQL
• Python
• PySpark

1. Database Management Systems:

• Databricks
• Experience with relational databases (e.g. MySQL, PostgreSQL, Oracle)

1. ETL Tools:

• Experience with any open source ETL tools

1. Data Formats:

• Experience with various data formats (e.g. CSV, JSON, Avro, Parquet)

1. Operating Systems:

• Familiarity with AWS cloud-based platforms

Nice to Have:

1. Experience in Power BI
2. Certifications:
3. Experience with:

• Data warehousing and business intelligence tools (e.g. Tableau, Power BI)
• Containerization and orchestration tools (e.g. Docker, Kubernetes)

Example of PySpark skills we are looking for:

• Experience with Python ETL frameworks : PySpark

Example of ETL skills we are looking for:

• Experience with any open source ETL tools
• Familiarity with data integration frameworks (e.g. Apache NiFi, AWS Glue)
• Knowledge of data quality and data governance best practices
• Experience with data migration and data warehousing concepts

Open Positions

1

Mandatory Skills

Data Warehousing,Database Development,Databricks

Location

Pune, Maharashtra, India

Education Qualification

B. E, B. Tech, M.C.A, CDAC or similar

Experience

3 to 6 years