Data Engineer
TransUnion
Description
Job Requirements
· Passion for Technology in the field of Data Engineering and Analytics
· Design, build, test and deploy cutting edge Big Data solutions at scale
· Extract, Clean, transform, and analyze vast amounts of raw data from various Data Sources
· Build data pipelines and API integrations with various internal systems
· Work on SAS to Spark migration projects
· Work Across all stages of Data Lifecycle
· Implement best practices across all Data Analytics Processes
· Estimate effort, identify risks and plan execution
· Proactively monitor, identify, and escalate issues or root causes of systemic issues
· Enable data scientists, business and product partners to fully leverage our platform
· Good analytical & problem-solving skills
· Good communication and presentation skills
Work Experience
· · Extensive experience in Big Data technologies like Hive and Spark
o Big Data Technologies – Hadoop HDFS, Hive, Spark, Kafka, Sqoop
· Experience in Shell scripting
· Experience in Python programming language is an advantage
· SAS experience is a plus.
· Experience working in Hadoop Distributions – Cloudera/Hortonworks/Mapr
· AWS or GCP cloud migration experience is an advantage.
· Excellent communication skills and presentation skills
We're looking for a Data Engineer to join our growing Data Engineering and Analytics Practice. You will be based both from our offices in India and working remotely as part of our 'flex together' approach. In this fast-paced role you'll work with Business Stakeholders to achieve business goals. This exciting role will offer a host of development opportunities as part of a growing global business.
About TransUnion
-
