Lead Data Engineer - Data Archival - Bangalore
Photon
Description
Missions
- Job description:
Our team Data-as-a-service is expanding, and we need 3 big data experts to join us!
Today we manage SG Data platform service offers and data tools:
-
Data ingestion: to ingest the data from a data source
-
Data processing: to process, transform and distribute the data to the target location
-
Data exposition : to distribute and expose the data hosted in the data platform
-
Data cleaning: to purge the data on the Lake in a secure way
-
Data tools: data formatter, data anonymizer
As a big data engineer, you'll develop, maintain and create new cloud-oriented features hand-by-hand with DDS/Data Foundation teams to bring forward the data approach across all SG entities and subsidiaries.
Profile
-
Experience: 3-5 Years
-
Skills:
-
Computer programming: Spark, Scala, Java, Python
-
Operating system knowledge for Unix, Linux
-
Databases and SQL
-
ETL and data warehousing
-
Hadoop
-
Apach Spark
Tasks:
-
Maintain an excellent service level of the platform and avoid issues.
-
Researching new methods of obtaining valuable data and improving its quality
-
Creating and enhancing data solutions using various programming languages and tools
-
Creating and enhancing data architectures that meet the requirements of the business
-
Communicate inside if the tech league group to find new approaches
Eligibility Criteria
- Experience: 3+ years
- Seniority: Mid Level
- Languages: English
About Photon
-
