← Back to jobs
PPhoton

Lead Data Engineer - Data Archival - Bangalore

Photon

-
Full-Time
3-6 Years experience

Description

Missions

  • Job description:

Our team Data-as-a-service is expanding, and we need 3 big data experts to join us!

Today we manage SG Data platform service offers and data tools:

  • Data ingestion: to ingest the data from a data source

  • Data processing: to process, transform and distribute the data to the target location

  • Data exposition : to distribute and expose the data hosted in the data platform

  • Data cleaning: to purge the data on the Lake in a secure way

  • Data tools: data formatter, data anonymizer

As a big data engineer, you'll develop, maintain and create new cloud-oriented features hand-by-hand with DDS/Data Foundation teams to bring forward the data approach across all SG entities and subsidiaries.

Profile

  • Experience: 3-5 Years

  • Skills:

  • Computer programming: Spark, Scala, Java, Python

  • Operating system knowledge for Unix, Linux

  • Databases and SQL

  • ETL and data warehousing

  • Hadoop

  • Apach Spark

Tasks:

  • Maintain an excellent service level of the platform and avoid issues.

  • Researching new methods of obtaining valuable data and improving its quality

  • Creating and enhancing data solutions using various programming languages and tools

  • Creating and enhancing data architectures that meet the requirements of the business

  • Communicate inside if the tech league group to find new approaches

Eligibility Criteria

  • Experience: 3+ years
  • Seniority: Mid Level
  • Languages: English

About Photon

-

Industry: no-mentionEmployees: 7500+Website