AWS, Pyspark

%3Cp class=%22MsoNormal%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3ESkill%3C/strong%3E: Pyspark, AWS%3C/span%3E%3C/span%3E%3C/p%3E%3Cp class=%22MsoNormal%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EExp%3C/strong%3E: 6 to 12 years%3C/span%3E%3C/span%3E%3C/p%3E%3Cp class=%22MsoNormal%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3ELocation%3C/strong%3E: Pune%3C/span%3E%3C/span%3E%3C/p%3E%3Cp class=%22MsoNormal%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EJob Summary%3C/strong%3E%3C/span%3E%3C/span%3E%3C/p%3E%3Cp class=%22MsoNormal%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EWe are seeking an experienced%26nbsp;AWS PySpark Developer%26nbsp;to design, develop, and optimize large-scale data processing pipelines in the cloud. The ideal candidate will have strong expertise in%26nbsp;PySpark,%26nbsp;AWS services, and%26nbsp;ETL workflows, with a focus on building scalable, high-performance data solutions for analytics and reporting.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/p%3E%3Cp class=%22MsoNormal%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EKey Responsibilities%3C/strong%3E%3C/span%3E%3C/span%3E%3C/p%3E%3Cul style=%22margin-top:0cm;%22 type=%22disc%22%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l1 level1 lfo1;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EDesign, develop, and maintain%26nbsp;ETL pipelines%26nbsp;using%26nbsp;PySpark%26nbsp;on AWS.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l1 level1 lfo1;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EWork with large datasets to perform%26nbsp;data cleansing, transformation, and aggregation.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l1 level1 lfo1;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EOptimize Spark jobs for performance and cost efficiency.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l1 level1 lfo1;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EIntegrate data from multiple sources including%26nbsp;AWS S3, RDS, Redshift, DynamoDB, and APIs.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l1 level1 lfo1;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EImplement%26nbsp;data quality checks%26nbsp;and ensure compliance with governance policies.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l1 level1 lfo1;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3ECollaborate with data analysts, data scientists, and business stakeholders to deliver data solutions.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l1 level1 lfo1;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EDeploy and monitor jobs using%26nbsp;AWS Glue, EMR, Step Functions, or Lambda.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l1 level1 lfo1;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3ETroubleshoot and resolve issues in production data pipelines.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l1 level1 lfo1;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EMaintain documentation for data flows, transformations, and architecture.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3C/ul%3E%3Cp class=%22MsoNormal%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3ERequired Skills %26amp; Qualifications%3C/strong%3E%3C/span%3E%3C/span%3E%3C/p%3E%3Cul style=%22margin-top:0cm;%22 type=%22disc%22%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l2 level1 lfo2;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3E3–7 years%26nbsp;of experience in data engineering or big data development.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l2 level1 lfo2;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EStrong proficiency in%26nbsp;PySpark%26nbsp;and%26nbsp;Spark SQL.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l2 level1 lfo2;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EHands-on experience with%26nbsp;AWS services%26nbsp;such as:%3C/strong%3E%3C/span%3E%3C/span%3E%3Cul style=%22margin-top:0cm;%22 type=%22circle%22%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l2 level2 lfo2;tab-stops:list 72.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3ES3, Glue, EMR, Lambda, Athena, Redshift, IAM%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3C/ul%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l2 level1 lfo2;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3ESolid understanding of%26nbsp;ETL concepts%26nbsp;and%26nbsp;data warehousing.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l2 level1 lfo2;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EProficiency in%26nbsp;Python%26nbsp;for scripting and automation.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l2 level1 lfo2;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EExperience with%26nbsp;version control%26nbsp;(Git) and CI/CD pipelines.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l2 level1 lfo2;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EStrong problem-solving skills and ability to work in an agile environment.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3C/ul%3E%3Cp class=%22MsoNormal%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EPreferred Skills%3C/strong%3E%3C/span%3E%3C/span%3E%3C/p%3E%3Cul style=%22margin-top:0cm;%22 type=%22disc%22%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l0 level1 lfo3;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EExperience with%26nbsp;AWS Glue Studio%26nbsp;and%26nbsp;Glue Catalog.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l0 level1 lfo3;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EKnowledge of%26nbsp;Airflow%26nbsp;or other orchestration tools.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l0 level1 lfo3;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EFamiliarity with%26nbsp;streaming data%26nbsp;using Kafka or Kinesis.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l0 level1 lfo3;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EExposure to%26nbsp;Terraform%26nbsp;or%26nbsp;CloudFormation%26nbsp;for infrastructure as code.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3Cli class=%22MsoNormal%22 style=%22mso-list:l0 level1 lfo3;tab-stops:list 36.0pt;%22%3E%3Cspan style=%22font-family:%26quot;Calibri%26quot;,sans-serif;font-size:10.0pt;%22%3E%3Cspan style=%22line-height:115%;%22%3E%3Cstrong%3EUnderstanding of%26nbsp;data security and encryption%26nbsp;in AWS.%3C/strong%3E%3C/span%3E%3C/span%3E%3C/li%3E%3C/ul%3E%3Cp class=%22MsoNormal%22%3E%26nbsp;%3C/p%3E