Apache Spark

• Should have ability to clean, transform, and analyze vast amounts of raw data from various systems using Scala/Spark to provide ready-to-use data.
• Create Spark jobs for data transformation and aggregation.
• Understanding and working exp in AWS and CI CD
• Good communication skills, team coordination and be proactive with project tasks
• Follow the Agile process and update JIRA for every sprint and meet the target dead lines.