Data Engineer (Databricks, SQL, Python)

We are seeking an experienced Data Engineer with 4 to 5 years of experience, and at least 3+ years of expertise in designing and implementing data solutions using the Databricks platform. The ideal candidate will have a solid background in distributed computing, big data technologies, and cloud platforms.

Key Responsibilities:

• Design, implement, and maintain scalable data solutions using Databricks.
• Work with programming languages such as Python, SQL, or Scala.
• Collaborate with cross-functional teams to deliver data-driven solutions.
• Optimize and manage data pipelines using Apache Spark and cloud services (AWS, Azure, or GCP).
• Leverage DevOps practices to automate deployments and monitor data pipelines.

Key Skills:

• Proficiency in Python, SQL, or Scala.
• Hands-on experience with Databricks and Apache Spark.
• Strong knowledge of cloud platforms like AWS, Azure, or GCP.
• Good understanding of distributed computing and big data technologies.
• Familiarity with containerization (Docker, Kubernetes) and DevOps practices.

Good to Have:

• Experience with containerization technologies (Docker, Kubernetes).
• Knowledge of automated deployment and monitoring for data pipelines.

Qualifications:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field