Software Engineer - Cloud and Big Data

Software Engineering

Overview

 

We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served.

 
As a Software Engineer, you will write code for our Fabric-based SaaS platform, build and test new features, and debug distributed systems. You will work with Spark and Spark-based extension frameworks, use AI tools in your daily workflow, and help maintain HDInsight components in production. This role will accelerate your growth in distributed systems, cloud platform engineering, and large-scale data infrastructure.  

Successful candidates will have experience in one or more of these areas: designing and coding cloud-scale SaaS products; building data lakes or data engineering tools; working with big data technologies such as Spark, Kafka, Hadoop, or HBase; enterprise software development in C#, Scala, Java, or Python; and working with the Azure stack (Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, Power BI). 

​We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served. 

Responsibilities

• Write clean, maintainable code in C#, Java, Scala, or Python for Fabric Materialized Lake View services and HDInsight components. Use AI tools and coding best practices across the development lifecycle.
• Explore design options for data refresh, scheduling, and query optimisation features with guidance from senior engineers. Contribute to design documents and technical specifications. 
• Review code from teammates to check for correctness, test coverage, and adherence to team standards. Participate in code reviews to learn coding patterns and build familiarity with the Spark and Fabric codebase. 
• Debug issues in distributed systems running on Azure, Linux, and Windows. Use debugging tools, logs, and telemetry to investigate problems. Learn to conduct incident retrospectives and implement fixes with supervision. 
• Support live site operations on a rotational, on-call basis. Follow playbooks to diagnose and mitigate issues in Fabric and HDInsight services; escalate complex problems to senior engineers. 
• Add logging and instrumentation to gather telemetry on system health, performance, and security for both Fabric and HDInsight workloads. Learn to build dashboards and alerts that surface problems early. 
• Work with product managers, senior engineers, and partners across geographies to understand customer requirements for Materialized Lake View features. Incorporate customer feedback into designs and fixes.

Qualifications

Required Qualifications 

 

​​Bachelor’s degree in computer science or related technical discipline with proven experience coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python; OR equivalent experience.​ 

 

Microsoft Cloud Background Check: 

• This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. 

 

Preferred Qualifications 

 

• ​Master’s degree in computer science or related technical field with proven coding experience; OR Bachelor's + 2 years technical engineering experience; OR equivalent experience.

• Experience with the Azure stack including Storage, Compute, Networking, Fabric, Purview, Synapse, AKS, DevOps, Data Factory, or Power BI. 
• Familiarity with big data technologies such as Spark, Kafka, Hadoop, or HBase. 
• Exposure to data lakes, data engineering tools, or container-based architectures (Docker, Kubernetes)

 

#azdata

#azuredata 

​​#MicrosoftFabric #AzureData #BigData #Analytics #Spark #Kafka​ #EiP

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Experience Level

Mid Level