Data Engineer

Data Engineer II

Overview
Do you have a relentless passion for data engineering and building platforms that enable decision science at scale? Does processing petabytes of data every day excite you? Do you enjoy designing complex workflows and pipelines that power measurement, insights, and visualization from real-world user data—ultimately driving experiments and recommendations that impact business metrics? If so, we’d love to talk to you!
We are the Windows India Data team, part of the Windows and Web Experiences (WWE) engineering organization. Our mission is to leverage advanced data engineering, analytics, and data science to inform decision-making, drive product performance, and maximize business impact through the power of ML/AI. In short, we thrive on data to solve high-impact business problems for Windows! We’re looking for a solid Data Engineer II to help us foster and scale a data-driven culture across Windows.
As a Software & Data Engineer, you’ll help build and deliver business intelligence for experiences running on 1.5 billion Windows devices. You’ll partner closely with Data Scientists and Analysts to understand their challenges and design next-generation platforms and solutions that make decision-making seamless and scalable.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Authoring and design of Big Data ETL platforms and pipelines in SCOPE, Scala, SQL, Python, or C#.
• Data extraction across a wide variety of data sources.
• Data cleaning, preprocessing, and transformation for further analysis by data analysts.
• Data Validation framework from source to endpoints ensuring data quality and integrity.
• Enable the Data Scientists and Analysts to do more with data across all aspects of the development lifecycle.
• Contribute to a data-driven culture as well as a culture of experimentation across the organization.
• Provide new and improve upon existing data platform offerings with a fundamental understanding of the end-to-end scenarios.
• Enable Data Scientists and other partners to do more with data across all aspects of the development lifecycle by helping democratize data.

Qualifications

Required Qualifications:

• Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR equivalent experience.
• Ability to work and communicate effectively across disciplines and teams.
• Familiarity with distributed data processing and analysis, such as Map-Reduce or Apache Spark.

Preferred Qualifications:

• 3+ years of experience in data engineering.
• Understanding and experience with data cloud computing technologies such as – Azure Synapse, Azure Data Factory, SQL, Azure Data Explorer, Power BI, PowerApps, Hadoop, YARN, Apache Spark.
• Excellent analytical skills with systematic and structured approach to software design.

 

 

#W+DJOBS

This position will be open for a minimum of 5 days, with applications accepted on an ongoing basis until the position is filled.

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance with religious accommodations and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.

Experience Level

Mid Level