Azure Databricks DevSecOps Engineer

Azure Databricks with DevSecOps

• Experience: 9–14 years of overall IT experience with significant hands-on exposure to cloud-based operations and automation. • Proven expertise in Azure DevOps with end-to-end ownership of CI/CD pipelines, release management, and integration with Azure services over multiple projects. • Strong hands-on experience with Databricks administration and operations, including workspace setup, cluster management, job orchestration, and performance optimization in production environments. • Solid understanding of Azure cloud services relevant to data and analytics (e.g., storage, networking, identity, and monitoring) and how they integrate with Databricks and Azure DevOps. • Practical experience with secure operations in Azure, applying security best practices, role-based access control, and governance in day-to-day operations. • Ability to analyze and resolve complex operational issues in distributed systems, with strong debugging, problem-solving, and communication skills. Infosys is a global leader in next-generation digital services and consulting. We enable clients in more than 50 countries to navigate their digital transformation. With over four decades of experience in managing the systems and workings of global enterprises, we expertly steer our clients through their digital journey. We do it by enabling the enterprise with an AI-powered core that helps prioritize the execution of change. We also empower the business with agile digital at scale to deliver unprecedented levels of performance and customer delight. Our always-on learning agenda drives their continuous improvement through building and transferring digital skills, expertise, and ideas from our innovation ecosystem. Infosys provides equal employment opportunities to applicants and employees without regard to race, color, sex, gender identity; sexual orientation, religious practices and observances; national origin; pregnancy, childbirth, or related medical conditions; status as a protected veteran or spouse/family member of a protected veteran; or disability. Design, implement, and maintain Azure DevOps pipelines for Databricks and related Azure services, enabling automated build, test, and deployment processes for data and analytics workloads. • Operate and optimize Databricks environments including workspace configuration, cluster policies, job scheduling, and performance tuning for large-scale data processing and analytics use cases. • Establish and enforce operational standards for monitoring, logging, alerting, and incident management across Azure and Databricks platforms, ensuring high availability and reliability. • Collaborate with data engineering and analytics teams to industrialize notebooks, jobs, and workflows into robust, production-grade solutions using Azure DevOps and Databricks best practices. • Implement security and compliance controls in alignment with Azure SecOps guidelines, including access management, network security, secrets management, and audit logging for Databricks and Azure resources. • Drive automation and Infrastructure as Code (IaC) for provisioning and managing Azure and Databricks resources, reducing manual effort and configuration drift. • Troubleshoot complex production issues across CI/CD pipelines, Databricks jobs, and Azure services, performing root cause analysis and implementing long-term fixes and improvements. • Partner with architecture and platform teams to define standards, patterns, and reusable components for Azure DevOps and Databricks operations across multiple projects and business units. • Mentor and guide junior engineers on DevOps practices, Databricks operations, and secure cloud operations, fostering a culture of continuous learning and improvement. • Document operational procedures and best practices for deployment, monitoring, incident response, and change management in the Azure and Databricks ecosystem.