Data Engineer

Data Engineer II

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we’re helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Title and Summary

Data Engineer IIMastercard is the global technology company behind the worlds fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of PricelessÆ. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities. Services within Mastercard is responsible for acquiring, engaging, and retaining customers by managing fraud and risk, enhancing cybersecurity, and improving the digital payments experience. We provide value-added services and leverage expertise, data-driven insights, and execution.

As a Data Engineer in Data Platform & Engineering Services (DPES), you will have the opportunity to Build and test high performance data pipelines which load into Mastercard Data Warehouse. Our Data Warehouse provides analytical capabilities to number of business users who help different customer provide answer to business problems through data. You will play a vital role within a rapidly growing organisation, while working closely with experienced and driven engineers to solve challenging problems.

1. Overview
We are looking for a motivated and skilled Data Engineer to join our team and contribute to our Big Data ecosystem. In this role, you will be responsible for building and maintaining secure, scalable data pipelines that support critical financial insights. You will work closely with senior engineers and business stakeholders to translate requirements into technical implementations, ensuring data quality within the Payment & Credit Card Ecosystem. If you are passionate about coding, eager to learn complex data systems, and ready to build high-performance pipelines for large-scale datasets, we want to hear from you.

2. Role
Pipeline Development: Build, test, and maintain data pipelines using Spark and Scala/Python/Java on Hadoop or object storage (e.g., MinIO/S3), ensuring code is efficient and reliable.
Data Integrity: Assist in maintaining data lineage and quality. You will implement data quality checks and validation logic to ensure deliverables meet business requirements and integrity standards.
Domain Learning: Actively develop an understanding of the Financial Credit Card Transaction Lifecycle (Authorization, Clearing, and Settlement) to ensure your technical work aligns with financial business logic.
Operational Support: Monitor pipeline health and collaborate with the Operations team to troubleshoot failures. You will help ensure jobs are completed on time and contribute to meeting Service Level Agreements (SLAs).
Security Implementation: Implement security and privacy controls within data solutions as defined by senior architects to protect sensitive large datasets.
Automation: Create scripts and workflows to automate data ingestion and routine tasks, helping to reduce manual effort in data movement and access.
Adherence to Standards: Follow established Software Development standards and engineering principles. Participate in code reviews to ensure best practices are maintained within the Big Data space.
Incident Resolution: Assist in the root-cause analysis and resolution of production incidents, working alongside senior team members to restore services rapidly.
3. All About You / Experience
Technical Proficiency: Solid programming skills in Scala, Python, or Java, with working knowledge of Apache Spark and Big Data processing frameworks.
Storage Knowledge: Familiarity with Oracle, Hadoop ecosystems or Object Storage solutions (MinIO, AWS S3).
Data Format Proficiency: Deep experience parsing, validating, and handling various structured and semi-structured file types including JSON, Parquet, Fixed Width, CSV, and Avro.
Data Mindset: You understand data structures and modeling. You have experience identifying data quality issues and writing code to validate data accuracy. You understand the best practices required to handle petabyte-sized data.
Process Oriented: You are disciplined in following engineering processes (CI/CD, Version Control) and are eager to provide feedback on how to improve team efficiency.
Collaborative Learner: You are a strong team player who communicates well. You are capable of working on assigned tasks independently but know when to ask for guidance or escalate issues.
Domain Interest: An interest in or basic familiarity with Financial Transaction Data Processing is a plus.

Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

• Abide by Mastercard’s security policies and practices;

• Ensure the confidentiality and integrity of the information being accessed;

• Report any suspected information security violation or breach, and

• Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines.

Experience Level

Mid Level