Lead Engineer – Data Platform

As a member of the Lighthouse Analytics organization, you'll join the Tracking team, which establishes the fundamental data architecture for PayPal's analytical systems. Our mission is to create seamless data experiences for those building data products by providing various frameworks and services that empower engineers to operate efficiently while enabling their users to extract meaningful insights from data.

Your way to impact:

Are you passionate about solving complex and interesting problems? Want to be part of high impact team? As part of the team, you’ll design robust data architectures and build efficient ingestion pipelines that transform raw information into actionable insights, while ensuring seamless integration with analytics tools through thoughtful system design. By applying performance optimization techniques across the data processing lifecycle, you’ll deliver solutions that balance speed, scalability, and quality control. You’ll implement comprehensive monitoring systems that maintain data integrity and facilitate proactive maintenance, minimizing disruptions to business operations. Through collaborative leadership, you’ll bridge technical and business perspectives, guiding cross-functional teams to develop data solutions that directly support strategic objectives and drive organizational success. If you are self-driven, passionate, a team-player and have effective communication skills, this role will fascinate you!

Your Day to Day: 

• Write clean and solid code that scales over PB of data 
• Work within a team of highly talented engineers, product and architects to design and develop a highly scalable and configurable Platform 
• Being involved in design meetings to propose, discuss and refine new features and functionality 
• You must have business knowledge and technical expertise in application design and architecture, as well as knowledge of related domains of technical architectures, information architectures, and data architectures 
• You will be involved in all aspects of the project life cycle, from the initial kickoff through the requirements analysis, design and implementation 
• Must be a self- starter, work independently or as a team member, and have strong communication skills in interfacing with business partners and the Technology, will also be responsible for communicating to stakeholders on technical standards, principles, methodology and trends 
• Highly analytical, innovative, and able to think strategically and to develop comprehensive detailed specifications. 
• Highly effective at working in cross-functional groups and getting results in matrix organizations. 
• Experience in engineering support of a product through a PDLC. 
• Maintain and enhance the existing architectural documentations and create the new one as needed 

What You Need to Bring  

• 7+ years’ experience and a bachelor’s degree in computer science or equivalent. 
• Hands on experience in developing data pipelines using Spark or Flink using programming technologies like Scala or Java. 
• Working experience in Big Data technologies like Big Query, Redshift, Big Table, Pub Sub, Kafka, DBT, Amazon EMR. 
• Experience with data modeling, ETL (Extraction, Transformation & Load) concepts, and patterns for efficient data governance. 
• Knowledge of design and implementation of Rest API & Spring framework would be a good addition to the overall skill set. 
• Experience with Design Patterns, MVC and frameworks. 
• A deep understanding of data structures, object-oriented design, and algorithms. 
• Experience working with large-scale, highly available, and distributed systems. 
• Ability to analyze requirements and transform them into scalable software designs. 
• Competent in design/implementation for reliability, availability, scalability, and performance. 
• Competent in software engineering tools (e.g. Java build tools) and best practices (e.g. unit testing, test automation, continuous integration, etc.) 
• Should be a strong advocate of code craftsmanship, good coding standards and use of tools that will improve the quality of the delivered code. 
• Demonstrate a high level of curiosity, passion for technology, pride of ownership and strive for excellence. 
• Experience with using Agile/Scrum methodology for software development. 
• Experience to interact with engineering teams from multiple geo-locations. 
• Experience with Docker and Kubernetes will earn some brownie points