Lead Data Engineer with Expertise in Pyspark, AWS, and SQL

Lead Software Engineer – Data Engineer with Pyspark AWS SQL

We have an opportunity to impact your career and provide an adventure where you can push the limits of what's possible.

As a Manager of Software Engineer at JPMorgan Chase within the Technology Division, you are part of an agile team that works to enhance, design, and deliver the software components of the firm’s state-of-the-art technology products in a secure, stable, and scalable way. As an emerging member of a software engineering team, you execute software solutions through the design, development, and technical troubleshooting of multiple components within a technical product, application, or system, while gaining the skills and experience needed to grow within your role.

 

Job responsibilities :

• Manage data integration and data analysis of disparate systems
• Build extensible data acquisition and integration solutions to meet the functional and non-functional requirements of the client
• Implement processes and logic to extract, transform, and distribute data across one or more data stores from a wide variety of sources
• Provide problem-solving expertise and complex analysis of data to develop business intelligence integration designs
• Interface with other internal product development teams as well as cross functional teams (Product Management, Integration Engineering, Quality Engineering, System Admin Teams)
• Working with remote and geographically distributed teams to enable building the right products, using the right building blocks, and making them consumable by other products easily

 

Required qualifications, capabilities, and skills:

• Formal training or certification on software engineering concepts and 5+ years applied experience
• Hands on  experience in data integration projects using Big Data Technologies
• Hands on experience with a minimum of 5 years on Spark and Scala along with experience on building streaming applications using Kafka
• Strong experience in CICD using Jenkins, Git, Artifactory, Yaml, Maven for Cloud deployments
• Java opensource, API, JUnits, Spring Boot applications, Swagger Setup
• Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala- Strong experience in integrating data from different types of file-storage formats like Parquet, ORC, Avro, Sequence files etc.
• Strong technical understanding in building scalable, high performance distributed services/systems
• Strong knowledge of Data Warehousing and Data Lake concepts ; Possesses strong problem solving, troubleshooting, and analytical skills
• Having excellent communication, presentation, interpersonal, and analytical skills including the ability to communicate complex concepts clearly to different audiences

• Experience in technologies like Oracle/SQL and NoSQL data stores such as DynamoDB

   

Preferred qualifications, capabilities, and skills:

• Experience in AWS Data Warehousing and database platforms preferred
• Ability to quickly learn new technologies in a dynamic environment
• Experience in managing team of at least 5-10 engineers. 
• Big data experience preferably related to human resources analytics

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

Experience Level

Senior Level