Senior Data Engineer
Quantiphi Analytics Solution Pvt LtdJob Description
Senior Data Engineer
While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
Role: Senior Data Engineer - Snowflake
Experience Level: 4+ Years
Work location: Mumbai, Bangalore & Trivandrum
Notice Period: 0- 15 days
Role & Responsibilities:
Design, develop, and optimize data loading techniques, virtual warehouses, and performance tuning within Snowflake.
Build complex SQL logics, stored procedures, and User-Defined Functions (UDFs) in Snowflake.
Implement and manage Snowflake data sharing and security features.
Design, develop, and orchestrate complex data pipelines using Azure Data Factory (ADF).
Work proficiently with Azure Data Lake Storage Gen2, Azure Blob Storage, and Azure SQL Database.
Integrate Azure Key Vaults for secure credential management within data solutions.
Perform advanced SQL querying, optimization, and data manipulation across various relational database systems.
Implement and manage CI/CD pipelines for data solutions, preferably using Azure DevOps, including version control (Git) and branching strategies.
Develop automated testing for data pipelines and data quality.
Apply solid understanding of dimensional modeling (Star Schema, Snowflake Schema) and data warehousing concepts.
Utilize strong programming skills in Python , Pyspark for data processing, scripting, and automation.
Solve complex analytical and data-related problems with meticulous attention to detail.
Lead the development of data pipelines and orchestration using Azure Data Factory (ADF) for data ingestion, cleansing, and transformation.
Lead, mentor, and conduct code reviews for Junior Data Engineers. Assist in development and developing automated testing for data pipelines and data quality.
Knowledge on financial processes such as budgeting, forecasting, financial reporting, accounts payable/receivable, sage intact general ledger, and treasury operations, and relevant financial regulations.
Skills expectation:
Snowflake Expertise: Deep expertise in Snowflake, data loading techniques, virtual warehouses, and performance tuning. Strong experience with Snowflake SQL / building complex logics, stored procedures, and UDFs. Experience with Snowflake data sharing and security features.
Azure Data Services (Expert): Azure Data Factory (ADF)-> Extensive experience designing, developing, and orchestrating complex data pipelines. Azure Data Storage-> Proficient with Azure Data Lake Storage Gen2, Azure Blob Storage, and Azure SQL Database. Azure Key Vaults-> Hands-on experience integrating Key Vaults for secure credential management.
SQL (Expert): Advanced SQL querying, optimization, and data manipulation skills. Experience with various relational database systems.
CI/CD (Advanced): Proven experience implementing and managing CI/CD pipelines for data solutions, preferably using Azure DevOps. Understanding of version control (Git) and branching strategies. Experience with automated testing for data pipelines and data quality.
Data Modeling: Solid understanding of dimensional modeling (Star Schema, Snowflake Schema) and data warehousing concepts.
Problem-Solving: Excellent analytical and problem-solving skills with a keen eye for detail.
Python: Strong programming skills in Python for data processing, scripting, and automation. Experience with relevant libraries.
Domain Knowledge: Finance / Good to have Sage Intact GL knowledge.
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Experience Level
Senior LevelJob role
Job requirements
About company
Similar jobs you can apply for
Software / Web Developer
Senior Java Developer
Humanique Consulting Private Limited
Software Tester
Tetra Edge Infra LLP
Software Developer
Tpipay Fintech Private Limited
Quality Control Engineer
Garuthmann AerospaceQA / QC Executive
Cube S ConstructionsWordpress Developer
Skeltron Info SolutionsYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 4 to 31 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!