Full Stack Data Engineer

•Generate code artifacts and use version control (git) •Infra as Code, Data Ingestion – Streaming, relational, file-based •SQL, Python, Java, GCP Services •Data Modeling & Design for Scalability and performance •Optimization of code •System Design •GCP •Astronomer •Data and Software Engineering best practices (automation, infra as code, CI/CD, testing, etc.) •Ability to work with business stakeholders to determine data model needs and work backwards to sources and scalability

Work on a Portfolio Engineering Portfolio Team based in Chennai to deliver curated data products and perform end to end Full stack Data engineer role.
Work effectively with fellow data engineers, product owners, data champions and other technical experts.
Demonstrate technical knowledge and communication skills with the ability to advocate for well-designed solutions.
Develop exceptional analytical data products using both streaming and batch ingestion patterns on Google CloudPlatform with solid data warehouse principles.
Be the Subject Matter Expert in Data Engineering with a focus on GCP native services and other well integrated third-party technologies.

5+ years of SQL development and analytics/data product development experience.
3+ years of cloud experience (GCP preferred) with solutions designed and implemented at production scale.
Experience working in GCP native (or equivalent) services like Big Query, Google Cloud Storage, PubSub, Dataflow,Dataproc, Cloud Build, etc.
Experience working with Airflow for scheduling and orchestration of data pipelines.
Experience working with Terraform to provision Infrastructure as Code.
2 + years professional development experience in Java or Python.
Bachelor’s degree in computer science or related scientific field.
Experience in analyzing complex data, organizing raw data, and integrating massive datasets from multiple datasources to build analytical domains and reusable data products.
Experience in working with architects to evaluate and productionalize data pipelines for data ingestion, curation, andconsumption.
Experience in working with stakeholders to formulate business problems as technical data requirements, identify andimplement technical solutions while ensuring key business drivers are captured in collaboration with productmanagement.

Experience Level

Mid Level