Capco Technologies Pvt Ltd

Senior Data Engineer

Capco Technologies Pvt Ltd
Bengaluru/Bangalore
Not disclosed
Work from OfficeWork from Office
Full TimeFull Time
Min. 5 yearsMin. 5 years

Job Description

Data Engineer - Scala

Job Title: Senior Data Engineer - Scala

Job Description:

The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data pipelines and building out new API integrations to support continuing increases in data volume and complexity. They will collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.

Responsibilities:

  • Design, construct, install, test and maintain highly scalable data management systems & Data Pipeline.
  • Ensure systems meet business requirements and industry practices.
  • Build high-performance algorithms, prototypes, predictive models, and proof of concepts.
  • Research opportunities for data acquisition and new uses for existing data.
  • Develop data set processes for data modeling, mining and production.
  • Integrate new data management technologies and software engineering tools into existing structures.
  • Create custom software components and analytics applications.
  • Install and update disaster recovery procedures.
  • Collaborate with data architects, modelers, and IT team members on project goals.
  • Provide senior level technical consulting to peer data engineers during data application design and development for highly complex and critical data projects.

Qualifications:

  • Bachelor's degree in computer science, Engineering, or related field, or equivalent work experience.
  • Proven 5-8 years of experience as a Senior Data Engineer or similar role.
  • Experience with big data tools: Python, Hadoop, Spark, Pyspark & Scala
  • Expert level SQL skills for data manipulation (DML) and validation (DB2).
  • Experience with data pipeline and workflow management tools.
  • Experience with object-oriented/object function scripting languages: Python, Java, Go lang etc.
  • Strong problem solving and analytical skills.
  • Excellent verbal communication skills.
  • Good interpersonal skills.
  • Ability to provide technical leadership for the team.

Experience Level

Senior Level

Job role

Work location
Work locationIndia - Bengaluru
Department
DepartmentData Science & Analytics
Role / Category
Role / CategoryData Science & Machine Learning
Employment type
Employment typeFull Time
Shift
ShiftDay Shift

Job requirements

Experience
ExperienceMin. 5 years

About company

Name
NameCapco Technologies Pvt Ltd
Job posted by Capco Technologies Pvt Ltd

Similar jobs you can apply for

Logistics/ Warehouse operations
Packaid Ecopack Private Limited

Quality Assistant

Packaid Ecopack Private Limited
Margondanahalli, Bengaluru/Bangalore
₹16,000 - ₹22,000*
Work from Office
Full Time
Any experience
Basic English

Quality Control Engineer

Pragathi IT Solutions
Peenya, Bengaluru/Bangalore
₹18,000 - ₹22,000
Work from Office
Full Time
Night Shift
Freshers only
Basic English

Software Developer

Frame Culture Private Limited
Rajaji Nagar, Bengaluru/Bangalore
₹30,000 - ₹60,000
Work from Office
Full Time
Min. 3 years
Basic English

Audio Evaluator — Speech Quality Assessment (Hindi/Tamil/Telugu/Urdu/Odia)

Arctic Engines
Work From Home
₹25,000 - ₹45,000
Full Time
Min. 6 months
Basic English
Edizi Tools Private Limited

Quality Assurance Executive

Edizi Tools Private Limited
Electronics City, Bengaluru/Bangalore
₹19,000 - ₹24,000*
Work from Office
Full Time
Freshers only
Good (Intermediate / Advanced) English

Automation Test Engineer

MNC company
Kumaraswamy Layout, Bengaluru/Bangalore
₹1,20,000 - ₹1,49,999
Work from Office
Full Time
Min. 5 years
Good (Intermediate / Advanced) English