Senior Data Engineer - Teradata/Databricks & AI/ML
NTT DATA Global Delivery Services Ltd
Work from Office
Full Time
Min. 5 yearsJob Description
Senior Data Engineer - Teradata/Databricks & AI/ML
• Ingest and validate 18+ months of Teradata DBQL logs including SQL text, object usage, timestamps, user/application IDs, row counts, and steps.
• Integrate metadata from Autosys (scheduling), DataStage (orchestration), and MagicWand (observability) to supplement DBQL analysis.
• Build end-to-end, log-driven analysis pipelines in Databricks to identify unused datasets, read-only (non-updating) datasets, and unused partitions within active datasets.
• Capture and analyze CPU/IO resource usage and workload statistics (ResUsage) to quantify cost-reduction opportunities.
• Classify data into cold, warm, and hot tiers; generate heatmaps of date/partition access patterns.
• Develop a prioritized recommendation backlog with expected savings, risk levels, and required changes.
• Apply AI/ML models or LLM-assisted analysis to detect access pattern anomalies, predict cold data candidates, and automate classification.
• Produce and present deliverables: Observation Report, Workshop Notes & Action Log, and Final Readout for customer stakeholders.
Experience Level
Senior LevelJob role
Job requirements
About company
Similar jobs you can apply for
Manufacturing / ProductionQA Engineer
Sidra Tech SolutionsWork from OfficeFull TimeMin. 1 year
Good (Intermediate / Advanced) EnglishSoftware Tester AI3
XportsWork from OfficeFull TimeAny experienceGood (Intermediate / Advanced) English
QA / QC Manager
Aira Kiran HR and Labour SolutionsWork from OfficeFull TimeMin. 3 yearsGood (Intermediate / Advanced) EnglishProduct Executive
Nemus PharmaceuticalsWork from OfficeFull TimeAny experienceGood (Intermediate / Advanced) English
Quality Control Engineer
M/s Vardhaman Pressure Die CastingWork from OfficeFull TimeAny experienceBasic English
Mobile App Developer
Iaksr GroupWork from Office
Part TimeFull TimeMin. 1 yearBasic EnglishYou can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.
The candidate should have completed the required education and people who have 5 to 31 years are eligible to apply for this job. You can apply for more jobs in Bengaluru/Bangalore to get hired quickly.
The candidate should have sound communication skills and sound communication skills for this job.
Both Male and Female candidates can apply for this job.
No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Bengaluru/Bangalore at apna.
No work-related deposit needs to be made during your employment with the company.
Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.
The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Bengaluru/Bangalore . Through apna, you can find jobs in 64 cities across India. Join NOW!