Specialist - Data Engineering

Specialist - Data Engineering

Loaction- C V Raman Nagar Bagmane Bangalore
Experience - 5- 8years

The primary focus of this role is to transform heaps of logs and complex configuration data into highperformance data products You will be responsible for the architectural backbone of our observability platform designing robust parsing mechanisms scalable data pipelines and optimized schemas that power both realtime visualizations and Large Language Model LLM implementations

Key Responsibilities

Data Parsing Orchestration Build custom parsing logic to extract meaning from complex log strings eg ChassisNo VariantId and Capability parameters

Pipeline Schema Design Architect and maintain endtoend data pipelines Create and optimize data schemas that improve the performance and retrieval speed of data products over time

Modeling Enrichment Develop sophisticated data models and enrichment layers that connect disparate data points across the ecosystem

Visualization To communicate the findings with stakeholders

AI Implementation Create Vector Embeddings and buildoptimize RAG RetrievalAugmented Generation layers to interface with LLMs for log summarization and predictive insights

Performance Optimization Continuously monitor and slice and dice data structures to reduce latency and improve the accuracy of analyticsdriven insights

CrossFunctional Collaboration Translate business challenges into technical data science projects ensuring quality checks and clear communication of technical concepts to stakeholders

Candidate needs to travel to client office C V Raman Nagar Bagmane for 2 to 3 days or all days wherever applicable