Paytm Services Private Limited

Hadoop Administrator

Paytm Services Private Limited
Noida
Not disclosed
Work from OfficeWork from Office
Full TimeFull Time
Min. 2 yearsMin. 2 years

Job Description

Hadoop Administrator

Job Description: Hadoop Administrator

Role Overview
We are looking for an experienced Hadoop Administrator to manage, maintain, and upgrade our on-premises Hadoop clusters. The role involves working on Apache Hadoop versions 2.7.1 and 3.4.x, ensuring cluster stability, performance, and scalability, along with ecosystem components like Hive and YARN.

 Key Responsibilities

1. Cluster Administration:
- Install, configure, and manage on-prem Hadoop clusters based on Apache Hadoop (versions 2.7.1 and 3.4.x)
- Administer and monitor Hadoop Distributed File System (HDFS) including storage management, replication, and data balancing
- Manage resource allocation and scheduling using Apache YARN

2.  Upgrade & Migration:
- Hadoop upgrades (2.7 → 3.4) in on-prem environments
- Perform Cluster migration, Data validation (HDFS checksums, block integrity) & Backward compatibility validation for jobs
- Experience with migration tools and distribution changes

3. Ecosystem Management
- Administer and optimize Apache Hive (query tuning, metastore management)
- Work with ecosystem tools like Spark (basic admin exposure preferred) & Tez (execution engine for Hive)
- Ensure high availability for Hive Metastore and critical services

4.  Performance & Optimization
- Monitor cluster health, job performance, and resource utilization
- Tune YARN queues and capacity scheduler, Hive queries and execution plans, Disk, memory, and network utilization
- Implement performance improvements for large-scale data processing

5.  Security & Governance
- Configure authentication/authorization
- Ensure data security and compliance policies
- Manage access controls and audit logs

6.  Troubleshooting & Support
- Provide support for Hadoop cluster issues
- Troubleshoot Node failures, Job failures (Hive/YARN) & Data inconsistencies
- Perform log analysis and root cause identification

7.  Backup & DR
- Plan and manage backup and disaster recovery strategies
- Implement DistCp-based replication & DR cluster setup (active-passive / active-active)

Required Skills
- Strong hands-on experience with Apache Hadoop (2.7.x and 3.x)
- Expertise in Apache YARN, Apache Hive & HDFS administration
- Experience in on-prem cluster setup and hardware-level optimization
- Linux administration (RHEL/CentOS/Ubuntu)
- Shell scripting for automation

Job role

Work location
Work locationNoida, Uttar Pradesh
Department
DepartmentData Science & Analytics
Role / Category
Role / CategoryDBA / Data warehousing
Employment type
Employment typeFull Time
Shift
ShiftDay Shift

Job requirements

Experience
ExperienceMin. 2 years

About company

Name
NamePaytm Services Private Limited
Job posted by Paytm Services Private Limited

Similar jobs you can apply for

Software / Web Developer

Web Developer – WordPress, Shopify & Landing Pages (AI Tools)

Valuora
Sector 153, Noida
₹15,000 - ₹22,000
Work from Office
Full Time
Min. 1 year
Good (Intermediate / Advanced) English

Quality Engineer

Roots Sanjeevani
Noida Extension, Noida
₹25,000 - ₹35,000
Work from Office
Full Time
Min. 6 months
Basic English
BM Digital Utlization

Laravel Developer

BM Digital Utlization
Sector 63, Noida
₹15,000 - ₹25,000
Work from Office
Full Time
Any experience
Good (Intermediate / Advanced) English
Emphatic Vans & Testing Labs

Quality Control Engineer

Emphatic Vans & Testing Labs
Sector 63, Noida
₹15,000 - ₹24,500*
Work from Office
Full Time
Min. 1 year
Good (Intermediate / Advanced) English
Bizmart Infotech

Wordpress Developer

Bizmart Infotech
Sector 63, Noida
₹18,000 - ₹25,000
Work from Office
Full Time
Min. 2 years
Basic English
BM Digital Utlization

Flutter Developer

BM Digital Utlization
Sector 63, Noida
₹15,000 - ₹25,000
Work from Office
Full Time
Any experience
Good (Intermediate / Advanced) English

You can expect a minimum salary of 0 INR. The salary offered will depend on your skills, experience and performance in the interview.

The candidate should have completed the required education and people who have 2 to 31 years are eligible to apply for this job. You can apply for more jobs in Noida to get hired quickly.

The candidate should have sound communication skills and sound communication skills for this job.

Both Male and Female candidates can apply for this job.

No, it's not a work from home job and can't be done online. You can explore and apply for other work from home jobs in Noida at apna.

No work-related deposit needs to be made during your employment with the company.

Go to the apna app and apply for this job. Click on the apply button and call HR directly to schedule your interview.

The last date to apply for this job is . For more details, download apna app and find Full Time jobs in Noida . Through apna, you can find jobs in 64 cities across India. Join NOW!