Hadoop Administrator

Role – Hadoop Administrator

About The Role

• We are looking for an experienced Hadoop Administrator (MapR) to manage and support our production‑grade MapR Hadoop clusters.
• The ideal candidate will have hands‑on experience running mission‑critical, multi‑tenant Hadoop environments, ensuring high availability, performance, and security across diverse workloads.

Key Responsibilities

• Manage, monitor, and optimize MapR‑based Hadoop clusters in a production environment.
• Oversee daily operations, including cluster health checks, performance tuning, capacity planning, and system upgrades.
• Perform installation, configuration, patching, and version upgrades for MapR distributions and ecosystem tools.
• Configure, support, and optimize multi‑tenant setups, ensuring isolation, resource fairness, and performance SLAs.
• Manage YARN queues, ACLs, quotas, and security policies per tenant requirements.
• Collaborate with data engineering and analytics teams to onboard new tenants and align resource needs.

Performance & Troubleshooting

• Diagnose and resolve cluster performance issues, bottlenecks, and failures across MapR FS, YARN, Spark, Hive, Kafka, and related services.
• Manage node failures, job failures, and cluster rebalancing while maintaining uptime.
• Automate alerting, monitoring, and reporting using tools like MapR Control System (MCS), Grafana, Nagios, Prometheus, or similar.

Security & Compliance

• Implement and manage security features such as Kerberos, Ranger/Sentry policies, SSL encryption, and user/role management.
• Ensure compliance with internal and external standards for data governance and security.

Backup, Disaster Recovery, & High Availability

• Maintain reliable backup and DR strategies using MapR snapshots, mirrors, and failover configurations.
• Ensure 24/7 availability of production environments and participate in on‑call rotation.

Automation & Scripting

• Develop automation for operational tasks using Python, Shell scripting, or Ansible.
• Streamline cluster provisioning, monitoring, and deployment pipelines.

Required Skills & Qualifications

• 4+ years of hands‑on experience as a Hadoop/MapR Administrator.
• Strong knowledge of MapR‑FS, MapR‑DB, MapR Streams, YARN, Hive, Spark, and Kafka.
• Experience managing production clusters with high availability requirements.
• Proficiency in Linux administration (RHEL/CentOS/Ubuntu).
• Expertise with multi‑tenant Hadoop environments, resource governance, and user management.
• Strong skills in shell scripting, automation, and performance tuning.
• Experience with monitoring tools (Grafana, Nagios, Prometheus, MapR MCS).
• Understanding of Hadoop security (Kerberos, SSL, ACLs, AD integration).

Preferred Qualifications

• Experience migrating from MapR to other Hadoop distributions (Cloudera, Hortonworks) – a plus.
• Knowledge of Cloud (AWS/Azure/GCP) big data services.
• Experience with CI/CD pipelines, Dev Ops tools, or containerized big data workloads.

Mandatory Skills

• Exp in Hadoop Admin, linux, unix, MapR, Grafana, Spark, Hive, kafka.
• Candidates should have minimum 2 to 3 years of exp.

If you are interested, share us your resume at

Life At Capgemini

Capgemini supports all aspects of your well‑being throughout the changing stages of your life and career. For eligible employees, we offer:

• Healthcare including dental, vision, mental health, and well‑being programs
• Financial well‑being programs such as 401(k) and Employee Share Ownership Plan
• Paid time off and paid holidays
• Paid parental leave
• Family building benefits like adoption assistance, surrogacy, and cryopreservation
• Social well‑being benefits like subsidized back‑up child/elder care and tutoring
• Mentoring, coaching and learning programs
• Employee Resource Groups
• Disaster Relief

Disclaimer

Capgemini is an Equal Opportunity Employer encouraging diversity in the workplace. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity/expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.

This is a general description of the Duties, Responsibilities and Qualifications required for this position. Physical, mental, sensory or…