Ikon Staffing Solutions Pvt. Ltd.

Senior Hadoop Administrator and Engineer

Job Location:  Gurugram
Job Description:  SkillSet: hadoop, hive, linux, sqoop, pig.

Roles and Responsibilities

  • Manage large scale Hadoop environments, handle builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.
  • Evaluate and recommend systems software and hardware for the enterprise system including capacity modeling.
  • Architect our Hadoop infrastructure to meet changing requirements for scaling, reliability, performance and manageability.
  • Work with core production support personnel in IT and Engineering to automate deployment and operations of the infrastructure. Manage, deploy, and configure infrastructure with Ansible or other automation tool sets.
  • Create metrics and measures of utilization and performance.
  • Increase capacity by planning to implement new/upgraded hardware and software including storage infrastructure.
  • Ability to work well with a global team of highly motivated and skilled personnel - interaction and dialogue are requisites in our dynamic environment.
  • Research and recommend innovative solutions, and where possible, automated approaches for system administration tasks.
  • Identify approaches that leverage our resources, provide economies of scale, and simplify remote/global support issues.
  • Monitor and maintain cluster connectivity and performance.
  • Configure cluster to get the best performance for our requirement.
  • Identify faulty nodes and programmatically isolate them to avoid process/job failures.
  • Monitor file system to maintain data locality and accessibility.
  • Keep track of all the Hadoop jobs and recommend optimization.
  • Qualifications
  • 9+ years of professional experience supporting production medium to large scale Linux environments.
  • 5 years of professional experience working with Hadoop (HDFS & MapReduce) and related technology stack.
  • A deep understanding of Hadoop design principals, cluster connectivity, security and the factors that affect distributed system performance.
  • Experience on Kafka, HBase is mandatory.
  • MapR and MySQL experience a plus.
  • Solid understanding of automation tools (puppet, chef, ansible).
  • Expert experience with at least one if not most of the following languages; python, PERL, Ruby, or Bash.
  • Prior experience with remote monitoring and event handling using Nagios, ELK.
  • Solid ability to create automation with chef, puppet, ansible or a shell.
  • Good collaboration & communication skills, the ability to participate in an interdisciplinary team.
  • Strong written communications and documentation experience.
  • Knowledge of best practices related to security, performance, and disaster recovery.

Functional Area:  General / Other Software,Sales / BD
Experience:  6 - 9 years
Qualification:  ("Other in Other")
Salary:  8 Lakh to 14 Lakh INR
Ikon Staffing Solutions Pvt. Ltd.
Job Ad publication date: 24 Feb 2021  

Related Jobs

Related Jobs