Hadoop Admin
Hadoop Migration Admin.
• Should have experience in Hadoop migration projects.
• Should have experience on migration tools.
• Should have experience on handling issues that come up during Hadoop migration and provide instant • solution that would come up during migration.
• Should have work experience in creating scripts and tuning the parameters to modfity codes to handle migration issues.
• OS loading & configuration of name nodes, data nodes and edge nodes in Hadoop cluster
• Configure NFS shares on Data Lake storage nodes & mount across Hadoop cluster nodes
• Installing and upgrading Java on Hadoop nodes
• Installing Hadoop packages
• Performance management (CPU, Memory & disk performance issues)
• Kernel parameter tuning
• Disk management (configuring filesystem, extending filesystem)
• RAID configuration (redundancy for OS drives)
• Hardware issues (add and remove drives, memory)
• Network management (configure IP address, network bonding)
• Upgrade BIOS & network card drivers
• Vendor management (support for hardware & OS)
Day to day Hadoop support
• Monitoring Hadoop Services (HDFS, Yarn, Hive, Impala, Hue, Solr, Zookeeper, Kafka, Spark,
Sqoop, Sentry etc). using Cloudera manager.
• Monitoring the jobs and informed to Onsite team to failed jobs as well log information.
• Identify the failed jobs and gathering log data and fixed the issues.
• Handling the tickets with Hadoop related issues to resolve the with in SLA and priority wise.
Responsibility’s:
• Hadoop cluster setup, installation, configuration of multi-node cluster using Cloudera
distributions of Hadoop framework services.
• Cluster level security implementation using Kerberos authentication and ACL’s as well.
• Hive databases, tables, column level security implementation using Sentry authorization.
• Hadoop cluster upgradation
• Commission/decommission the nodes into Hadoop cluster.
• Implementing High availability with Name node and Resource manager.
• Integrate AD with Hadoop cluster.
• Hadoop cluster troubleshooting and improve the cluster performance.
• Prepared technical documentation.
• Helping with our support team members to create the schemas, partitions in hive and impala and remove/add the files into HDFS directory.
• Migrating the hive databases & tables and HDFS files from HDPPDEV cluster to HDPPRD2
cluster.
Should take care of issues like below.
• Integrating AD with SVN.
• Data content must be given by the CLIENT.
• Third-party dependency their response/ resolution etc.
• Defects due to hardware failures.
• Wrong data input provide already by customer.
HARMAN is proud to be an Equal Opportunity / Affirmative Action employer. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, gender (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics.