Hadoop Administrator in Miami, FL at Signature Consultants

Date Posted: 10/1/2020

Job Snapshot

Job Description

Hadoop Administrator Summary:

Signature Consultants is looking for a Hadoop Developer for an opportunity with a client in Miami, FL.

Responsibilities:

  • Install and configure Hadoop clusters and its ecosystem components (Experience with MapR specifically a plus)
  • Manage Hadoop, Sqoop, Drill and Spark cluster environments
  • Manage MAPR storage Volume/Snapshots etc.
  • Hadoop/MAPR Cluster management by adding or removing nodes
  • Manager cluster resource allocation
  • Elasticsearch and Kibana is a plus
  • Apply proper architecture guidelines to ensure highly available services
  • Plan and execute major platform software and operating system upgrades and maintenance across physical environments
  • Develop and automate processes for maintenance of the environment
  • Implement security measures for all aspects of the cluster (SSL, disk encryption, role-based access)
  • Ensure proper resource utilization between the different development teams and processes
  • Design and implement a toolset that simplifies provisioning and support of a large cluster environment
  • Review performance stats and query execution/explain plans; recommend changes for tuning Hive/Drill queries
  • Create and maintain detailed, up-to-date technical documentation
  • Daily monitoring cluster connectivity and performance.
  • Manage and review Hadoop log files.

Requirements:

  • 5+ years hands-on experience with supporting Linux production environments
  • 3+ years of experience in architecting, administrating, configuring, installation and maintenance of Open Source Big-data applications, with focused experience on MapR distribution
  • 3+ years hands-on experience with supporting Hadoop ecosystem technologies in
  • Source Big-data applications, with focused experience on MapR distribution.
  • Expertise in administration of MapR DB / Hive / Drill / Spark / Sqoop / Kafka
  • Scripting experience using Shell, Python or PowerShell
  • Good understanding of High availability
  • Able to implement MapR Data Security using Groups/Roles
  • Implement and manage Cluster security
  • Expert in ACL / Posix ,MapR Control System (MCS) Wire-level security (WLS)
  • Ability to shell script with Linux
  • Ability to troubleshoot problems and quickly resolve issues
  • Cluster maintenance as well as creation and removal of nodes
  • Performance tuning of Hadoop clusters and Hadoop MapReduce routines
  • Screen cluster job performances and capacity planning
  • Monitor cluster connectivity and security
  • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability
  • Collaborating with application teams to install operating system and MapR updates, patches, version upgrades when required"
  • Integration to other Hadoop platforms

About Signature Consultants, LLC

Headquartered in Fort Lauderdale, Florida, Signature Consultants was established in 1997 with a singular focus: to provide clients and consultants with superior staffing solutions. For the ninth consecutive year, Signature was voted as one of the "Best Staffing Firms to Work For" and is now the 15th largest IT staffing firm in the United States (source: Staffing Industry Analysts). With 28 locations throughout North America, Signature annually deploys thousands of consultants to support, run, and manage their clients' technology needs. Signature offers IT staffing, consulting, managed solutions, and direct placement services. For more information on the company, please visit www.sigconsult.com. Signature Consultants is the parent company to Hunter Hollis and Madison Gunn.