DevOps Engineer w/ Hadoop in Charlotte, NC at Signature Consultants

Date Posted: 8/31/2020

Job Snapshot

Job Description

DevOps Engineer w/ Hadoop Summary:

Signature Consultants is seeking an DevOps Engineer with experience on Hadoop platform for an opportunity in Charlotte, NC. As a platform admin & DevOps Engineer, you will be responsible for the installing/upgrading CDH components, setting up new clusters, collaborating with SA team on OS revisions, conducting capacity planning, optimizing platform performance, testing/troubleshooting Hadoop components, and exploring new big data tools & technologies. This person should have around 5-7 years of experience.


DevOps Engineer and Platform Admin for a large Hadoop data & analytics environment running on CDH 6.2 /CDP 7.x & RHEL 6/7 environments. The platform is shared by multiple applications and multiple development teams. As a platform admin & DevOps engineer - install/upgrade CDH components, set up new clusters, collaborate with SA team on OS revisions, conduct capacity planning, optimize platform performance, test/troubleshoot Hadoop components, explore new big data tools & technologies; collaborate with development teams to create common libraries, establish Hadoop programming standards/best practices, CI/CD automation with Ansible.

Required Skills:

  • Must have 3+ yrs Cloudera, 7+ yrs in data oriented solutions. 3+ years in configuring/managing Hadoop components (Sqoop, Impala, Spark, Hive, HDFS, Oozie, HUE, HBase, Kafka, Nifi). Programming experience in Java and strong Linux Shell scripting and automation skills.
  • Ability to work independently, and on multiple deliverables at the same time with aggressive deadlines.
  • Solid understanding of Linux OS, networking, security using Kerberos/Active Directory/SSL/PowerBroker, space management to run Hadoop on bare metal servers.
  • Familiarity with Python notebooks, Cloud computing, Kubernetes/Docker containers, Object Storage, mysql administration for metadata, software development using continuous integration and deployment are desirable.
  • Experienced in Agile methods & Jira storyboarding. Familiarity with DW, ETL & BI technologies.

Critical/Niche Skills:

  • Must have 3+ yrs Cloudera
  • 7+ yrs in data oriented solutions
  • 3+ years in configuring/managing Hadoop components (Sqoop, Impala, Spark, Hive, HDFS, Oozie, HUE, HBase, Kafka, Nifi
  • Experience level: 7 Years
  • Hadoop, ansible, scripting and automation

About Signature Consultants, LLC
Headquartered in Fort Lauderdale, Florida, Signature Consultants was established in 1997 with a singular focus: to provide clients and consultants with superior staffing solutions. For the ninth consecutive year, Signature was voted as one of the "Best Staffing Firms to Work For" and is now the 15th largest IT staffing firm in the United States (source: Staffing Industry Analysts). With 28 locations throughout North America, Signature annually deploys thousands of consultants to support, run, and manage their clients' technology needs. Signature offers IT staffing, consulting, managed solutions, and direct placement services. For more information on the company, please visit Signature Consultants is the parent company to Hunter Hollis and Madison Gunn.