Hadoop Developer in Charlotte, NC at Signature Consultants

Date Posted: 5/3/2021

Job Snapshot

Job Description

Job Summary:

Signature Consultants is seeking a Hadoop Developer for an opportunity with a client located in Charlotte, NC.

Responsibilities:

  • Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB and object storage architecture
  • Design and build the data services on container-based architecture such as Kubernetes and Docker Partner with Enterprise data teams such as Data Management & Insights and Enterprise Data Environment (Data Lake) and identify the best place to source the data
  • Work with business analysts, development teams and project managers for requirements and business rules
  • Collaborate with source system and approved provisioning point (APP) teams, Architects, Data Analysts and Modelers to build scalable and performant data solutions
  • Effectively work in a hybrid environment where legacy ETL and Data Warehouse applications and new big-data applications co-exist
  • Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure
  • Work with DBAs in Enterprise Database Management group to troubleshoot problems and optimize performance
  • Support ongoing data management efforts for Development, QA and Production environments
  • Utilizes a thorough understanding of available technology, tools, and existing designs
  • Leverage knowledge of industry trends to build best in class technology to provide competitive advantage
  • Acts as expert technical resource to programming staff in the program development, testing, and implementation process

Required Skills:

  • Software engineering experience
  • ETL (Extract, Transform, Load) Programming experience
  • Agile experience
  • Hadoop experience
  • Java or Python experience
  • Design and development experience with columnar databases using Parquet or ORC file formats on Hadoop
  • Apache Spark design and development experience using Scala, Java, Python or Data Frames with Resilient
  • Distributed Datasets (RDDs)
  • Experience integrating with IBM BPM RESTful API

Preferred Skills:

  • operational risk, conduct risk or compliance domain experience
  • Experience with containers: Dockers, Kubernetes
  • Experience with Amazon Web Services (AWS), Azure, Object Storage, Elastic Compute Cloud, OnDemand compute, etc.

About Signature Consultants, LLC

Headquartered in Fort Lauderdale, Florida, Signature Consultants was established in 1997 with a singular focus: to provide clients and consultants with superior staffing solutions. For the ninth consecutive year, Signature was voted as one of the "Best Staffing Firms to Work For" and is now the 14th largest IT staffing firm in the United States (source: Staffing Industry Analysts). With 28 locations throughout North America, Signature annually deploys thousands of consultants to support, run, and manage their clients' technology needs. Signature offers IT staffing, consulting, managed solutions, and direct placement services. For more information on the company, please visit www.sigconsult.com. Signature Consultants is the parent company to Hunter Hollis and Madison Gunn.

EEO Employer

Signature Consultants is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Signature will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or 888.838.1020.