Big Data Platform Architect in Charlotte, NC at Signature Consultants

Date Posted: 11/10/2020

Job Snapshot

Job Description

Data Architect Summary:

Signature Consultants is looking for Big Data Platform Architect to be a part of the development of next-generation enterprise big data platform that supports every line of business. Candidates must be well-versed in building Big Data analytical platforms using containerization, cloud technologies and Big Data parallel processing technologies as well as the advantages, disadvantages and trade-offs of various architecture approaches. Candidate will be responsible for developing architecture and deployment plans for Big Data implementations. As a Big Data Platform Architect candidate should have sound knowledge and architecture experience with Big Data tools, Data Science tools and libraries, Machine Learning, Streaming Data and Enterprise Data Warehousing. Candidate should be able to help accelerate our customer's journey to Private Cloud by moving and improving existing Hadoop installations, modernizing their data lakes with emerging and proven industry trends. Must be familiar with agile methods and related SDLC tools.


  • Design and Develop Big Data architecture patterns on on-prem and Private Cloud platforms
  • Work on new product evaluation, certification, defining standards for tool fitment to the platform
  • Develop technical architecture for enabling Big Data services using industry best practices for large scale processing
  • Design, build, and automate Big Data solutions centered around the Kubernets container orchestration platform
  • Stand up architecture review, operating model, routines, and evaluation criteria for Big Data container platform adoption by applications
  • Maintain in-depth knowledge of the organization's technologies and architectures.
  • Ensure the reference architecture is optimized for larger workloads and come up with recommended tuning techniques
  • Develop standards and methodologies for benchmarking, performance, evaluation, testing, data security and data privacy
  • Communicate architectural decisions, plans, goals and strategies.
  • Participate in regular scrum calls to track progress, resolve issues, mitigate risks and escalate concerns in a timely manner
  • Contribute to the development, review, and maintenance of requirements documents, technical design documents and functional specifications

Required Skill Set:

  • Experience in Big Data/Analytics/Data science tools and a good understanding of the leading products in the industry are required along with passion, curiosity and technical depth
  • Thorough understanding and working experience in Cloudera/Horton Hadoop distributions
  • Solid functional understanding of the Big Data Technologies, Streaming and NoSQL databases
  • Experience in working with Big Data eco-system including tools such as YARN, Impala, Hive, Flume, HBase, Sqoop, Apache Spark, Apache Storm, Crunch, Java, Oozie, SQOOP, Pig, Scala, Python, Kerberos/Active Directory/LDAP
  • Experience in solving Streaming use cases using Spark,Kafka,NiFi
  • Thorough understanding, strong technical/architecture insight and working experience in Docker,Kubernets
  • Containerization experience with Big Data stack using Open Shift/Azure
  • Exposure to Cloud computing and Object Storage services/platforms
  • Experience with Big Data deployment architecture, configuration management, monitoring, debugging and security
  • Experience in performing Cluster Sizing exercise based on capacity requirements
  • Ability to build strong partnership with internal teams, vendors on resolving product gaps/issues and escalate to the management on timely manner
  • Good Exposure to CI/CD tools, application hosting, containerization concepts
  • Excellent verbal and written skills, Team skills, Proficient with MS Visio, Strong analytical and problem solving skills
  • Must be a self-starter, excellent communication and interpersonal skills.
  • Strong problem solving and analytical skills
  • Effective verbal and written communication skills

EEO Employer

Signature Consultants is an equal opportunity employer. We do not discriminate or allow discrimination on the basis of race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), age, sexual orientation, gender identity, national origin, ancestry, citizenship, genetic information, registered domestic partner status, marital status, disability, status as a crime victim, protected veteran status, political affiliation, union membership, or any other characteristic protected by law. Signature will consider qualified applicants with criminal histories in a manner consistent with the requirements of applicable law. If you have visited our website in search of information on employment opportunities or to apply for a position, and you require an accommodation in using our website for a search or application, please contact our Employee Services Department at or 888.838.1020.

About Signature Consultants, LLC

Headquartered in Fort Lauderdale, Florida, Signature Consultants was established in 1997 with a singular focus: to provide clients and consultants with superior staffing solutions. For the ninth consecutive year, Signature was voted as one of the "Best Staffing Firms to Work For" and is now the 14th largest IT staffing firm in the United States (source: Staffing Industry Analysts). With 28 locations throughout North America, Signature annually deploys thousands of consultants to support, run, and manage their clients' technology needs. Signature offers IT staffing, consulting, managed solutions, and direct placement services. For more information on the company, please visit Signature Consultants is the parent company to Hunter Hollis and Madison Gunn.