Senior Data Engineer in Fort Lauderdale, FL at Signature Consultants

Date Posted: 10/29/2019

Job Snapshot

Job Description

Senior Data Engineer Summary:

Signature Consultants has an opportunity for the senior lever Data Engineer to work on a contract position with one of our clients located in Fort Lauderdale, Florida. The role of the Senior Data Engineer is responsible for building and maintaining optimized and highly available data pipelines that facilitate deeper analysis and reporting. The engineer's duty is to monitor the existing metrics, analyze data, and lead partnerships with other Data and Analytics teams in an effort to identify and implement systems and process improvements. This engineer also designs, architects, implements, and supports key datasets.

Responsibilities:

  • Design and develop highly scalable and reliable data engineering pipelines to process large volumes of data across many data sources in the cloud
  • Identify, design and implement internal process improvements by automating manual processes and optimizing data delivery
  • Develop and promote best practices in data engineering
  • Develop real-time data processing applications using Google Cloud
  • Be part of the on-call rotation supporting our SLA's
  • Participate in design and code reviews

Qualifications:

  • Bachelor's degree in Computer Science or equivalent experience in a related field
  • 5+ years of hands-on experience working in data warehousing or data engineering environment
  • Strong Python and Advanced SQL programming skills
  • 3+ years' experience developing data solutions on GCP or AWS
  • Experience in ingestion of data from external APIs and data stores
  • Experience in design, build and operationalization of big data pipelines on Cloud Technologies.
  • Can-do attitude on problem-solving, quality and ability to execute
  • Strong experience in authoring, scheduling, and monitoring of workflows (Apache Airflow related technologies)
  • Strong communication & interpersonal skills

Preferred Skills:

  • Google Cloud Certified - Professional Data Engineer certification would be a plus
  • Knowledge of Git, Jinja2, Docker, Bitbucket, and Bamboo
  • Familiar with a NoSQL database such as MongoDB
  • Familiar with version control systems (Git and Bitbucket)
  • Familiar with Atlassian products Jira and Confluence
  • Hands-on experience with Apache Airflow or Google Composer

Technical Requirements:

  • Proficient in Python
  • SQL
  • Apache Airflow
  • Some UC4
  • Google Cloud
  • Docker and Kubernetes
  • BitQuery for requests
  • API's for documentation
  • Informatica

About Signature Consultants, LLC

Headquartered in Fort Lauderdale, Florida, Signature Consultants was established in 1997 with a singular focus: to provide clients and consultants with superior staffing solutions. For the ninth consecutive year, Signature was voted as one of the "Best Staffing Firms to Work For" and is now the 15th largest IT staffing firm in the United States (source: Staffing Industry Analysts). With 28 locations throughout North America, Signature annually deploys thousands of consultants to support, run, and manage their clients' technology needs. Signature offers IT staffing, consulting, managed solutions, and direct placement services. For more information on the company, please visit www.sigconsult.com. Signature Consultants is the parent company to Hunter Hollis and Madison Gunn.