Big Data Engineer in Atlanta, GA at Pyramid Consulting, Inc

Date Posted: 9/3/2019

Job Snapshot

Job Description

Immediate need for a talented Big Data Engineer with experience in the Transportation Industry. This is a 6+ Months contract opportunity with long-term potential and is located in Atlanta, GA. Please review the job description below.
Job ID: 19-21060

Key Responsibilities:
  • The successful candidate must have Big Data engineering experience and must demonstrate an affinity for working with others to create successful solutions.
  • Join a smart, highly skilled team with a passion for technology, where you will work on our state of the art Big Data Platforms (Cloudera).
  • He/She must be a very good communicator, both written and verbal, and have some experience working with business areas to translate their business data needs and data questions into project requirements.
  • The candidate will participate in all phases of the Data Engineering life cycle and will independently and collaboratively write project requirements, architect solutions and perform data engineering development and support duties.
Key Requirements and Technology Experience:
  • 4+ years of overall IT experience
  • 2+ years experience with stream-processing/workflow systems: Apache Nifi, Storm, Spark-Streaming, etc.
  • 2+ years experience with Big Data tools: Hadoop, Spark, Kafka, etc.
  • 2+ years experience with SQOOP for data ingestion from databases like Teradata, Db2, SQL Server and Oracle
  • 2+ years experience with data ingestion from different file formats across different platforms like JSON, XML, CSV
  • 2+ years experience with relational SQL and NoSQL databases, including HBASE and Cassandra
  • 2+ years experience building and optimizing 'Big Data' data ingestion pipelines, architectures and data sets
  • Experience in translating business requirements to SQL-based ETL
  • Knowledge of Unix/Linux platform and shell scripting
  • Strong analytical and problem solving skills
  • Proficient testing skills – unit, system and integration
  • Strong verbal/written communication and presentation skills
  • Experience with Cloudera/Hortonworks HDP and HDF platforms
  • Strong SQL skills with ability to write intermediate complexity queries
  • Strong understanding of Relational & Dimensional modeling
  • Experience with Client/GIT code versioning software
  • Experience with Tibco BW
  • Experience with REST API and Web Services
  • Good business analyst and requirements gathering/writing skills
  • Experience with Crontab/Oozie Job scheduler
  • Proficiency with Microsoft Office Suite
  • Railroad knowledge and experience
Our client is a leading Transportation Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.