Data Engineer III

Immediate need for a talented Data Engineer III. This is a 12+ Months Contract opportunity with long-term potential and is located in Charlotte, NC(Hybrid). Please review the job description below and contact me ASAP if you are interested.

Job ID:25-66466

Pay Range: $60 - $70/hour.  Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
 
Key Responsibilities:

• Support or collaborate with application developers, database architects, data analysts and data scientists to ensure optimal data delivery architecture throughout ongoing projects/operations.
• Develop, construct, test, and maintain architectures, such as databases and large-scale processing systems that help analyze and process data in the way the Nuclear Data Fabric organization requires.
• Develop highly scalable data management interfaces, as well as software components by employing programming languages and tools.
• Design, document, build, test and deploy data pipelines that assemble large complex data sets from various sources and integrate them into a unified view.
• Identify, design, and implement operational improvements: automating manual processes, data quality checks, error handling and recovery, re-designing infrastructure as needed.
• Build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enrich data to applications.
• Responsible for obtaining data from the System of Record and establishing batch or real-time data feed to provide analysis in an automated fashion.
• Develop techniques supporting trending and analytic decision-making processes
• Apply technologies for responsive front-end experience
• Ensure systems meet business requirements and industry practices
• Research opportunities for data acquisition and new uses for existing data.

Key Requirements and Technology Experience:

• Skills-JAVA, Spring Boot, API Gateways , Rest APIS, AWS, ECS, Container Orchestration , Kafka , Flink , data governance , data engineer , Postgres, PostgreSQL .
• Five (5) or more years of AWS experience using one or more of the associated services - S3, EMR, Glue Jobs, Lambda, Aurora, CloudTrail, SNS, SQS, CloudWatch
• Experience with EMR databases such as Glue Catalog, Lake Formation, Redshift, DynamoDB and Aurora PostgreSQL
• Experience developing REST APIs and API gateways using Java Springboot
• Eight (8) or more years designing, building, and maintaining enterprise-scale databases
• Eight (8) or more years of experience in data warehouse architecture
• Eight (8) or more years SQL experience
• Excellent customer service, requirements gathering, and data analysis skills
• Excellent analytical abilities and documentation skills
• Experience with Kafka/Messaging preferably Confluent Kafka
• Competence in developing and refining data pipelines within AWS
• Proficient in handling both real-time and batch data processing tasks
• Tools and Languages
• Java, Java Spring Boot
• Infrastructure as Code technology
• Terraform/CloudFormation
• AWS Console
• Ability to build DevOps pipelines using GitHub & GitHub Actions.
• Experience with native AWS technologies for data and analytics such as Kinesis, OpenSearch
• Databases - Document DB, Mongo DB
• Python, NodeJS
• Workflow Automation
• Experience transitioning on premise big data platforms into cloud-based platforms
• Strong Background in Kubernetes, Distributed Systems, Microservice architecture and containers
• Deep knowledge of IAM roles and Policies
• Experience using AWS monitoring services like CloudWatch, CloudTrail ad CloudWatch events
• Deep understanding of networking DNS, TCP/IP and VPN
• Experience with AWS workflow orchestration tool like Airflow or Step Functions
• Experience with Secrets Management Platform like Vault and AWS Secrets manager
• Experience with Event Driven Architecture

Our client is a leading natural gas Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.
 
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy .

#cha J2W:CB3