Data Engineer IV

Immediate need for a talented Data Engineer IV .This is a 12 months contract opportunity with long-term potential and is located US (Remote). Please review the job description below and contact me ASAP if you are interested.

Job Diva ID: 26-05674

Pay Range: $ 75 - $85 /hour .  Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
 
Key Responsibilities

• Provides technical direction, guides the team on key technical aspects and responsible for product tech delivery
• Lead the Design, Build, Test and Deployment of components
• Where applicable in collaboration with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead)
• Understand requirements / use case to outline technical scope and lead delivery of technical solution
• Confirm required developers and skillsets specific to product
• Provides leadership, direction, peer review and accountability to developers on the product (key responsibility)
• Works closely with the Product Owner to align on delivery goals and timing
• Assists Product Owner with prioritizing and managing team backlog
• Collaborates with Data and Solution architects on key technical decisions
• The architecture and design to deliver the requirements and functionality
• Core Experience and Abilities
• Power Systems engineering experience
• DER Dispatch experience
• Automated fault analysis systems experience
• Ability to perform hands on development and peer review for certain components / tech stack on the product
• Standing up of development instances and migration path (with required security, access/roles)
• Develop components and related processes (e.g. data pipelines and associated ETL processes, workflows)
• Lead implementation of integrated data quality framework
• Ensures optimal framework design and load testing scope to optimize performance (specifically for Big Data)
• Supports data scientist with test and validation of models
• Performs impact analysis and identifies risk to design changes
• Ability to build new data pipelines, identify existing data gaps and provide automated solutions to deliver analytical capabilities and enriched data to applications
• Ensures Test Driven development

Key Requirements and Technology Experience: 

• Key skills: - Python, AWS, Data Pipeline
• Experience leading teams to deliver complex products
• Strong technical skills and communication skills
• Strong skills with business stakeholder interactions
• Strong solutioning and architecture skills
• Experience building real time data ingestion streams (event driven)
• Ensure data security and permissions solutions, including data encryption, user access controls and logging
• Core Technical Skills
• Experience with native AWS technologies for data and analytics such as Athena, S3, Lambda, Glue, EMR, Kinesis, SNS, CloudWatch, etc.
• Tools and Languages such as Django, Python, Java, Scala, Pandas
• Infrastructure as Code technology such as Terraform
• AWS services such as S3, EMR, Glue, Lambda, Athena, Kinesis, EC2, SNS, SQS, Cloudwatch
• Experience with databases such as Redshift, Document DB, DynamoDB and Mongo DB
• Experience transitioning on premise big data platforms into cloud based platforms such as AWS
• Hadoop platform (Hive; HBase; Druid)
• Spark
• PySpark
• SQL
• Workflow Automation
• DevOps pipeline (CI/CD); Bitbucket; Concourse
• API frameworks

Our client is a leading Utility Industry, and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration

Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, colour, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

By applying to our jobs, you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy .

#cha
 J2W:CB3