Data Engineer II

Immediate need for a talented Data Engineer II. This is a 12 Months Contract opportunity with long-term potential and is located in Charlotte, NC(Hybrid). Please review the job description below and contact me ASAP if you are interested.

Job ID:26-01201

Pay Range: $60 - $65/hour.  Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
 
Key Responsibilities:

• Where applicable, collaborate with Lead Developers (Data Engineer, Software Engineer, Data Scientist, Technical Test Lead) to understand requirements/use cases to outline technical scope and deliver the technical solution
• Collaborate with Data and Solution architects on key technical decisions
• Skilled in developing data pipelines, focusing on long-term reliability and maintaining high data quality
• Design data warehousing solutions with the end-user in mind, ensuring ease of use without compromising on performance
• Manage and resolve issues in production data warehouse environments on AWS

Key Requirements and Technology Experience:

• Must have skills: AWS, Python, Data pipelines 
• 2 years of AWS experience
• AWS services: S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions
• Experience with Kafka, preferably Confluent Kafka
• Experience with Lake Formation,Amazon Redshift and Amazon Athena
• Strong SQL and data modeling skills, executing ETL processes tailored for data warehousing
• Competence in developing and refining data pipelines within AWS
• Extensive understanding of database management fundamentals
• Tools and Languages: Python (good experience in Pyspark) , SQL
• Infrastructure as Code technology: Terraform
• DevOps pipeline (CI/CD): GitHub
• Deep knowledge of IAM roles and Policies
• Experience with AWS workflow orchestration tool like Airflow or Step Functions
• Ability to perform hands-on development and peer review for certain components/tech stack on the product
• Standing up of development instances and migration path (with required security, access/roles)
• Develop components and related processes (e.g., data pipelines and associated ETL processes, workflows)
• Ability to build new data pipelines, identify existing data gaps, and provide automated solutions to deliver analytical capabilities and enriched data to applications
• Ability to implement data pipelines with the right attentiveness to durability and data quality
• Implement data warehousing products thinking of the end user's experience (ease of use with the right performance)

Our client is a leading Utility Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.
 
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy .

#chaJ2W:CB3