Data Engineer

Immediate need for a talented Data Engineer. This is a 12 months contract opportunity with long-term potential and is located in Westlake, TX (Onsite). Please review the job description below and contact me ASAP if you are interested.

Job ID: 26-00331

Pay Range: $75 - $80/hour.  Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).

Key Responsibilities:

• Architect and Design scalable, secure, and high-performance data pipelines for on-prem and cloud environments.
• Develop and Enhance automated ETL/ELT workflows leveraging modern frameworks and best practices.
• Modernize Legacy Systems by migrating data pipelines to cloud-native solutions.
• Implement CI/CD Pipelines for data workflows, ensuring robust version control and automated deployments.
• Apply DevOps Practices to improve reliability, observability, and maintainability of data infrastructure.
• Troubleshoot and Resolve Issues in data pipelines, identifying root causes and implementing permanent fixes.
• Analyze Business Processes to identify inefficiencies and opportunities for automation and improvement.
• Translate Business Insights into Technical Solutions by creating actionable technical plans aligned with business objectives.
• Communicate Effectively with both technical teams and business stakeholders to ensure clarity and alignment.
• Execute Implementation Plans with urgency, high quality, and accountability for outcomes.
• Leverage All Available Resources proactively to deliver projects on time and within scope.
• Optimize Performance of large-scale data processing systems and troubleshoot pipeline failures.
• Ensure Data Quality and Governance through validation frameworks, lineage tracking, and compliance with security standards.
• Collaborate with Cross-Functional Teams including data scientists, analysts, and business stakeholders to deliver data solutions.
• Mentor and Guide junior engineers, promoting best practices and technical excellence.
• Drive Innovation by evaluating emerging technologies and recommending improvements to data architecture

Key Requirements and Technology Experience: 

• Key skills; This is half Data Engineer, half DevOps Engineer. Angular, Java Spring Batch, ETL (SnapLogic nice to have), AWS, Snowflake, Airflow, heavy CI/CD experience. There isn’t a CI/CD hand off team so the devs need to be experience themselves with CI/CD.
• Data Engineering Expertise
• Advanced experience in building and maintaining automated data pipelines.
• Strong knowledge of ETL/ELT processes and orchestration tools (Airflow, Prefect, Dagster).
• Programming & Querying
• Proficiency in Python, Java, or Scala.
• Advanced SQL skills for complex queries and optimization.
• Cloud Platforms
• Hands-on experience with AWS, Azure, or GCP data services (Glue, Data Factory, Dataflow).
• Familiarity with object storage and IAM/security best practices.
• Cloud Certification
• AWS Certified Data Analytics or equivalent certification in Azure/GCP.
• DevOps & CI/CD
• Advanced experience with CI/CD tools (GitHub Actions, Jenkins, Azure DevOps).
• Infrastructure-as-Code (Terraform, CloudFormation).
• Containerization & Orchestration
• Docker and Kubernetes for deploying data workflows.
• Data Modeling & Storage
• Expertise in relational and NoSQL databases.
• Advanced knowledge of data lake and data warehouse architectures (Snowflake, Redshift, BigQuery).
• Monitoring & Observability
• Implementing logging, monitoring, and alerting for data pipelines.
• Troubleshooting & Root Cause Analysis
• Expert in diagnosing pipeline failures, data inconsistencies, and performance bottlenecks.
• Ability to design and implement permanent fixes and preventive measures.
• Business Process Analysis
• Skilled in analyzing workflows to identify inefficiencies and automation opportunities.
• Skilled in translating business requirements into technical designs and actionable plans.
• Execution & Accountability
• Proven ability to develop implementation plans and execute independently with urgency.
• Strong sense of ownership and accountability for outcomes.
• Resourceful in leveraging tools, teams, and information to meet deadlines.
• Communication & Leadership
• Strong ability to communicate complex technical concepts to technical and non-technical stakeholders.
• Ability to design enterprise-scale architectures and lead modernization initiatives.
• Strong mentoring and team leadership skills.
• Security & Compliance
• Understanding of encryption, masking, and regulatory standards (GDPR, HIPAA).

Our client is a leading Financial Industry, and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.

Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy