SRE with Data Engineering Expertise

Immediate need for a talented SRE with Data Engineering Expertise. This is a 12+ Months Contract opportunity with long-term potential and is located in Canada (Remote). Please review the job description below and contact me ASAP if you are interested.

Job ID:25-83480

Pay Range: CA$55 - CA$60/hour + HST
 
Key Responsibilities:

• Manage, monitor, and troubleshoot cloud-based data pipelines.
• Optimize data pipelines to enhance performance, cost-efficiency, and reliability.
• Automate repetitive tasks in data processing and management.
• Perform SLA-oriented monitoring of critical pipelines and ensure adherence.
• Analyze, troubleshoot, and resolve complex pipeline issues and conduct post-incident reviews.
• Maintain infrastructure reliability for data pipelines and MDM jobs.
• Implement and improve monitoring, alerting, and testing mechanisms for pipeline reliability.
• Develop and maintain technical documentation for data pipeline systems and processes.
• Collaborate with stakeholders, ensuring effective communication and reporting.
• Open to working in a 24x7 shift environment.

Key Requirements and Technology Experience:

• Skills-SRE, BigQuery, Cloud Storage, GKE, Glue, DMS, Athena, Lake, Python.
• 5+ years of industry experience in Data Engineering support and enhancement.
• Proficiency in cloud platforms: GCP, Azure, or AWS (experience with BigQuery, Cloud Storage, GKE, Glue, DMS, Athena, Lake Formation preferred).
• Strong understanding of data pipeline architectures and ETL processes.
• Excellent programming skills in Python (Pandas, PyArrow, Ibis) for data processing and automation.
• Proficiency in SQL for data analysis with relational databases.
• Hands-on experience with Apache PySpark and/or Apache Flink (or Kafka Streams, Apache Storm).
• Practical knowledge of Docker & Kubernetes (containerization and orchestration).
• Experience with Git, CI/CD pipelines, and automated testing.
• Strong troubleshooting and problem-solving skills.
• Proven ability to analyze, optimize, and maintain high-reliability pipelines.
• Strong documentation and communication skills.
• Bachelor’s degree in Computer Science or a related technical field (or equivalent practical experience).
• Cloud Professional Data Engineer certification is an advantage.
• Excellent verbal and written communication skills.
• Knowledge of FHIR R4 standards and healthcare data interoperability.
• Experience with data visualization tools (Google Looker, Tableau, Power BI).
• Hands-on with PyFlink (Python API for Apache Flink) and Flink SQL.
• Familiarity with Pixi environment management and modern Python dependency management.
• Experience with Apache Iceberg or other modern data lake storage formats.
• Understanding of real-time vs. batch processing trade-offs, particularly in healthcare data systems.

Our client is a leading IT Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.
 
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy . J2W:CB3