DevOps Engineer/Site Reliability Engineer – Hadoop & Spark

Immediate need for a talented DevOps Engineer/Site Reliability Engineer – Hadoop & Spark. This is a 12+months contract opportunity with long-term potential and is located in Charlotte, NC(Hybrid). Please review the job description below and contact me ASAP if you are interested.
 
Job ID: 25-79211
 
Pay Range: $60 - $65/hour.  Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
 
Key Responsibilities:

• Develop and maintain monitoring and alerting solutions tailored for monitoring decoupled Storage(Hadoop) and Compute(Spark Grid) production and production-like environments.
• Build internal tools that integrate with existing monitoring platforms (e.g. Influx, Grafana, Telegraf) to collate and derive insights from production metrics.
• Proactively monitor and manage the Infrastructure - Cloudera Hadoop and Apache Spark .
• Support application releases, implementations, upgrades (RHEL, Spark), and/or changes into the environment.
• Build strong partnership with Development, Infrastructure and platform teams.
• Configures and maintains the set of tools and services that provide Continuous Integration and Continuous Delivery (CI/CD) services and validates access control mechanisms for the Software and Infrastructure Engineering team throughout the software development lifecycle.

Key Requirements and Technology Experience:

• Key Skills: Devops ,Hadoop and Spark ,Python .
• 3-5 years of experience with logging and monitoring platforms - Influx/Prometheus, Grafana etc.
• System Admin experience with Linux, Influx/Prometheus and Grafana tools.
• Demonstrated ability to build observability tooling or integrations that serve multiple internal teams.
• Proficiency in scripting (e.g., Python, Shell) to create diagnostic and observability tools.
• Experience with Git and version control workflows.
• Knowledge of CI/CD tools (Jenkins, GitHub) and Ansible is must.
• Exceptional debugging and root cause analysis skills across application, infrastructure, and network layers.
• Ability to multi-task, as well as being flexible to assist team members as needed.
• Experience with secrets management.
• Experience in a site reliability role.
• Basic understanding of Cloudera Hadoop would be beneficial.
• Self-starter with a service-oriented mindset and a relentless drive to improve system reliability.
• Container technologies (Kubernetes, Docker, etc.).
• Active Directory and Kerberos, access management.

Our client is a leading Banking and Financial Industry, and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.
 
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, colour, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy .

#BOA J2W:CB3