Hadoop & ETL Production Support Engineer

Immediate need for a talented Hadoop & ETL Production Support Engineer. This is a 12+ months contract opportunity with long-term potential and is located in Plano TX(Hybrid). Please review the job description below and contact me ASAP if you are interested.

Job ID: 25-88561

Pay Range: $60 - $65/hour.  Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).

Key Responsibilities:

• Individual will be responsible for understanding design, propose high level and detailed design solutions, propose out of box technical solutions for resolving business problems and technical problems arise during the real time in production.
• Individual should be flexible to work on the weekends at least once in a month.
• May get comp-off during weekdays.
• As an individual contributor in BAU, person should have good analytical skills to take a quick decision during the tough times.
• Engage in discussions with information architecture team for coming out with design solutions, proposing new technology adoption ideas, attending project meetings, partnering with near shore and offshore teammates in a matrix environment, coordinating with other support teams like L2, development, testing, upstream and downstream partners, etc.
• BAU support activities like analysis, coding, propose improvement ideas, drive the development activities at offshore.
• Able to think over in a quick turnaround time to address the situation in production.
• Work on multiple projects concurrently, take ownership & pride in the work done by them, attending project meetings, understanding requirements, designing solutions, developing code
• Partnering with near shore and offshore teammates in a matrix environment, coordinating with other support teams like L2, development, testing, up/down stream partners, etc.
• Work with the Business Analysts to understand the requirements work on high level & detailed design to address the real time issues in production.
• Work with Information Architecture team for proposing technical solutions to business problems
• Identify gaps in technology and propose viable solutions
• Take accountability of the technical deliveries from offshore
• Understand Hadoop, Spark, Python and other Eco Systems like Impala, Hive, Oozie, Pig etc., Autosys and UNIX Shell Scripting.
• Work with the development teams and QA during the post code development phase
• Identify improvement areas within the application and work with the respective teams to implement the same
• Ensuring adherence to defined process & quality standards, best practices, high quality levels in all deliverables
• Adhere to team’s governing principles and policies

Key Requirements and Technology Experience: 

• Key Skills; Hadoop Ecosystem Expertise, ETL Development & Support, Spark with Python (PySpark)
• Strong working knowledge of ETL, database technologies, big data and data processing skills
• 3+ years of experience developing ETL solutions using any ETL tool like Informatica, SSIS, etc.
• 3+ years of experience developing applications using Hadoop, Spark, Impala, Hive & Python.
• 3+ years of experience in running, using and troubleshooting the ETL & Cloudera Hadoop Ecosystem i. e. Hadoop FS, Hive, Impala, Spark, Kafka, Hue, Oozie, Yarn, Sqoop, Flume.
• Experience on Autosys JIL scripting.
• Proficient scripting skills i.e. Unix shell & Perl Scripting
• Experience troubleshooting data-related issues.
• Experience processing large amounts of structured and unstructured data with MapReduce.
• Experience in SQL and Relation Database developing data extraction applications.
• Experience with data movement and transformation technologies.
• Good to have experience in Python / Scala programming
• Have a good understanding of the E2E process of the application
• Have a good understanding of all aspects of the application like upstream, database model, data processing and data distribution layers.

Our client is a leading Banking Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.

Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy