Data Pipeline Engineer IV

Immediate need for a talented Data Pipeline Engineer IV. This is a 12+ Months Contract opportunity with long-term potential and is located in Mountain View, CA (Onsite). Please review the job description below and contact me ASAP if you are interested.

Job ID:25-89006

Pay Range: $85 - $95/hour.  Employee benefits include, but are not limited to, health insurance (medical, dental, vision), 401(k) plan, and paid sick leave (depending on work location).
 
Key Responsibilities:

• Implement, maintain and evolve big data platform and infrastructure •
• Responsible for designing, implementing and maintaining backend REST API Services and ETL processes for Predictive Data Modeling, Machine Learning, Personalization, Recommendation, and Business Intelligence system •
• Perform extensive research and analysis to make optimal architecture and design decisions •
• Write large amounts of code, perform code reviews, write unit tests and documentation • Interface with other groups including Product Management, QA and Operations •
• Create quick proof-of-concept prototypes

Key Requirements and Technology Experience:

• Skills-Spark, Apache Iceberg, Python.
• Work in a scrum team with ML & Cloud Engineers Requirements: Minimum of 3 years of Hand-on experience in Big Data technologies like Apache Iceberg, Spark, Spark ML, & Kafka •
• Strong skills in statistical analysis: correlation analysis, regression analysis, univariate and multivariate analysis •
• Strong skills in algorithms, Data structures, UNIX/Linux, Scripting, Machine Learning (especially classification and unsupervised clustering), Data Modeling, Data warehousing, and Networking •
• Hands-on experience in building REST API’s • Team player with strong communication skills and ability to mentor ML & Cloud engineers in areas of Data Engineering •
• Desire to learn fast and pick up latest and greatest technologies •
• MS in Computer Science or equivalent experience Preferred: • Programming Language: Python •
• Preferred 7+ years of experience in Big Data Technologies: AWS EMR, Iceberg, Spark, Kafka, & YARN •
• Machine Learning: PyTorch, TensorFlow, Spark ML • REST API: Flask, FastAPI, or Django.
• Data Quality tools such as Monte Carlo, Great Expectations, or Databand • Experience with teams using MLflow.

Our client is a leading Research and development Industry and we are currently interviewing to fill this and other similar contract positions. If you are interested in this position, please apply online for immediate consideration.
 
Pyramid Consulting, Inc. provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By applying to our jobs you agree to receive calls, AI-generated calls, text messages, or emails from Pyramid Consulting, Inc. and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy . J2W:CB3