University of Phoenix Sr. Software Engineer (Hadoop DevOps Engineer) in Phoenix, Arizona

Sr. Software Engineer (Hadoop DevOps Engineer)

General Information

Location:

US-AZ - Phoenix

Position Type:

Full Time

Virtual Eligible:

No

Job Category:

Information Technology

Ref #:

3193

Description and Requirements

Overview

We are currently engaged in expanding our Hadoop capabilities to manage our ever-increasing amounts of data. We are looking for someone who enjoys learning, and working with state of the art open source technologies, and enjoys working with large datasets with the challenge of stringent SLA requirements and processing large data volumes. Ideally, someone with software development and systems administration experience who is interested in scaling up.

Responsibilities

  • Carry out Hadoop administration/configuration activities in close collaboration with Hadoop application development teams

  • Monitor Hadoop ecosystem - identifies and resolves issues concerning data pipeline jobs availability

  • Monitor Hadoop volume, workload expansion and scalability pertaining to both volume and compute

  • Carry out software upgrades, Hadoop tools upgrades, and data migration activities in scaled up environment

  • Carry out POCs of different Hadoop distributions including Cloud offerings

  • Manage secured Hadoop clusters (Kerberos/Sentry) and ACLs

  • Monitor Hadoop ecosystem components in our Cloudera stack; specifically: HDFS, Map/Reduce, Oozie, HBase, Pig, Hive, Impala, SPARK tools

  • Troubleshoot and debug Hadoop ecosystem run-time issues including job processing failures and performance

  • Provide operations documentation and support

  • Provide on-call, remote, emergency support

Qualifications

Basic Requirements:

  • Bachelors degree in related field or equivalent combination of experience required.

  • Minimum of 4 years of experience working with cloudera distribution.

  • Minimum of 4 years of experience with Hadoop administration or a strong and diverse background of distributed cluster management experience

Additional Qualifications:

  • Experience working with both, development and administration teams.

  • Experience building and scaling out Hadoop (cloudera cdh) based on Unix hosted infrastructure for an enterprise

  • Experience building and managing Hadoop cluster in the Cloud is a big plus

  • Experience with RHEL/CentOS system administration

  • Experience with CHEF, PUPPET system configuration tools, or excellent shell scripting experience is a plus

  • Experience with Java is a plus

  • Experience with python, Ruby, perl scripting is a plus

  • Open Source tools experience is a plus (a well curated blog, upstream accepted contribution, or community presence)

Apollo Education Group, Inc. and its subsidiary companies ("Apollo Education Group") are firmly committed to the concept and practice of equal employment opportunity and to providing a workplace and learning environment that is free from unlawful discrimination. As such, it is Apollo Education Group's policy not to discriminate against any employee (Faculty or Staff) or applicant for employment on the basis of age, citizenship, color, creed, disability, ethnicity, familial or marital status, gender, gender identity, genetic information, national origin, pregnancy, race, religion, sexual orientation, veteran status, or any other status or characteristic protected by applicable federal, state, or local law. This policy applies to all terms, conditions, and privileges of employment including, but not limited to, recruiting, hiring, placement, training, educational assistance, transfer, promotion, leaves of absence, evaluation of performance, rate of pay or other forms of compensation and benefits, social and recreational programs, employee facilities, disciplinary action, and termination. An individual's employment, and future changes in work assignments, shall be based entirely on the individual's ability, education, training, relevant experience, performance, and other valid job requirements.