University of Phoenix Sr. Software Engineer (Hadoop DevOps Engineer) in Phoenix, Arizona
Sr. Software Engineer (Hadoop DevOps Engineer)
US-AZ - Phoenix
Description and Requirements
We are currently engaged in expanding our Hadoop capabilities to manage our ever-increasing amounts of data. We are looking for someone who enjoys learning, and working with state of the art open source technologies, and enjoys working with large datasets with the challenge of stringent SLA requirements and processing large data volumes. Ideally, someone with software development and systems administration experience who is interested in scaling up.
Carry out Hadoop administration/configuration activities in close collaboration with Hadoop application development teams
Monitor Hadoop ecosystem - identifies and resolves issues concerning data pipeline jobs availability
Monitor Hadoop volume, workload expansion and scalability pertaining to both volume and compute
Carry out software upgrades, Hadoop tools upgrades, and data migration activities in scaled up environment
Carry out POCs of different Hadoop distributions including Cloud offerings
Manage secured Hadoop clusters (Kerberos/Sentry) and ACLs
Monitor Hadoop ecosystem components in our Cloudera stack; specifically: HDFS, Map/Reduce, Oozie, HBase, Pig, Hive, Impala, SPARK tools
Troubleshoot and debug Hadoop ecosystem run-time issues including job processing failures and performance
Provide operations documentation and support
Provide on-call, remote, emergency support
Bachelors degree in related field or equivalent combination of experience required.
Minimum of 4 years of experience working with cloudera distribution.
Minimum of 4 years of experience with Hadoop administration or a strong and diverse background of distributed cluster management experience
Experience working with both, development and administration teams.
Experience building and scaling out Hadoop (cloudera cdh) based on Unix hosted infrastructure for an enterprise
Experience building and managing Hadoop cluster in the Cloud is a big plus
Experience with RHEL/CentOS system administration
Experience with CHEF, PUPPET system configuration tools, or excellent shell scripting experience is a plus
Experience with Java is a plus
Experience with python, Ruby, perl scripting is a plus
Open Source tools experience is a plus (a well curated blog, upstream accepted contribution, or community presence)
Apollo Education Group, Inc. and its subsidiary companies ("Apollo Education Group") are firmly committed to the concept and practice of equal employment opportunity and to providing a workplace and learning environment that is free from unlawful discrimination. As such, it is Apollo Education Group's policy not to discriminate against any employee (Faculty or Staff) or applicant for employment on the basis of age, citizenship, color, creed, disability, ethnicity, familial or marital status, gender, gender identity, genetic information, national origin, pregnancy, race, religion, sexual orientation, veteran status, or any other status or characteristic protected by applicable federal, state, or local law. This policy applies to all terms, conditions, and privileges of employment including, but not limited to, recruiting, hiring, placement, training, educational assistance, transfer, promotion, leaves of absence, evaluation of performance, rate of pay or other forms of compensation and benefits, social and recreational programs, employee facilities, disciplinary action, and termination. An individual's employment, and future changes in work assignments, shall be based entirely on the individual's ability, education, training, relevant experience, performance, and other valid job requirements.