University of Phoenix Sr. Software Engineer (Hadoop Development) in Phoenix, Arizona
Sr. Software Engineer (Hadoop Development)
US-AZ - Phoenix
Description and Requirements
We are currently engaged in expanding our Hadoop capabilities to manage our ever-increasing amounts of data. We are looking for someone who enjoys learning, and working with state of the art open source technologies, and enjoys working with large datasets with the challenge of stringent SLA requirements and processing large data volumes. Ideally, someone with software development and systems administration experience who is interested in scaling up.
Build data pipelines and develop Hadoop solutions. Experience with cloudera cdh hadoop ecosystem is a huge plus
Work with application development teams to guide, mentor, and develop Hadoop solutions
Day to day maintenance of hadoop platform, including data processing uptime and SLAs, and production support
Participate in identifying and resolving issues concerning data pipeline jobs availability
Carry out POCs of different Hadoop distributions including Cloud offerings
Develop and enhance the Cloudera stack; specifically: HDFS, Map/Reduce, Oozie, KAFKA, Flume, HBase, Hive, Pig, Impala, SPARK tools
Troubleshoot and debug Hadoop ecosystem run-time issues including job processing failures and performance
Provide development documentation and support
Provide on-call, remote, emergency support
Bachelors degree in related field or equivalent combination of experience required
A minimum of 5 years of software development experience, covering the stages of the SDLC
A minimum of 2 years of experience working with data technologies.
Experience in developing REST and SOAP based web services on J2EE stack, exposing Hadoop data to applications
Software development experience of at least 4 years with Java/J2EE platform.
Experience with Python, R scripting
Experience working with both, development and administration of the hadoop eco system is a plus.
Experience with RHEL/CentOS operating systems
Experience with Ruby, perl scripting is a plus
Excellent shell scripting experience is a plus
Open Source tools experience is a plus (a well curated blog, upstream accepted contribution, or community presence)
Apollo Education Group, Inc. and its subsidiary companies ("Apollo Education Group") are firmly committed to the concept and practice of equal employment opportunity and to providing a workplace and learning environment that is free from unlawful discrimination. As such, it is Apollo Education Group's policy not to discriminate against any employee (Faculty or Staff) or applicant for employment on the basis of age, citizenship, color, creed, disability, ethnicity, familial or marital status, gender, gender identity, genetic information, national origin, pregnancy, race, religion, sexual orientation, veteran status, or any other status or characteristic protected by applicable federal, state, or local law. This policy applies to all terms, conditions, and privileges of employment including, but not limited to, recruiting, hiring, placement, training, educational assistance, transfer, promotion, leaves of absence, evaluation of performance, rate of pay or other forms of compensation and benefits, social and recreational programs, employee facilities, disciplinary action, and termination. An individual's employment, and future changes in work assignments, shall be based entirely on the individual's ability, education, training, relevant experience, performance, and other valid job requirements.