Essential Functions:

• Write code for moderately complex system designs. Write programs that span platforms. Code and/or create Application Programming Interfaces (APIs).
• Write code for enhancing existing programs or developing new programs.
• Review code developed by other IT Developers.
• Provide input to and drive programming standards.
• Write detailed technical specifications for subsystems. Identify integration points.
• Report missing elements found in the system and functional requirements and explain impacts on the subsystem to team members.
• Consult with other IT Developers, Business Analysts, Systems Analysts, Project Managers, and vendors.
• “Scope” time, resources, etc., required to complete programming projects. Seek review from other IT Developers, Business Analysts, Systems Analysts, or Project Managers on estimates.
• Perform unit testing and debugging. Set test conditions based upon code specifications. May need assistance from other IT Developers and team members to debug more complex errors.
• Support transition of application throughout the Product Development life cycle. Document what has to be migrated. May require more coordination points for subsystems.
• Research vendor products/alternatives. Conduct vendor product gap analysis/comparison.
• Accountable for including IT Controls and following standard corporate practices to protect the confidentiality, integrity, as well as availability of the application and data processed or output by the application.

Experience:

• 5-8 years related work experience or equivalent combination of transferable experience and education IT development/programming/coding professional within a Hadoop environment
• Experience with Agile Methodology

Specific Tools/Languages Required:

• Hadoop
• Spark
• Big Data Technologies and frameworks: Hadoop Edge nodes, HDFS, HIVE, HBase, Map-reduce, Hue, Oozie, Pig, Zookeeper, Cloudera
• ETL – Apache Spark, Sqoop
• Programing languages: Scala is needed, Python is helpful
• Fast Access – PostgreSQL, Mongo
• Kafka/Spark Streaming/Batch/Real-Time Processing
• Relational DB - DB2, Hive, SQL Server

Preferred Skills:

• Java, Javascript, Shell scripting, Nifi, Yarn