Sr. Informatica ETL / Hadoop Lead
Information Technology company
Information Technology company
New York, NY 10001
W-2 and C2C availableContractContract to Permanent600 views
New York, NY 10001
ContractContract to Permanent
Questions?
Click to chat now!
This posting has been closed

Job Description: Developer / Software Engineer - Hadoop/Informatica BI

Analytics and Data team at Morgan Stanley Wealth Management(MSWM) is responsible for delivering the data strategy, enterprise reporting, and big data capabilities to its business partners. The team is looking for Sr. Informatica ETL / Hadoop Lead with Hadoop/Big Data/ Unix and Teradata skills to help advance its goals to build a world class data-driven enterprise.

Roles and Responsibilities:

The person will be primarily responsible for:
• Creating and maintaining data streams and processes within the Hadoop and EDW platforms
• Profile and analyze various data sources
• Design and implement data ingestion strategy
• Design, develop, code, test and debug complex new code packages or make significant enhancements to existing code/packages.
• Interact with business users to understand and document the requirements.

Required Skills:

• Demonstrated experience with the Hadoop ecosystem (Hive, Pig, MapReduce, Spark etc.)
• Demonstrated experience with ETL tools like Informatica
• Experience on scheduling tools like Tivoli or Autosys.
• Development experience in one or more of the following languages: Java, Python and Scala
• Demonstrated experience with databases like Teradata/DB2/Oracle.
• Good understanding and experience with working in Hadoop and Big data technologies
• Good knowledge of database structures, theories, principles and practices.

Skills
Skill Proficiency Years Experience Percent Used
ETL
3 - 6100%
Hadoop
3 - 6100%
Informatica
Any100%
Big Data
Any75%
Informatica BDQ
Any75%
Teradata
Any75%
Spark
Any50%
UNIX
Any50%
Agile Methodology
Any25%
Java
Any25%
MapReduce
Any25%
Oracle
Any25%
Pig
Any25%
Related Positions
View all of our positions