This posting has been closed |
What Project/Projects will the candidate be working on while on assignment?
- This role is for a Change Data Capture (CDC) Senior Data Engineer that will join a team responsible for streaming data for Cloud-based data ecosystem consisting of a metadata driven data lake and databases that support real time analytics, extracts, and reporting. The right candidate will have a solid background in data engineering and should have a few years of experience on AS400, Change Data Capture tools and also working on Cloud platform such as Azure.
Is this person a sole contributor or part of a team?
- Will be part of team
If so, please describe the team? (Name of team, size of team, etc.)
- Will be part of Agile team with minimum 7 members
What are the top 5-10 responsibilities for this position? (Please be detailed as to what the candidate is expected to do or complete on a daily basis)
- This role is for a Change Data Capture (CDC) Senior Data Engineer that will join a team responsible for streaming data for Cloud-based data ecosystem consisting of a metadata driven data lake and databases that support real time analytics, extracts, and reporting. The right candidate will have a solid background in data engineering and should have a few years of experience on AS400, Change Data Capture tools and also working on Cloud platform such as Azure.
- The ideal candidate will be very comfortable creating subscriptions to stream real-time data using CDC tools such as IBM Infosphere Data Replication and streaming data to Kafka.
- The candidate should be comfortable working with AS400, Oracle and MSSQL server databases, including any aspect of administration or support required to maintain them.
What software tools/skills are needed to perform these daily responsibilities? Required Experience & Qualifications:
- Data engineering experience
- 7 years
- Cloud platform experience
- 1 year
- Version Control (Git or equivalent)
- 1 years
Preferred Experience & Qualifications:
- Change Data Capture Tools (IBM CDC, Attunity or equivalent) 3 years
- Version Control (Git or equivalent) 1 year
- Scripting (Linux/Unix Shell scripting or equivalent) 5 years
Where is the work to be performed? (Please list preferred facility, if other please specify i.e. remote work, rural, etc.)
- Remote work
Skills
Skill | Proficiency | Years Experience | Percent Used |
---|---|---|---|
AS/400 | Any | 100% | |
Data Engineering | 3 - 6 | 100% | |
AWS | Any | 75% | |
Cloud Analytics | Any | 75% | |
ETL | Any | 75% | |
Git | Any | 75% | |
Oracle | Any | 75% | |
Scripting | Any | 75% | |
SQL Server | Any | 75% | |
Version Control | Any | 75% | |
Agile Methodology | Any | 50% | |
Linux | Any | 50% | |
MS Azure | 1 - 3 | 50% | |
UNIX | Any | 50% | |
CDC | Any | 25% | |
Data Replication | Any | 25% | |
Ideal | Any | 25% | |
Kafka | Any | 25% | |
Metadata | Any | 25% |