Projects worked: CX Measurements

Environment: Big data, Spark-Pyspark and Scala, Ab Initio GDE 3.1.3, Cooperating system-3.1.3, DB2, Oracle, Hive, Mongo, Kafka, EME, Unix, Control-M, SMARTIT, Service Manager

Responsibilities:

• Work with project business analysts to understand requirements for CX Measurements project and create tasks for the various user stories based on the corresponding features in the project.
• Lead the ETL team to successful delivery of various surveys in Customer Experience domain
• Design and built Ab Initio graphs and calling graphs using control-m jobs to populate the metadata process utilized by all surveys
• Generate Spark scripts using Pyspark for various surveys and the shell scripts calling python scripts and the Shell script is called from Control-M job
• Currently working in Creating Spark scripts using Scala for MSRT tool for Phase-2 and Phase-1 scripts developed using Scala and Kafka and the Scala jars created are called from Shell script which in turn called by Control-m job.
• Write Shell scripts call the Pyspark scripts and the shell scripts run using control-m
• Working in Agile methodology and has good knowledge in waterfall methodology
• Extract the various data sources i.e EDW tables for Individual and Group data and using Dataland as sources for HCC, Address, Segment and Funding Extracts, Telephone and Plan and RELD Extracts for Combined Metadata creation to be used for all surveys
• Create Producer and Consumer code in Scala and write the Producer output in Kafka and read the data from Kafka for the Consumer Process.
• Built ETL process using Pyspark for populating various tables for for Various Surveys-Transactional, Relationship, Onboarding and Retail surveys, Closed Loop Survey, Digital, Payment and Post Doctor Visit Survey.
• Involved in working with Version Control tools like GIT and EME and Jenkins for Code Migration
• The target tables are Hive tables for various survey and the target extracts are created in Hadoop server and SFTP'ed on their respective run frequency to Qualtrics External vendor which is used for reporting and analytics purpose.
• Control-M jobs are created for various ETL jobs and run in unit, test and stage before migrating the jobs to Prod along with the code and respective configuration files.
• Provide System, Integration and UAT support until migrating the code to Prod.
• Provide production support for existing surveys in Prod environment.

Projects worked Adoption of SE for CASH Environment: Ab Initio GDE 3.1.3, Cooperating system-3.1.3, Ab Initio Continuous Flows, Conduct>IT, Talend, Teradata, Oracle, EME, BRE, Unix, MQC, $UVIEW

Responsibilities:

• Work with project business analysts to understand requirements for Adoption of SE and create ETL High Level and Low-Level Design documents.
• Design and built Ab Initio graphs and calling graphs using Wrapper scripts to integrate PSETs based graph executions, establish dependencies with various modules, implemented resource pools.
• Access the various data sources i.e EDW tables for Segmentation, join data sources for subsequent data analysis.
• Write Validation tests that can detect null or blank values, valid and invalid values, data patterns, invalid data relationships and uniqueness of key values.
• Built ETL graph for populating various tables for Segmentation process which includes Hierarchy, revenue, address and attribute table loading before loading segmentation table for 5 sectors in Oracle which is a truncate and load process
• The segmentation process has Simulation and daily ETL processes where corresponding graphs and scripts created to populate the respective streams.
• The Simulation process is loading the data for future quarter i.e for next quarter and at the end of the quarter flipped to the daily tables.
• The Oracle tables are converted to EDW format and the files are FTP'ed to EDW acquisition server.
• The acquisition server has load scripts to load the various EDW tables using the scripts.
• The source is CVM application where the source tables are extracted from Teradata
• The various sectors are US, CANADA, LAC, EMEA and APAC for which the data is segmented to segmentation tables-SEG_1_TB to SEG_5_tb using Segmentation ETL process.
• The segmentation data is passed to alignments process where cash engine job runs and then runs cash alignment file process using Ab Initio graphs to create Quarterly Business Alignment files, Quarter End Alignment and SBA files (daily)
• Perform dollar-U scheduler change, scripts to trigger plan for ETL process.
• Defect support, environment scheduling, monitoring, job abend restart and root cause analysis for CASH WBA prod support.
• Perform Month end revenue runs and then use the revenue details to run cash engine jobs to create Quarter End Alignment files at end of each month which are sent to CSI server
• Prepare migration plan and production history load instructions.

Projects worked Claims Compare Environment: Ab Initio GDE 3.1.3, Cooperating system-3.1.3, DB2, Teradata, EME, Unix, BRE, MQC, Autosys

Responsibilities:

• Based on the business requirements document enhancing the mappings and existing graphs based on Business requirements document
• Starting from gathering requirements and analysis, design and development, System and Integration testing and Providing Production support
• Executing Conduct IT plan to run for various iterations of a tier
• Creating WHSEFULL files and RDX files and sending to be adjudicated by Mainframe and comparing east and west files and sending claim compare reports for business.
• Performance Tuning of Ab Initio Graphs and supporting System testing, Integration test environment and Preparing Implementation Plan documents for Ab Initio Support team

Projects worked SBIS Flow Mart, Claims LMA R2 Conversion Environment: Ab Initio GDE 3.1.3, BRE, Conduct>IT, Cooperating system-3.1.3, DB2, Oracle, Teradata, MSSQL, Sybase, EME, Unix, MQC, Autosys

Responsibilities:

• Estimation for the Design, Coding and Unit testing activities to fit into Project timelines and enhancing existing Ab Initio graphs as per Schema Mapping document
• Prepare Design documents for various workstreams in the Project.
• Coding, Unit testing of Ab Initio Code deliverables and Review of Code and involved in code promotions to higher environment.
• Performance Tuning of Ab Initio Graphs and supporting System testing, Integration test environment and Preparing Implementation Plan documents for Ab Initio Support team

Environment: Ab Initio GDE 3.1.1, Cooperating system-3.1.1, DB2, Oracle, Teradata, MSSQL, Sybase, EME, Unix, MQC, Control-m

Responsibilities:

• Understand the legal requirement for Flow Mart & Claims LMA R2 Conversion, Space Project and identified the impacted BI ETL processes and propose design solutions.
• The Flow Mart Data Model is composed of 9 stars namely Account, Policy, Competitor, Transaction, Policy State, Location, Vehicle, Driver and Rule. In Flow Mart, a Type 1 indicates a column where a changed value would require an update to the record in place, and Type 2 indicates a column where a changed value would require an entirely new row to be inserted and played a key role in building the SBIS Flow Datamarts using the Type 1 and Type 2 Models.
• Worked in SCD Type 2 dimensions and was working in a Star Schema data model.
• Estimation for the Design, coding and Unit testing to fit into Flow Mart project timelines and completed design and development within the timelines
• Developed ETL process using generic graph to extract various tables from differing sources i.e SQL Server and Oracle and Teradata.
• LMA R2 Conversion is a project where existing Practice Manager (PM application is replaced with LMA i.e Litigation Management Application for creating, tracking storing the matters/cases and played a key role in incorporating the functions of PM.
• Worked on trillium tool for standardizing Personal and Business Entity addresses.
• Estimation for the Design, Coding and Unit testing activities for LMA R2 Conversion to fit into Project timelines and enhancing existing Ab Intio graphs as per Schema Mapping document
• Space Program in Sainsburys comprises Product Inbound Interface where all Product tables extracted from Oracle and then transformed to generate Product Delta files which are loaded to JDA Product tables. Similarly Store Inbound interface extracts the store tables from Sybase and then transformed to generate store delta files loaded to JDA store tables and the JDA database is SQL Server Database.
• Preparation of High-Level design and Low-Level Design documents
• Coding, Unit testing of Ab Initio Code deliverables and Review of Code and involved in code promotions to higher environment.
• Involved in Performance Tuning of Ab Initio ETL graphs, processes and load routines and supporting System testing, Integration test environment and Preparing Implementation Plan documents for Ab Initio Support team.
• Developed customized shell scripts to trigger Ab Initio process in runtime.
• Created mapping documents with the required transformation logic, sources tables & fields for loading the target tables.
• Design and built job schedulers using Autosys.
• Builf XML Metadata and handling XML feeds using Ab Initio
• Provide warranty support post production, identify and fix known issues.
• Release planning of ETL process with interfacing applications by sending release plan documents to ETL Support team.

Environment: Ab Initio GDE 2.15, Cooperating system-2.15, Oracle, Teradata, EME, Unix, MQC, Maestro, RCS Responsibilities:

• Analyzing and Gathering the requirements by direct interaction with clients.
• Prepared Mapping documents for Source to Target Mapping.
• Worked on Low level design based on the High-Level Design provided by ETL Tech lead in EDS.
• Developed Abinitio graphs as per the design requirements and performed performance tuning of the graphs.
• Involved in unit testing, generation of Unit test plan document and involved in code promotion to higher environments using RCS.
• Good knowledge of RCS, EME Code versioning tools and RCS maintains the master copy of the objects.
• Design and built job schedulers using Maestro scripts and set the dependencies between jobs.
• Provide warranty support post production, identify and fix known issues.
• Release planning of ETL process with interfacing applications by sending release plan documents to ETL Support team.

• Interpreting the requirements by direct interaction with clients.
• Generating Low-level design and developing custom abinitio graphs as per the design requirements for 13 constraints
• Involved in generating code using Data Elements Framework
• Performed performance tuning of Ab Initio graphs and maintaining Ab Initio development standards and followed Ab Initio best practices.
• Involved in unit testing, generating unit test plan documents and support manual documents and involved in code promotions to higher environments using CVS.

• Interpreting the requirements by direct interaction with clients.
• Involved in preparing the design document as per the technical architecture document.
• Ab Initio graphs and scripts developed and executed from control-m for the csv file containing debit card transactions which are moved to Central Staging area and created to load newly created table in PCRANEUK database.
• Generated Brio summary and exception reports using the table data in PCRANEUK database
• Develop unit test scripts to validate the data file in the ETL server, compare the checksum value with the signal file.
• Performed code version control using EME for checking in the code for CSA2 server and Clearcase is the version control tool for maintaining CSA1 objects.
• Involved in enhancement of capitalize transform function.

• Provide recommendation and code enhancements for the identified root cause of failure.
• Develop Ab Initio graphs and wrapper scripts
• Analyzed and fine-tuned Ab Initio graphs to reduce the job running time to enhance performance.
• Month end runs run as per the schedule in Production.
• Publish manual work effort statistics on a monthly, quarterly and yearly basis and recommend reoccurring issue resolutions to save manual effort put forth by team.
• Created Generic Housekeeping script as a part of Enhancement activity to ensure multiple project teams can reuse it by supplying the parameters for running the script from scheduling tool
• Setup automation alert scripts to monitor Server space, file system warning.
• Involved in job monitoring of production jobs.
• Handling rejections by analyzing the reason for rejections for the Ab Initio record Rejections in the reject file
• Solving Help Desk tickets and servicing the tickets by providing the resolutions based on the Severity for the various legacy systems and has exposure to handling defects in PLSQL packages
• Involved in Monitoring Informatica Sessions and Workflows