Uploaded File
add photo
Vidya
sadhanavidyasagar@gmail.com
614-266-2031
Columbus, OH 43085
ETL Developer and Lead
10 years experience W2
0
Recommendations
Average rating
7
Profile views
Summary

Experience
Information Technology
May 2021 - present
Design, Development, Testing, Implementation, Documentation, Production Support and maintenance, involving client specific ETL tools and technologies.
  • Coordinating the ETL testing (Unit testing, SIT, UAT) of system requirements and the appropriate code developments through rigorous rounds of test cycles meeting the standards of client business and effective Business check out.
  • Led a team in onshore-offshore model and mentor Junior team members.
  • Facilitating the technical and functional coordination between client and the technical team.
  • Good experience in identifying the bottlenecks and performance tuning of SQL and ETL processes. P R O F I L E S U MMA R Y
  • Driven the effort of SQL Server database stale space purging activity which helped save 3.5 TB space.
  • Automated the time consuming ETL process to reduce the processing time from 30 mins to 10 mins.
  • Designed Tableau interactive dashboards deriving insightful KPIs which is used across Deloitte Analytics and Cognitive service line.
  • Obtained AWS Certified Solution Architect Associate in Feb 2021.
No skills were added
Remove Skill
Information Technology
Nov 2013 - present
Star and Snow-Flake schema, Fact and Dimensions Tables, Relational Data Modeling, Logical and Physical Data Modeling. Data Normalization, Enterprise and Operational Data Model. ETL tools SSIS, Informatica 10.1.1, Datastage Reporting tools Tableau 9.x/8.x/7.x, Cognos, SAS Big Data Eco Systems Spark, Scala, Hadoop, HDFS, Hive, Glue, AWS, S3, Athena Scheduling Tools Control M, WLM Languages C, SQL, PL/SQL, Unix Shell Scripting, Python Databases AWS DynamoDB, SQL Server 2008 R2, Oracle 10g/11g/12g, Postgres SQL, MySQL, Teradata, DB2 SDLC Methodology Agile, Waterfall, Onshore-offshore Model MS Office Word, Excel, Power Point, Access. Core Skills Requirement gathering, design data modeling, development, testing and performance tuning. EX P ER I EN C E S U M M A R Y
No skills were added
Remove Skill
Senior Consultant
Nov 2013 - present
Senior Consultant
No skills were added
Remove Skill
Senior Consultant
Oct 2019 - present
No skills were added
Remove Skill
Senior Consultant
Information Technology
Oct 2019 - present
State Auto IT ADM Services
  • State Auto is a mutual insurance firm working across various lines of business, personal lines and commercial lines It serves through independent service agents in USA. There are various external sources which has structured & semi-structured source data coming from Guidewire for Billing and Claims. Build ETL and Datalake Solution using SSIS, Informatica to extract, transform and load. Use Amazon EMR & AWS Services like Athena for interactive querying, Glue Catalog for lift and shift of data across Data clusters and using Amazon S3 for storage. This solution also utilizes Scala to ingest data and curate in the lake. Design visualization insights for business using Tableau. Responsibilities:
  • Requirement gathering from client tech leads and defining the technical specifications for developing the data ACCOMP L IS H M E N TS T EC H N O LO G I ES & S K I LLS models using Erwin Data modeler.
  • Plan and Build road maps for future of the data engineering scope coordinating with client tech leads.
  • Preparing technical design documents based on the requirement gathering analysis, which will be converted to user stories next, to be able to fit into the Agile project life cycle.
  • Led a team of 5 members in onshore-offshore model.
  • Designed and developed the flow mappings and flow diagram for migration of data systematically from one system to another.
  • Design tables and view structures for the application. Define DDL (Data definition language) and accordingly build the table structure.
  • Extract the XML files data using SSIS, Informatica to transform the data based on business requirements and load into SQL Server tables. Design audit checks in the data flow to ensure the data quality.
  • Involved in creating database objects like tables, views, procedures, triggers, and functions using T-SQL to provide definition, structure and to maintain data efficiently.
  • Creating and deploying SSIS packages using various transformations such as Slowly Changing Dimension, Multicast, Merge Join, Lookup, Fuzzy Lookup, Conditional Split, Aggregate, Derived Column, and Data Conversion Transformations.
  • Developing best practices for standard naming conventions and coding practices to ensure consistency of data models.
  • Schedule SQL Agent Jobs based on the frequency of time requested by business.
  • Thorough analysis, unit testing and integrated testing with other applications of database objects & T-SQL statements before deployment to the production server.
  • Performing Gap analysis and identifying the KPIs necessary for business.
  • Design extract and live interactive dashboards using Tableau and publish them using Tableau server.
  • Created Tableau dashboards using stack bars, bar graphs, scatterplots and user interactive dashboards.
  • Perform root cause analysis on failures. Resolve performance tuning related issues and queries.
  • Perform POC using AWS Glue to extract data from various sources like S3, SQL Server, Athena, Excel, XML etc. and transform structured and semi structured data and load into AWS DynamoDB.
  • Using Spark and Spark SQL to read the data and create the tables in hive using the Scala API.
  • Implemented Spark using Scala and Spark SQL for faster testing and processing of data.
  • Utilized AWS Athena interactive query to validate data integrity and overall data quality.
  • Maintaining and managing the functional design docs, technical design docs for proper implementation of solutions, business requirements and the designed routines/codes adhering to standard SDLC processes.
  • Involved in daily stand up calls with business analysts and data architects to resolve the business issues an data challenges. Technologies & Tools: SSIS, Tableau, Informatica 10.1.1, SQL Server 2008/2012/2014, Spark, Scala, Amazon S3, Hive, AWS, Erwin, Hadoop, HDFS, Athena, Glue, DynamoDB
SQL SQL Server
Remove Skill
ETL Developer and Lead
Information Technology
Nov 2013 - Oct 2019
Project / Assignment: Individual Infomart & Product Analytics
ETL ETL Developer
Remove Skill
Software Engineer (Band U2)
Information Technology
Jun 2011 - Nov 2013
No skills were added
Remove Skill
ETL Developer
Information Technology
Nov 2013 - Nov 2013
ETL ETL Developer
Remove Skill
Information Technology
Jun 2011 - Nov 2013
Project /
  • Vodafone is one of the leading telecommunication company. The project was an ongoing development project where Teradata Bteq Scripts, Datastage jobs were designed to extract and load the data as per business requirements. Responsibilities:
  • Involved in Software Development Life Cycle (SDLC)
  • Business Requirements Analysis, preparation of Technical Design documents, Data Analysis, Logical and Physical database design, Coding, Testing, Implementing, and deploying to business users.
  • Interacted with business team to understand business needs and to gather requirements.
  • Performed data Profiling and data Analysis using SQL queries looking for Data issues and data anomalies.
  • Used Teradata utilities like Fast Load, Fast Export, Multiload, Tpump and Involved in implementation and batch monitoring.
  • Involved in Data analysis, Data model designs and Preparation of metadata documents for all source tables.
  • Used DataStage stages namely Sequential file, Transformer, Aggregate, Sort, Datasets, Join, Funnel, Row Generator, Remove Duplicates, Teradata Extender, Copy stages extensively.
  • Designed and coded different SQL statements in Teradata BTEQ for generating report.
  • Performance testing of the Teradata BTEQ scripts in production.
  • Source to Target Mappings and transformations with ETL Data stage Technologies & Tools: Teradata Bteq, MLOAD, FLOAD, Datastage, Unix, SQL Cognos, SAS AC AD E M I C Q U AL I F I C AT I O N S
  • Bachelor of Engineering (Electronics and Communication Engineering)
No skills were added
Remove Skill
Jun 2011 - Jun 2011
PVT LTD
No skills were added
Remove Skill
Jun 2011 - Jun 2011
No skills were added
Remove Skill
Edit Skills
Non-cloudteam Skill
Education
Certifications
AWS Certified Solution Architect Associate
AMS ITIL V3 Foundation (Deloitte Internal) Certification
Skills
ETL
2019
6
ETL Developer
2019
6
SQL
2021
2
SQL Server
2021
2