--Building data pipeline, ETL processes for all products using Hadoop framework, python and ETL tools.
--Writing Python scripts for ETL methodologies.
--Using Sqoop for importing and exporting data from traditional RDBMS like Oracle to HDFS and vice versa.
--Writing hive queries for fetching data from HDFS and writing complex SQL queries to fetch data from RDBMS.
--Writing a scala scripts to migrate a data between Hadoop clusters, doing transformation and automating entire process.

​Data Mining and Predictive analysis of Internet users for Telecom Company:

• Performing data analysis using various data mining techniques such as neural networks, naive Bayes and decision trees in SAS & Weka to determine possible customers that can use Internet.

Regression Analysis on eBay auction data:

• Built a linear regression model in R on auction data of eBay to determine pattern in price changes. Used different sampling technique to determine effective samples in data.

Statistical Data Mining Project on Nielsen data:

• Identifying best TV program within each DMA assigned by Nielsen and comparing SANDY effect on TV viewing experience using different modelling techniques like linear regression, non-linear regression, classification trees and ANOVA tables.

Projects: - 1. Mort Project 2. Rental Project 3. Experian Property Database 4. High Availability Data Services

Roles: -

• Responsible for functional requirement gathering, analysis of requirements, creating high level and low level design document.
• Manipulating, cleansing and processing of data using excel, SQL, Quality stage.
• Used Datastage to extract, transform and loading (ETL) of source data from transaction systems.
• Created data reports, reconciliation of data, data auditing and monitoring data for quality purpose.
• Designed, developed and deployed new ETL functionality.
• Suggested architectural changes in existing BI Datawarehouse as per new functionality to clients and building them.
• Providing quantitative and qualitative data to business users.
• Carried out processing of data and statistical techniques.
• Worked with Business Analysts as an onshore coordinator for understanding of requirements, advising on new methods and suggesting improvements.
• Managed and mentored different module teams simultaneously.
• Worked directly with client and utilized problem solving skills to gain more business.

• Developed two ETL applications in project from scratch which became a core part of credit risk calculation.
• Supported all live applications issues, bug fixing and maintenance of live applications.