• A Big Data Engineer with a wide range of experience working in Data Analytics, Big Data and Business intelligence in Healthcare, Insurance and financial industries.
• 4 years of experience in Hadoop, Pig, Hive and Python
• 8 years in ETL and Data Warehousing with SSIS, Zena, Bash shell scripting and 1 year in Spark, pyspark and Kafka.
• Highly proficient in MySQL, DB2 Worked in Unix, Windows and mainframe environments.
• Accustomed to working in an Agile environment.

KEY ACCOMPLISHMENTS

• Developed WBM 2.0 (claims) using Pig, Hive, Python, Zena and Bash shell scripting, Hadoop, and Scrum. Helped load three years or 720,000,000 BCBS claims.

• Developed PMAR using Spark/pyspark (python), Kafka, Bash shell scripting, Hadoop, and Scrum. Real-time/Batch Ingestion and Processing pipelines built using Apache Spark

• Used Python for pyspark and other uses (formatting json, xml files, etc) for 3 to 4 years.

• Developed Nice consumption application using Pig, Hive, Python, Zena, Bash shell scripting, ETL, Hadoop and Scrum

• Developed Nice application that generated python scripts from hive data, using these scripts in the consumption transformation in Pig using Bash shell Scripting and scrum.

• Designed and led a two-person team that ran a Pig consumption process to store two years or 480,000,000 BCBS claims for the WBM 1.0 project using Bash shell scripting and ETL, Pig and Hive.

• Coached and Mentored two people on the WBM project using agile methodology

• Developing and coached one person for the PMAR application using pyspark, Kafka.

• Acted as SME on NICE and WBM ETL projects using Python.

• Saved $4.5 million in one quarter on gross margin by serving as team subject matter expert assisting the business and technical staff to price point merchandise.