• 9.9 years of experience in IT which includes Analysis, Design and Development of Big Data using Hadoop and SPARK and data bases includes SQLSERVER, My SQL, ORACLE, TERADATA, IMS DB and DB2.
• Around 4.5+ years of work experience on Big Data with hands on experience in Hadoop ecosystem components like Hadoop Map reduce, HDFS, Zookeeper, Hive, Hbase, Sqoop, Apache NIFI, Oozie and SPARK, CTRL-M, KAFKA.
• Good Understanding of Hadoop architecture and Hands on experience with Hadoop components such as YARN, Job Tracker, Task Tracker, Name Node, Data Node, Application master and Map Reduce concepts and HDFS Framework.
• Experience in using Apache Ambari for installation and management of single-node and multi-node Hadoop cluster (Ambari 2.5).
• Experience in Data load management, importing & exporting data using SQOOP.
• Experience in scheduling and monitoring jobs thru Oozie, Zookeeper and CTRL-M.
• Experience in writing Map Reduce programs & UDF's for Hive in java.
• Experience in integrating Hive and Hbase for effective operations.
• Experience in writing end to end Spark data processing (2.3) as a part of Azure cost usage project.
• Experience in Developing Scala program by implementing Spark Streaming by integrating with Kafka and triggering via Nifi.
• Having good knowledge in writing scripts using Bash shell in Linux.
• Experience in understanding and querying Databases like TERADATA, ORACLE, MYSQL, SQL SERVER and integrating with Hadoop HDFS storage.
• Worked on different file formats (ORCFILE, AVRO, TEXTFILE) and different Compression Codecs (GZIP, SNAPPY).
• Strong understanding of Data warehouse concepts, ETL, data modeling experience using Normalization, Business Process Analysis, Reengineering, Dimensional Data Modeling, Physical & Logical data modeling.
• Experience in JAVA concepts like Oops, collections, Multithreading, JDBC with strong analytical and problem solving skills and ability to follow through with projects from inception to completion.
• Utilized Apache Hadoop environment by Hortonworks.
• Knowledge in software Development Life Cycle (Requirements Analysis, Design, Development, Testing, Deployment and Support).
• Implemented end to end cloud data processing framework by creating Azure hdinsights Spark cluster and Azure ADF pipelines and integrating with SQL server at the source and Azure BLOB storage accounts at the end.
• Have good interpersonal communication skills, strong problem solving skills, explore/adopt to new technologies with ease and a good team member.

TECHNICAL PROFICIENCY – BIGDATA

• OPERATING SYSTEMS LINUX, UNIX, WINDOWS
• HADOOP ECO SYSTEM Hadoop (HDFS and Map-Reduce), YARN, Zookeeper, Hive, Oozie
• PROCESSING FRAMEWORK Map Reduce and APACHE SPARK
• DATA INGESTION SQOOP, KAFKA
• Others Apache NIFI
• LANGUAGES/SCRIPT Shell Script(bash), Java, Scala, Python
• Cluster Management Hortonworks, Ambari
• Operating Systems Unix, Windows, Linux (CentOS, Ubuntu, Redhat)
• Development Tools Maven, Jenkins, GITHUB, Gerrit, gitbash
• Cloud Technologies AWS EC2, EMR, S3 bucket, Azure Hd insights, Azure data factory, Azure BLOB storage account.