add photo
Mohammed
mohammedayazm1@gmail.com
917-960-9533
New York City, NY 10002
Hadoop Data Engineer
12 years experience C2C
0
Recommendations
Average rating
130
Profile views
Summary

Hadoop Developer with 7+ Years of IT experience including 5 years in Big Data and Analytics field in Storage, Querying, Processing and Analysis for developing E2E Data pipelines. Expertise in designing scalable Big Data solutions, data warehouse models on large-scale distributed data, performing wide range of analytics.
• Expertise in all components of Hadoop/Spark Ecosystems - Spark, Hive, Pig, Flume, Sqoop, HBase, Kafka, Oozie, Impala, Stream sets, Apache NIFI, Hue, AWS.
• 3+ years of experience working in programming languages Scala/Python.
• Extensive knowledge on data serialization techniques like Avro, Sequence Files, Parquet, JSON and ORC.
• Acute knowledge on Spark architecture and real-time streaming using Spark.
• Hands on experience with Spark Core, Spark SQL and Data Frames/Data Sets/RDD API.
• Good knowledge on Amazon Web Services (AWS) cloud services like EC2, S3, EMR and VPC.
• Experienced in Data Ingestion, Data Processing, Data Aggregations, Visualization in Spark Environment.
• Hands on experience in working with large volume of Structured and Un-Structured data.
• Expert in migrating the code components from SVN repository to Bit Bucket repository.
• Experienced in building Jenkins pipelines for continuous code integration from Github into Linux machine. Experience in Object Oriented Analysis Design (OOAD) and development.
• Good understanding in end-to- end web applications and design patterns.
• Hands on experience in application development using Java, RDBMS, and Linux shell scripting.
• Experience in implementing by using agile methodology. Well versed in using Software development methodologies like Agile Methodology and Waterfall processes.
• Experienced in handling databases: Netezza, Oracle and Teradata.
• Strong team player with good communication, analytical, presentation and inter-personal skills.

Experience
Education
Master's in Masters
Texas, 2015 - 2016
Minor: bachelors
Skills
REST
2021
6
Hadoop
2021
4
Hive
2021
4
Java
2021
4
Kafka
2018
4
MongoDB
2021
4
Pig
2021
4
Python
2021
4
Spark
2021
4
SQL
2021
4
AWS
2021
3
Big Data
2021
3
JSON
2021
3
Data Analysis
2021
2
Hadoop Developer
2018
2
HDFS
2018
2
MapR
2017
2
MapReduce
2018
2
Oozie
2018
2
PySpark
2017
2
Agile Methodology
2021
1
Apache
2018
1
API Development
2021
1
Application Development
2017
1
AWS CloudFormation
2021
1
AWS S3
2021
1
Cloudwatch
2021
1
Continuous Deployment
2021
1
Continuous Integration
2021
1
Data Engineering
2021
1
Data Integration
2018
1
Database Backups
2017
1
Elasticsearch
2017
1
ETL
2017
1
Ganglia
2021
1
Hbase
2018
1
Machine Learning
2017
1
Maven
2017
1
Metadata
2017
1
Performance Tuning
2021
1
Shell Scripts
2017
1
SQL Server
2017
1
Sqoop
2018
1
Systems Engineering
2021
1
Tableau
2017
1
UNIX
2021
1
XML
2021
1
Apache NiFi
0
1
AWS EC2
0
1
Cassandra
2016
1
Data Warehousing
0
1
Design Patterns
0
1
Flume
2016
1
impala
2016
1
Jenkins
0
1
Linux
0
1
Netezza
0
1
Oracle
2018
1
Pipeline
0
1
Scripting
0
1
SVN
0
1
Teradata
2018
1
WebServices
0
1