Rahul Kumar Singh

Professional Synopsis

I have experience in the Hadoop framework, Script designing in Spark and Python. Expertise in Analysis, Design, Development, Implementation, and Support of Data.

Warehousing using Big Data.

Hands-on experience in Data Transformation using Python, Pandas. Pyspark, and Hive.
Identifying and resolving performance issues at various levels like Hive Performance issues, Spark running performance issues, etc.

Performs data processing using Hadoop, Spark, Python, Hive, and Sqoop.

Sound exposure in working directly with clients to understand and analyze the business requirements and propose effective solutions.

Independently developed multiple Spark script using Python and pandas to process data.

Involved in creating Hive tables, loading data and writing hive queries which will run internally in Pyspark way.

Strong Knowledge of Hadoop and Hive and Hive's analytical functions.

Created schema in Hive with performance optimization using bucketing & partitioning

Solid understanding of the Hadoop file distributing system

Hands-on experience in IDE tools like Eclipse, Pycharm, Jupyter Notebook.