I am a Big data engineer with over 6 years of professional experience in the industry. I am very proficient in Apache Spark, NiFi, HDFS ecosystem, Kafka , Java, Python Design. I have a lot of background in both software development, building ETL pipelines and data lake