Gnanendra Reddy

An expert professional having total 8+ years of experience in IT industry with around 4 years of relevant experience in Azure cloud, Azure data factory, Azure Databricks, Pyspark, Data Analysis, ETL, Development, Maintenance, Testing and documentation. Experience in engaging the Azure Data Factory (ADF) to design Pipelines using control flow activities such as Get Metadata, Copy, If Condition, For Each, Delete Validation, sending email notifications etc. Experience in Creating ADF pipelines to execute Databricks Notebook activities to carry out transformations. Debugging data pipelines, investigating issues, fixing failures etc. and scheduling pipelines using schedule Trigger in Azure Data Factory (ADF). Experience in Developing Spark applications using Spark - SQL in Databricks for data extraction, transformation and aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the customer usage patterns. Good Experience on Databricks with Pyspark for Data migration and ETL project implementation using Databricks Notebooks and scheduling jobs. Good understanding of Spark Architecture including Spark Core, Spark SQL, Data Frames, Driver Node, Worker Node, Stages, Executors and Tasks. Expertise in coding like Oracle - SQL and PL/SQL. Experience in implementing UNIX shell scripting. Experience in writing PL/SQL concepts like Packages, Procedures, Functions, Triggers, Cursors, Exception Handling and Collections. Strong experience in Performance testing and tuning in Oracle Database. Expertise in Retail and Banking domain such as SCM, Client Mortgages System, Enterprise Governance Risk and Compliance Platform (EGRCP) with modules GRC, Audits, Risk, ISM.