Big Data Spark

• 2 to 5 years hands-on Experience on Spark Core, Spark-SQL, Scala-Programming, and Streaming datasets in Big Data platform • Should have extensive working experience in Hive and other components of the Hadoop ecosystem (HBase, Zookeeper, Kafka, and Flume) • Should be able to understand the complex transformation logic and translate them to Spark-SQL queries. • Unix Shell Scripting and setting up CRON • Familiar with Data Warehouse concepts and Change Data Capture (CDC and SCD Types) • Should have worked on Cloudera distribution framework, Oozie Workflow (or any Scheduler), Jenkins (or any version controller). • Prior Experience in Consumer Banking Domain is an advantage. • Prior Experience in the agile delivery method is an advantage. • Excellent understanding of technology life cycles and the concepts and practices required to build big data solutions • Core Java skillset is an added advantage. Airflow is an added advantage. • Good Knowledge and Experience in any database (Teradata or Data Lake or Oracle or SQL Server) is a plus.…