Design, Build, Maintain, Manage the Big Data and Cloud Data initiatives for Group Risk
Job Responsibilities
Define Data Ingestion, Data Validation, Data Security, Data Archival / Retention Frameworks and other platform governance related frameworks.
Implement and operationalise governance processes based on the defined frameworks.
Establish standards for ETL process in both Big Data and Cloud, which includes designing and building ETL Jobs, Scheduling and Monitoring
Collaborate with the Big Data and Cloud system owners to monitor the user experience on platform performance, advise on and implement any necessary infrastructure changes
Define data archival and retention policies
Design and define security access matrix
Review the ETL in the Big Data and Cloud in the Production environment to ensure optimal performance
Support on Model Deployment on Production
Maintain and update Big Data and Cloud-related documentation
Provide support to Business Data Users on data queries and provide advisory on data points.
Provide data quality assessment of the ingested data in the Big Data and Cloud Platform
Ensures compliance with the Bank\'s Data Compliance policies
Job Requirements
Degree in Computer Science / IT / MIS from a reputable university
Minimum 8-10 years of experience in Big Data Platform, Cloud services, data management, and data modelling.
Experience with Amazon Web Services cloud implementation
Experience with Cloudera Distribution of Hadoop System.
Experience with tools such as Hue and R Studio
Experience with integration of data from multiple data sources
Experience in Data Management methodologies
Proficiency with Hadoop v2, MapReduce, HDFS
Proficiency of AWS services, such as Glue, Glue DataBrew, Redshift, Athena, S3
Proficiency of Big Data querying tools, such as Pig, Hive, and Impala
Good knowledge of the Financial Services Industry.
Knowledge of various ETL techniques and frameworks, such as Flume
Added advantage for having knowledge on masking/hashing technology
Added Advantage for having experience in Oracle Data Integrator.
Have implemented at least 1 Big Data and/or Cloud-based projects in the past 3 years.