Data Engineer, Data Management My

Malaysia, Malaysia

Job Description


:

Job Purpose

Design, Build, Maintain, Manage the Big Data and Cloud Data initiatives for Group Risk

Job Responsibilities

  • Define Data Ingestion, Data Validation, Data Security, Data Archival / Retention Frameworks and other platform governance related frameworks.
  • Implement and operationalise governance processes based on the defined frameworks.
  • Establish standards for ETL process in both Big Data and Cloud, which includes designing and building ETL Jobs, Scheduling and Monitoring
  • Collaborate with the Big Data and Cloud system owners to monitor the user experience on platform performance, advise on and implement any necessary infrastructure changes
  • Define data archival and retention policies
  • Design and define security access matrix
  • Review the ETL in the Big Data and Cloud in the Production environment to ensure optimal performance
  • Support on Model Deployment on Production
  • Maintain and update Big Data and Cloud-related documentation
  • Provide support to Business Data Users on data queries and provide advisory on data points.
  • Provide data quality assessment of the ingested data in the Big Data and Cloud Platform
  • Ensures compliance with the Bank\'s Data Compliance policies
Job Requirements
  • Degree in Computer Science / IT / MIS from a reputable university
  • Minimum 8-10 years of experience in Big Data Platform, Cloud services, data management, and data modelling.
  • Experience with Amazon Web Services cloud implementation
  • Experience with Cloudera Distribution of Hadoop System.
  • Experience with tools such as Hue and R Studio
  • Experience with integration of data from multiple data sources
  • Experience in Data Management methodologies
  • Proficiency with Hadoop v2, MapReduce, HDFS
  • Proficiency of AWS services, such as Glue, Glue DataBrew, Redshift, Athena, S3
  • Proficiency of Big Data querying tools, such as Pig, Hive, and Impala
  • Good knowledge of the Financial Services Industry.
  • Knowledge of various ETL techniques and frameworks, such as Flume
  • Added advantage for having knowledge on masking/hashing technology
  • Added Advantage for having experience in Oracle Data Integrator.
  • Have implemented at least 1 Big Data and/or Cloud-based projects in the past 3 years.
**Only shortlisted candidates will be notified

CIMB

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD1009545
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Malaysia, Malaysia
  • Education
    Not mentioned