Data Engineer/ Etl Developer

Kuala Lumpur, Malaysia

Job Description


PURPOSE A role to be responsible for system design, development and implementation of regional frontend systems. Provide maintenance and support on production systems. KEY ACCOUNTAIBILITIES Design, develop, document and implement end-to-end data pipelines and data integration processes, both batch and real-time. This include data analysis, data profiling, data cleansing, data lineage, data mapping, data transformation, developing ETL / ELT jobs and workflows, and deployment of data solutions. Monitor, recommend, develop and implement ways to improve data quality including reliability, efficiency and cleanliness, and to optimize and fine-tune ETL / ELT processes. Recommend, execute and deliver best practices in data management and data lifecycle processes, including modular development of ETL / ELT processes, coding and configuration standards, error handling and notification standards, auditing standards, and data archival standards. Prepare test data, assist to create and execute test plans, test cases and test scripts. Collaborate with Data Architect, Data Modeler, IT team members, SMEs, vendors and internal business stakeholders, to understand data needs, gather requirements and implement data solutions to deliver business goals. QUALIFICATIONS / EXPERIENCE Bachelor in IT, Computer Science or Engineering. Minimum 3 years of professional experience in data warehouse, operational data store, and large scale data architecture implementations in Unix or/and Windows environment. At least 3 years of solid hands-on development experience with ETL development to transform complex data structure in multiple data sources environment. Experienced in handling and processing different types of data (structured, semi-structured and unstructured). Strong knowledge in various database technologies (RDBMS, NoSQL and columnar). Preferably with a good understanding of data analytics and data visualization, strongly prefer Power BI and Tableau. Good to have understanding of programming languages like Python, Scala, Java, R, Shell and PLSQL Ability to communicate and present technical information in a clear and unambiguous manner. Strong ability to work independently and cooperate with diverse teams in a multiple stakeholder\'s environment. Strong sense of work ownership, high affinity with anything data and a desire for constant improvements.

foundit

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD980760
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Kuala Lumpur, Malaysia
  • Education
    Not mentioned