Job Description

:



Position Title

:

Data Engineer/Analyst

Department

:

Big Data & Analytics

Position Holder

:

Senior

Reports to

:

Job Scope / Position Summary

We are looking for skilled Data Engineer with expertise in data modelling and data pipeline development. As a Data Engineer/Analyst in Generali Malaysia, you will design, develop and optimize data pipelines based on solution architecture. Proficiency in cloud platforms like AWS Glue and AWS Redshift. Handle Management Information Systems (MIS) to generate reports.

Main Responsibility

Key Result Area

1

Data Pipeline Development

• Discuss with Solution Architecture on designing data pipelines.

• Develop data pipelines with proposed solution.

• Manage and maintain data pipelines.

• Design and optimize of the ETL/ELT architectures and performances.

• Develop efficient and scalable data processing workflows.

• Monitor data pipelines, detect issue and fix.

2

Data Modelling

• Create and maintain data models, including entity-relationship diagrams, to represent data structures and relationships.

• Design database schemas that optimize data storage, retrieval and query performance.

• Improve query performances.

• Optimize on database storage.

3

BAU Tasks

• Understanding business requirements

• Develop/Enhance SAP reports based business requirements

• Fix bug if issue detected.

• Deploy changes into GitHub.

• Delivery reports to business team.

• Ensure data accuracy

4

Documentation

• Create documentation for developed data pipeline, developed data modelling and challenges faced in BAU tasks.

• Knowledge sharing among team members.

Qualification and Experience Requirement

Education

:

• Bachelor\xe2\x80\x99s Degree in Computer Science, Engineering, or related field; Master\xe2\x80\x99s degree preffered

Experience

:

• 3 years of hands-on experience of data integration and analytics in a corporate or consulting setting

Skills

:

• Design, develop and maintain efficient data pipelines to support data processing, transformation and integrations needs.

• Collaborate with cross-functional teams to understand data requirements and implement solutions that are needed for business needs.

• Work with various data sources and formats, ensuring data quality and consistency.

• Monitor and troubleshoot data pipelines to ensure consistency of data flow.

• Handle Management Information Systems (MIS) including data collection, analysis and reporting for decision-making purpose.

• Able to build report by tools (SAP, PowerBI)

• Hands on y using AWS services (AWS Redshift, AWS Glue, AWS S3, AWS Lambda, AWS RDS, AWS AuroraDB, AWS API Gateway)

• Coding language: Python, PySpark, SQL, Linux

• Other skills: ETL/ELT skills, Architecture modelling, Data Modelling, Documentation

2

Avensys Consulting