Job Description

Role Overview

We are seeking a skilled

Data Engineer

to design and build scalable big data processing platforms that enable real-time decision-making and AI-driven automation. You will be responsible for developing robust data pipelines, ensuring high data quality, and optimizing system performance and resource usage. Your work will directly contribute to improving energy efficiency, operational insights, and sustainability through real-time dashboards and analytics.

Key Responsibilities

Build and maintain

scalable big data pipelines

that process large volumes of sensor and control data. Design and operate

real-time data processing systems

to support timely and data-driven decision-making. Integrate

Kafka and Spark Streaming

for low-latency, event-driven data streaming. Implement

cloud-based analytics solutions

(AWS, Azure, or GCP) for advanced data processing. Develop

automated data quality checks

and maintain data integrity across the platform. Collaborate with

AI, IoT, and software engineering teams

to support data ingestion, model development, and analytics. Optimize data processing and storage for

cost efficiency and performance

. Continuously monitor, test, and tune systems for reliability and scalability. Implement and maintain

metadata management

and documentation for data assets.

Who We're Looking For

3-6+ years

of experience in big data engineering or data infrastructure. Hands-on expertise in

large-scale data processing

,

ETL pipelines

, and

cloud-based storage

. Strong proficiency in

Spark, Python, and SQL

. Experience with

Spark Streaming, Kafka, Delta Lakehouse, Databricks (DLT), and Azure Synapse

. Familiarity with

data visualization tools

such as Apache Superset, Tableau, or Power BI. Experience with

version control systems (Git)

. Solid background in

cloud platforms

(AWS, Azure, or GCP) and scalable architecture design. Deep understanding of

data quality systems

,

schema validation

, and

data governance

. Proven ability to

deliver efficiency improvements

(e.g., reducing data processing time or cost by 40%+). Collaborative mindset with the ability to work across engineering, AI, and operations teams.

Why Join Us

Contribute to

real-world energy impact

in mission-critical industrial environments. Work on

cutting-edge AI, IoT, and automation technologies

for HVAC optimization. Build systems that power

live decision-making

for industrial clients. Help reduce

energy waste and operational costs

through data-driven innovation. Join a

collaborative, fast-paced, and growth-oriented

environment. Enjoy

competitive compensation

, flexibility, and opportunities for continuous learning.
Job Type: Full-time

Pay: RM8,000.00 - RM12,000.00 per month

Benefits:

Health insurance Maternity leave Opportunities for promotion Professional development
Work Location: In person