Sr. Data Engineer

Air Itam, M07, MY, Malaysia

Job Description

Role Overview



We're looking for a skilled

Data Engineer

to build a scalable big data processing platform

that enables real-time decision-making and AI-powered automation. You'll design systems

that handle large-scale data processing, ensure high data quality, optimizing resource

usage and reduce cost, and support cross-functional teams with actionable insights. Your

work will directly contribute to improving energy efficiency and improve data visibility with

real-time dashboard -- all while helping us achieve our mission of making industrial HVAC

systems smarter.

Key Responsibilities



? Build and maintain scalable big data pipelines that handle large volumes of sensor

and control data

? Design and operate a real-time data processing system that supports timely

decision-making

? Integrate Kafka and Spark Streaming for low-latency, event-driven data streaming

? Implement cloud-based analytics solutions (AWS, Azure, GCP) to support advanced

processing

? Develop automated data quality checks to ensure high-quality, validated inputs and

maintain the integrity of the data processed through the pipeline

? Collaborate with AI engineers, IoT engineers and software teams to support

ingestion, model development and analytics

? Optimize resource usage to reduce data processing costs and storage costs

? Continuously monitor, test, and tune systems for performance, cost-efficiency, and

reliability

? Implement and maintain metadata management

Who We're Looking For



? 3-6+ years of experience in big data engineering or data infrastructure roles

? Hands-on expertise in large-scale data processing, ETL pipelines, and cloud-based

storage

? Expertise in Spark, Python and SQL

? Experience in Spark Streaming, Kafka, Delta Lakehouse, Databricks (DLT) and Azure

Synapse

? Experience in data visualisation (eg. Apache Superset, Tableau and Power BI.)

? Experience with version control system (Git)

? Solid background in cloud computing (AWS, GCP, Azure) and scalable infrastructure

? Strong understanding of data quality systems and schema validation

? Proven track record of delivering efficiency improvements (e.g., 40%+ in data

processing)

? Ability to work across engineering and AI teams to deliver clean, production-ready

data

Job Types: Full-time, Permanent

Pay: RM8,000.00 - RM14,000.00 per month

Work Location: In person

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD1298478
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Air Itam, M07, MY, Malaysia
  • Education
    Not mentioned