Senior Data Engineer

Bayan Lepas, Pulau Pinang, Malaysia

Job Description


:
UST is seeking an experienced and highly motivated Senior Azure Data Engineer to join our Data & Analytics team. The ideal candidate will be a hands-on engineer responsible for designing, developing, implementing, and managing scalable, robust, and secure data solutions on the Microsoft Azure platform. This role involves leading a team of data engineers, setting technical direction, ensuring the quality and efficiency of data pipelines, and collaborating closely with data scientists, analysts, and business stakeholders to meet data requirements.
Key Responsibilities

  • Design, architect, and implement end-to-end data solutions on Azure, including data ingestion, transformation, storage (lakes/warehouses), and serving layers.
  • Oversee and actively participate in the development, testing, and deployment of robust ETL/ELT pipelines using key Azure services.
  • Establish and enforce data engineering best practices, coding standards, data quality checks, and monitoring frameworks.
  • Ensure data solutions are optimized for performance, cost, scalability, security, and reliability.
  • Collaborate effectively with data scientists, analysts, and business stakeholders to understand requirements and deliver effective data solutions.
  • Manage, monitor, and troubleshoot Azure data platform components and pipelines.
  • Contribute to the strategic technical roadmap for the data platform.
Required Skills and Experience
  • Bachelor's degree in computer science, Engineering, Information Technology, or a related quantitative field (or equivalent practical experience).
  • Minimum 6-8+ years of overall experience in data engineering roles.
  • Minimum 3-4+ years of hands-on experience designing, implementing, and managing data solutions specifically on the Microsoft Azure cloud platform.
  • Core Azure Data Services: Deep expertise in Azure Data Factory (ADF), Azure Synapse Analytics (SQL Pools, Spark Pools), Azure Databricks, Azure Data Lake Storage (ADLS Gen2).
  • Data Processing & Programming: Strong proficiency with Spark (using PySpark or Scala) and expert-level SQL skills. Proficiency in Python is highly desired.
  • Azure DevOps - CICD
  • Data Architecture & Modeling: Solid understanding of data warehousing principles (e.g., Kimball), dimensional modeling, ETL/ELT patterns, and data lake design.
  • Databases: Experience with relational databases (e.g., Azure SQL Database) and familiarity with NoSQL concepts/databases is beneficial.
  • Vision Control: Proficiency with Git for code management.
Our commitment to Diversity, Equity and Inclusion
Diversity and Inclusion are among the founding blocks of how UST as an organisation translates its values of Humility, Humanity, and Integrity into practice.
About UST
For more than 25 years, UST has worked side by side with the world's best companies to make a real impact through digital transformation. Together, with over 30,000 employees in 30+ countries, we build for boundless impact touching billions of lives in the process.
Skills:
Azure synapse Analytics ,Azure Data Factory,ADLS Storage,Azure devops - CICD
About Company:
UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the worlds best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact touching billions of lives in the process.

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD1100129
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Bayan Lepas, Pulau Pinang, Malaysia
  • Education
    Not mentioned