Senior Platform Engineer / Senior Data Engineer

Kuala Lumpur, Malaysia

Job Description


Job Summary We are looking for a highly motivated and experienced individual who will be responsibilities for a data professional, specifically focusing on managing and optimizing data infrastructure, pipelines, and processes. Mandatory Skill-set Bachelor\'s degree in IT, Computer Science, or Engineering; At least 3-5 years of experience using Big Data technologies, preferably with Azure Big Data technologies; Minimum 5 years of professional experience in data warehousing, operational data store, and large-scale data architecture management in Unix and/or Windows environments; Strong hands-on support experience with streaming and batch ETL processes; Hands-on experience with Azure AKS and AWS EKS; Experience with real-time data streaming using Kafka/Confluent; Experience with data API support using Python/Java is desirable; Hands-on experience with Azure Big Data Solutions such as Data Factory, Databricks, Gen2, Synapse, Power BI; Support experience with ETL/ELT frameworks, data warehousing concepts, data management frameworks, and data lifecycle processes. Desired Skill-set Good understanding of data analytics and data visualization, highly prefer Power BI; Experienced working in insurance industry will be an added advantage. Responsibilities Managing the infrastructure of the data platform, including security, performance, fault tolerance, and elasticity; Handling end-to-end data pipelines and integration processes, both batch and real-time; Monitoring, recommending, and implementing improvements to enhance data quality, reliability, efficiency, and cleanliness; Implementing best practices in data management, ETL/ELT processes, coding and configuration standards, error handling, auditing, and data archival; Collaborating with various stakeholders to understand data needs, gather requirements, and deliver data solutions aligned with business goals; Providing support for data issues and change requests, documenting investigations, findings, recommendations, and resolutions; Assessing technical skillsets and maturity level for managing and operating the big data platform; Contributing effectively to projects from technical support, project management, and team collaboration perspectives; Keeping up with new technologies and techniques applicable to solution delivery; Understanding existing and emerging technologies, as well as business practices, approaches, organization, politics, and culture; Identifying technology gaps and coordinating changes to meet new requirements within critical deadlines. Should you be interested in this career opportunity, please send in your updated resume to [HIDDEN TEXT] at the earliest. When you apply, you voluntarily consent to the disclosure, collection and use of your personal data for employment/recruitment and related purposes in accordance with the SCIENTE Group Privacy Policy, a copy of which is published at SCIENTE\'s website (https://www.sciente.com/privacy-policy) Confidentiality is assured, and only shortlisted candidates will be notified for interviews. EA Licence No. 07C5639

foundit

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD947510
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Kuala Lumpur, Malaysia
  • Education
    Not mentioned