Lead Data Engineer

Cyberjaya, M10, MY, Malaysia

Job Description

Open for Expats

On a given day, you will:



Team Leadership: Lead and mentor a team of data engineers to design, build, and optimize scalable data pipelines for analytics, reporting, and operational needs. Unified Data Pipeline Management: Create and manage a unified data pipeline that integrates multiple data sources, facilitating efficient access for both internal and external systems, including third-party tools and client-facing platforms. Utilization of Low-Code/No-Code Tools: Leverage low-code/no-code integration tools such as Fivetran or RudderStack to accelerate data workflows and improve integration efficiency. Cross-Functional Collaboration: Work closely with various teams to identify data needs and ensure smooth data flows between systems, enhancing high availability and integration. Data Governance and Quality Assurance: Implement and manage data governance and quality standards, ensuring data consistency and reliability throughout the organization. Real-Time and Batch Data Architecture: Architect and oversee the implementation of real-time and batch data pipelines using data streaming tools like Kafka or Pub/Sub, ensuring low-latency, high-performance data processing. Technical Guidance and Support: Provide technical guidance to your team, aiding in troubleshooting complex data issues and optimizing performance and cost-effectiveness while adhering to best practices. Continuous Improvement: Stay informed on the latest in data engineering technologies and best practices, especially concerning real-time processing and low-code/no-code integrations, to enhance our data infrastructure continually. Stakeholder Coordination: Communicate with stakeholders to ensure timely delivery of data solutions that effectively meet business requirements.

You may enjoy working with us if you:



Experience in fintech, trading, or other data-heavy industries. Familiarity with API-based integrations and third-party system integrations. Knowledge of additional data streaming technologies and best practices. Experience with automating data flows using low-code platforms.

We would love to work with you if you:



Bachelor's degree in computer science, data engineering, or a related field. 10 years of experience in data engineering, with at least 4 years in a leadership role. Expertise in designing, building, and maintaining data pipelines and data warehouse solutions. Strong knowledge of cloud platforms such as Google Cloud or AWS, and tools like BigQuery, PostgreSQL, and Airflow. Proficiency in programming languages such as Python or similar, with experience in ETL/ELT processes. Hands-on experience with low-code/no-code data integration tools like Fivetran, RudderStack, or similar platforms. Deep understanding of real-time data streaming and data processing tools such as Kafka, Pub/Sub, or similar. Experience in building unified data pipelines that serve both internal and external systems, ensuring consistent, secure data flows. Experience working with both real-time and batch data processing systems. Strong understanding of data governance, security, and compliance practices. Excellent communication skills, with the ability to convey technical concepts to non-technical stakeholders and mentor junior team members.

What We Offer:



State-of-the-art office facilities with excellent amenities (gym, squash court, rooftop garden, etc.). Collaboration with top talent from across the globe. Exciting team-building activities and opportunities for overseas travel. Competitive salary and performance-based bonus. A range of health benefits and allowances. Casual dress code and a supportive, vibrant work culture.
Job Types: Full-time, Permanent

Pay: RM15,000.00 - RM25,000.00 per month

Benefits:

Free parking Health insurance Maternity leave Meal provided Opportunities for promotion Parental leave Professional development Vision insurance
Schedule:

Monday to Friday
Supplemental Pay:

Yearly bonus
Ability to commute/relocate:

Cyberjaya: Reliably commute or willing to relocate with an employer-provided relocation package (Preferred)
Experience:

Leadership: 5 years (Preferred) Python: 3 years (Preferred) * GCP Cloud : 4 years (Preferred)

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD1109340
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    211806.0 268193.0 USD
  • Employment Status
    Permanent
  • Job Location
    Cyberjaya, M10, MY, Malaysia
  • Education
    Not mentioned