Big Data Operations Engineer

Subang Jaya, Selangor, Malaysia

Job Description


Proton New Energy Technology Sdn Bhd Incorporated on 16th August 2022, a wholly-owned subsidiary of Perusahaan Otomobil Nasional Sdn Bhd. General (or Official) Distributor of smart vehicles in Malaysia & Thailand. Our mission and vision are to become the leader in new energy ecosystem automotive solutions. Our business scope encompasses the distribution of New Energy Vehicles, provision of EV charging solutions, electronic parts and mobility solutions, finance and insurance services, retailing of accessories and merchandise, monitoring data services for customers as well as the latest technology in EV design and manufacturing. Job Responsibilities: Design and Build Distributed Processing Platform: Responsible for planning, designing, and building a distributed processing platform for big data. Ensure the system can effectively handle massive data by selecting appropriate distributed computing frameworks (such as Hadoop, Spark) and distributed storage systems (such as HDFS). Design corresponding architecture to support high concurrency and availability in data processing. Technology Selection and Evaluation: Responsible for selecting the appropriate technology stack, including but not limited to databases, message queues, and data warehouses. Conduct technology evaluations, choose the most suitable technology components based on business requirements and performance criteria, and ensure the entire big data analytics system works together seamlessly. System Architecture Design and Optimization: Undertake the overall architecture design and optimization of the big data analytics system, ensuring the system meets business requirements and performance criteria. Project Requirement Analysis: Understand project requirements thoroughly, communicate with stakeholders, and detail the analysis of project functionalities, performance, security, and other aspects. Formulation of Project Design Standards: Develop project design standards, clearly defining architectural, module, and database design standards to ensure alignment with industry best practices and project requirements. Guidance on Design, Development, and Deployment: Provide technical guidance throughout the project lifecycle, coordinate the design team\'s efforts, and ensure the implementation of design standards. Collaborate with the development team to maintain code quality and adherence to design standards. Formulation of Project Implementation Standards: Develop project implementation standards, including deployment procedures, testing strategies, quality controls, and system integration standards. Ensure the project follows these standards during deployment and implementation. Data Collection Program Development: Design and implement data collection programs to efficiently extract required data from various sources, such as databases, log files, APIs, etc. Data Cleaning and Integration Program Development: Develop data cleaning and integration programs to process raw data, handle missing values, outliers, and duplicate data, and integrate data from multiple sources into a consistent format. A Data Analysis Program Development: Design and write data analysis programs, develop data processing and computation logic based on business requirements for in-depth analysis of large datasets. Visualization Program Development: Create visualization programs to present analyzed data in intuitive charts, reports, or dashboards to aid business teams in understanding and utilizing data. Job Requirements: Tertiary qualification in STEM (Science, Technology, Engineering, Mathematics) or any related fields. Minimum 5 years of relevant experience in Bigdata operations Excellent communication skills. Agile, fast, able to travel and can work under pressure. Able to work in a start-up environment.

foundit

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD1019832
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Subang Jaya, Selangor, Malaysia
  • Education
    Not mentioned