Job Description

Job summary \xe2\x80\x93 We are looking for an experienced candidate with expertise in pre-data engineering/platform engineering, and back-end data processing. The candidate should have experience with AWS, API connections, Azure, Kafka, and real-time data streaming. Mandatory Skill-set \xe2\x80\xa2 Bachelor\'s degree in computer science, engineering, or a related field; \xe2\x80\xa2 At least 3 years of experience in data engineering; \xe2\x80\xa2 At least 3+ years of solid hands-on development experience with ETL development to transform complex data structure in multiple data sources environment; \xe2\x80\xa2 Well versed with Python and T-SQL ETL/ELT programming; \xe2\x80\xa2 Experience with big data technologies, such as Hadoop, Spark, or Cassandra. \xe2\x80\xa2 Good understanding of Azure cloud platform, Azure Data Management Solution including Azure Data Factory, Azure Databricks, Azure Blob storage (Gen2) and Azure Synapse; \xe2\x80\xa2 Experience with software development in Python, Java, or another programming language; \xe2\x80\xa2 Strong knowledge in various database technologies (RDBMS, NoSQL and columnar); \xe2\x80\xa2 Strong problem-solving skills and attention to detail. \xe2\x80\xa2 Excellent communication and collaboration skills. \xe2\x80\xa2 Team player, self\xc2\xac motivated and resourceful; \xe2\x80\xa2 Strong sense of work ownership, high affinity with anything data and a desire for constant improvements. Desired Skill-set \xe2\x80\x93 \xe2\x80\xa2 Experienced working in insurance industry. Responsibilities \xe2\x80\x93 \xe2\x80\xa2 Design, develop, document and implement end-to-end data pipelines and data integration processes, both batch and real-time; \xe2\x80\xa2 Responsible for raw data analysis and data profiling for data integration; \xe2\x80\xa2 Extract data from data tables in data warehouse using SQL queries; \xe2\x80\xa2 Identify business requirements and provide technical documentation; \xe2\x80\xa2 Able to manage delivery of projects through complete SDLC; \xe2\x80\xa2 Monitor, recommend, develop and implement ways to improve data quality including reliability, efficiency and cleanliness, and to optimize and fine-tune ETL / ELT processes; \xe2\x80\xa2 Prepare test data, assist to create and execute test plans, test cases and test scripts; \xe2\x80\xa2 Provide BAU support for any data issues and change requests, document all investigations, findings, recommendations and resolutions.
Sciente, we are a team of self-driven professionals with dreams, uncompromising values and a purpose. We are led by diverse, passionate, professional and ethical leaders from IT industry with deep industry domain knowledge. Every member of the leadership team has an excellent track record in making a difference in the industry within a high performance environment. This is coupled with the passion to create a high performance global venture with a difference and in doing the right things based on our core values, we are absolutely committed to deliver beyond satisfaction and therefore, to make a real impact to our clients\xe2\x80\x99 businesses and to make a difference to the community we live in. At Sciente Consulting, we work with large global multi-national companies within banking, financial services, insurance and telecommunications industries to address their business and technology integration challenges. Most importantly, these successful and profit making businesses sponsor the social innovations and community services to achieve an objective and a purpose, which are much larger than business.
Bachelor\'s or Equivalent