Databricks Architect

Kuala Lumpur, M14, MY, Malaysia

Job Description

Come join us

The Databricks Solution Architect is a senior technical leadership role responsible for defining, designing, and overseeing the implementation of scalable, secure, and high-performance data platforms using the Databricks Lakehouse Platform. This individual will translate business strategy into technical architecture, guide development teams, and ensure all data solutions align with enterprise standards for governance, security, and cost optimization.

Skills and experiences

Required Skills & Experience:



10+ years

of experience in data architecture, data engineering, or a related senior technical role.

5+ years

of deep, hands-on experience designing and implementing large-scale data solutions on the

Databricks Platform

. Expertise in

Lakehouse Architecture

,

Delta Lake

,

Apache Spark

, and performance tuning techniques. Proven experience implementing

Databricks Unity Catalog

for centralized governance. Deep proficiency in

Python/PySpark

or

Scala

and advanced

SQL

. Extensive experience with one major cloud platform and its security and data services. Strong experience with data modeling (dimensional, data vault) and data warehouse concepts. Demonstrated ability to lead technical discussions, document architectural designs, and communicate complex concepts to both technical and non-technical audiences.

Preferred Skills & Certifications:



Experience with real-time/streaming data architectures (Structured Streaming). Experience with MLOps practices, including

MLflow

for model lifecycle management. Expertise in Infrastructure-as-Code tools (e.g., Terraform) and automated CI/CD for Databricks.

Databricks Certified Data Engineer Professional

or

Databricks Certified Machine Learning Professional

or equivalent cloud architecture certification.

About you

Characteristics that can spell success for this role



Consultative, collaborative, curious
Resilient, adaptable, flexible
Humble leader, strong negotiator, relationship builder
Passionate about tech and engaging with and advising clients

What you'll do

Architectural Leadership:

Define and own the end-to-end technical architecture and roadmap for the enterprise data platform on Databricks, including data ingestion, transformation, storage, and consumption layers.

Lakehouse Design:

Design and champion the implementation of the Lakehouse architecture utilizing

Delta Lake, Databricks Unity Catalog, and Databricks SQL Warehouse

to support all data, analytics, and AI/ML initiatives.

Data Governance & Security:

Architect and enforce enterprise-level data governance, security, and access control policies using

Unity Catalog

(e.g., fine-grained access, lineage tracking, auditing).

Technical Guidance & Mentorship:

Provide technical leadership, guidance, and mentorship to a team of Databricks Engineers. Conduct architectural reviews, code audits, and ensure adherence to best practices and standards.

Performance and Cost Optimization:

Define strategies for, and lead, major performance tuning and cost optimization initiatives across all Databricks workloads, clusters, and Delta Lake storage.

Cloud Integration:

Lead the integration of Databricks with core cloud services (AWS, Azure, or GCP) and other enterprise systems (e.g., data catalogs, BI tools, ML platforms).

Stakeholder Collaboration:

Engage with executive stakeholders, data scientists, and business leaders to understand complex requirements and translate them into robust, scalable technical designs and solution blueprints.

DataOps and Automation Strategy:

Define the DevOps/DataOps strategy for the Databricks environment, including continuous integration/continuous delivery (CI/CD) pipelines and Infrastructure-as-Code (IaC) using tools like Terraform or Databricks Asset Bundles.

Innovation:

Evaluate new Databricks features, open-source technologies (e.g., MLflow), and industry trends to drive continuous platform improvement and competitive advantage.

Enjoy your career

Some of the best things about working at Avanade

+ Opportunity to work for Microsoft's Global Alliance Partner of the Year, with exceptional development and training (minimum 80 hours per year for training and paid certifications) + Real-time access to technical and skilled resources globally
+ Dedicated career advisor to encourage your growth
Engaged and helpful coworkers genuinely interested in you
+
Find out more about some of our benefits

Employee Benefits at Avanade | Avanade

A great place to work

As you bring your skills and abilities to Avanade, you'll get distinctive experiences, limitless learning, and ambitious growth in return. As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and communities. You'll join a community of smart, supportive collaborators to lift, mentor, and guide you, and to lean on your expertise . You get a company purpose-built for business-critical, leading-edge technology solutions, committed to improving the way humans work, interact, and live. It's all here, so take a closer look!

We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Visit our Inclusion & Diversity page.

Create a future for our people that focuses on
o Expanding your thinking o Experimenting courageously o Learning and pivoting

Inspire greatness in our people by
o Empowering every voice o Encouraging boldness o Celebrating progress

Accelerate the impact of our people by
o Amazing the client o Prioritizing what matters o Acting as one

Beware of fraud agents! do not pay money to get a job

MNCJobz.com will not be responsible for any payment made to a third-party. All Terms of Use are applicable.


Related Jobs

Job Detail

  • Job Id
    JD1267852
  • Industry
    Not mentioned
  • Total Positions
    1
  • Job Type:
    Full Time
  • Salary:
    Not mentioned
  • Employment Status
    Permanent
  • Job Location
    Kuala Lumpur, M14, MY, Malaysia
  • Education
    Not mentioned