We are seeking a Resident Solutions Architect (RSA) with deep experience in Databricks to lead strategic data initiatives for our enterprise clients. As a RSA, you will be the technical point of contact embedded directly with the customer, helping them architect, build, optimize, and operationalize solutions on the Databricks Lakehouse Platform.This role combines deep platform knowledge with the ability to lead cross-functional teams, mentor junior architects/engineers, and act as a trusted advisor for customers undergoing digital and data transformation. Key Responsibilities• Lead large-scale implementations of Databricks-based solutions across data engineering, analytics, and ML use cases.• Own technical architecture and decision-making during engagements, including platform design, pipeline strategy, governance, and performance optimization.• Drive the implementation of scalable data pipelines, Delta Lake architectures, and real-time streaming applications using Spark and Structured Streaming.• Guide customers through migration initiatives, including legacy data platform modernization to Databricks.• Optimize workloads through effective use of Databricks-specific tuning strategies(e.g., Z-Ordering, Delta Cache, Photon, OPTIMIZE).• Collaborate with cloud infrastructure, data science, and BI teams to ensure robust end-to-end integration.• Provide technical leadership and mentorship to client teams and internal engineers.• Align delivery with best practices in CI/CD, observability, and platform operations on Databricks.• Coordinate closely with Databricks Customer Success, Product, and Sales Engineering teams to align on business goals. Required Skills and Experience• 4+ years of hands-on experience with Databricks, including Delta Lake, Unity Catalog, Structured Streaming, and MLflow.• 5+ years working with Apache Spark, with strong command over transformations, actions, job tuning, and debugging.• Proficiency in Python, SQL, and optionally Scala for distributed data processing.• Experience architecting and delivering enterprise-scale data lakehouse solutions.• Experience with CDC tools like Fivetran• Strong expertise in at least one major cloud platform (Azure, AWS, or GCP), including services like:o Azure Data Factory, Event Hubs, Blob Storageo AWS Glue, S3, Kinesis• Experience leading data platform migrations and implementing strategies for data ingestion, CDC, and orchestration.• Working knowledge of DevOps & CI/CD practices, including experience with GitHub Actions, Jenkins, or Azure DevOps.• Exceptional communication skills and experience working with cross-functional teams and executive stakeholders. Preferred Qualifications• Databricks certifications:o Certified Data Engineer – Professionalo Certified Machine Learning Professional• Background in dimensional modelling, data warehousing, and SCD Type 2implementations.• Experience in regulated industries (e.g., Finance, Healthcare) is a plus.
Job Title
Databricks Solution Architect