Roles & Responsibilities
Key Responsibilities
• Data Platform Architecture
• Design end-to-end Databricks Lakehouse architectures.
• Define enterprise data architecture standards and reusable patterns.
• Architect Bronze, Silver, and Gold data products using Medallion Architecture.
• Establish scalable data integration frameworks for batch, streaming, and CDC workloads.
• Design resilient multi-region and data residency compliant solutions.
Data Modernization
• Lead modernization of Cloudera Hadoop, Hive, Impala, Spark, and legacy Data Warehouse platforms.
• Define migration strategies, migration factories, and cutover approaches.
• Establish metadata, lineage, and governance migration frameworks.
• Drive workload optimization and performance tuning.
Databricks Governance
• Design Unity Catalog architecture.
• Implement RBAC, ABAC, row-level and column-level security.
• Establish lineage, audit, compliance, and data quality frameworks.
• Define workspace, catalog, and metastore architecture across regions.
• Implement data sharing and data residency controls.
AI / GenAI Enablement
• Design AI-ready Lakehouse architectures.
• Enable MLOps and LLMOps frameworks.
• Implement Feature Stores and Vector Search architectures.
• Support GenAI, Agentic AI, and Retrieval-Augmented Generation (RAG) use cases.
• Evaluate emerging Databricks AI capabilities and accelerators.
Architecture Governance
• Conduct architecture reviews and design approvals.
• Define technical standards, guardrails, and reference architectures.
• Lead Proof of Concepts and innovation initiatives.
• Mentor engineering teams on Databricks best practices.
• Ensure compliance with security, risk, and regulatory requirements.
Required Skills & Qualifications
• 10+ years in Data & Analytics Architecture.
• 5+ years of Databricks implementation experience.
• Strong experience in large-scale cloud data modernization programs.
• Experience migrating Cloudera/Hadoop environments to Databricks.
• Banking and Financial Services domain experience preferred.
• Experience engaging with executive stakeholders and enterprise architecture boards
• Must work from customer location in Dallas.
Salary Range: $120,000 to $135,000 per year
</div