Data Analytics Architect
Remote
Contract
Responsibilities
• Lead the architecture, design, and implementation of advanced analytics solutions using Azure Databricks/Fabric.
• Work closely with business stakeholders and IT teams to gather requirements and deliver effective solutions.
• Oversee end-to-end implementation of data solutions ensuring alignment with business needs and best practices.
• Lead development of data pipelines and ETL processes using Azure Databricks, PySpark, and relevant tools.
• Integrate Databricks with Azure services (ADLS, Synapse, ADF) and on-prem systems.
• Provide technical leadership and mentorship to data engineering teams.
• Maintain clear documentation of architecture, processes, and data flows.
• Ensure adherence to best practices in code quality, security, and scalability.
• Stay updated on latest Databricks and big-data technologies to drive innovation.
Essential Skills
• Strong experience with Azure Databricks (cluster management, notebooks, Delta Lake).
• Strong SQL skills; experience with NoSQL databases.
• Proficiency in big data tech (Hadoop, Spark, PySpark).
• Strong understanding of Azure Data Lake, ADF, Synapse.
• Experience with ETL/ELT, data warehousing, data lakes.
• Experience with CI/CD and Git.
• Knowledge of cloud security best practices.
Soft Skills
• Excellent communication and ability to explain complex topics.
• Strong problem-solving and proactive issue resolution.
• Leadership and team mentorship skills.
Nice-to-Have Skills
• Power BI
• Microsoft Fabric
• Spark Streaming
• ARM templates for IaC
Experience
• 8+ years working on data ingestion and transformation using Databricks/Synapse and ADF.
• Strong hands-on knowledge of Delta Lake, Delta tables, ADLS Gen2.
• Experience using Auto Loader and Delta Live Tables.
• Proficient in Databricks SQL optimization.
• Hands-on integration experience with Synapse, ADLS, Power BI.
• Experience developing and optimizing Power BI reports.
• Familiarity with modern CI/CD pipelines for Databricks.