Your new company
As a Senior Data bricks Engineer, you will play a critical role in transforming raw data into actionable insights. Working within a high-performing team, you’ll design and maintain scalable data pipelines, and support strategic decision-making.
Your new role
- Design, build and maintain data ingestion and transformation pipelines using Azure Databricks
- Integrate new data sources and apply business logic to generate meaningful metrics
- Collaborate with industry teams to develop dimensional data models aligned with Kimball methodology
- Monitor and enhance data quality and security using vendor tools within the Databricks Lakehouse
- Extend orchestration frameworks and platform design principles as needed
- Act as a subject-matter expert on target state architecture
- Ensure reliability and performance of existing databrick environments through proactive monitoring and troubleshooting
- Mentor junior engineers and promote best practices in software engineering
What you'll need to succeed
- Bachelor’s degree in Computer Science, Information Systems, Business Administration or related discipline
- Minimum 3 years of hands-on experience with Azure Databricks
- Strong experience with Azure services including Data Lake, Blob Storage and Data Factory
- Deep understanding of data architecture principles: ETL, data modelling, governance, quality, privacy and security
- Proficiency in SQL and Python, with strong analytical and problem-solving skills
- Familiarity with Medallion Architecture or similar frameworks
What you'll get in return
- Opportunity to work on impactful data initiatives within a leading regulatory agency
- Collaborative team environment with strong mentoring culture
- Access to cutting-edge cloud technologies and modern data platforms
- Flexible working arrangements and career development pathways
What you need to do now
If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.
If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion on your career.
LHS 297508