Principal Data Engineer (Databricks)

Snap Analytics is a high-growth data analytics consultancy with offices in the UK and India, we work with enterprise clients to simplify complex data and drive business value. We’re customer-centric in our approach and dedicated to helping organisations achieve their strategic goals through innovative cloud analytics solutions. 

We pride ourselves on using our innovative Snap 360 delivery framework, combined with a strong culture of teamwork and knowledge-sharing, to consistently deliver exceptional results and ensure 100% customer satisfaction.

A bit about the role

This is an exciting and unique opportunity to join a high-growth consultancy that only works with the latest modern cloud platforms. You'll be at the cutting edge of modern cloud solutions and will be a vital member within our brilliant team of consultants.

There is a huge opportunity for you to have a major impact on the organisation; to influence our growth and drive the strategic direction of the company!

As a Principal Data Engineer at Snap, building on your wealth of experience, you’ll have the opportunity to explore the latest technologies within analytics; from ETL and Modern Cloud Data Platforms, to BI and ML/AI tools.

We’ll also look to you to lead in client interaction and engagement, support and mentor more junior members of the team and assist in building internal capabilities for use with clients.

Here’s a breakdown of what you’ll be doing

Data Migration & Integration: 

• Lead and manage complex data migration projects, ensuring smooth transitions from multiple data sources to cloud environments. 
• Design and implement efficient ETL/ELT processes for seamless integration between systems.

Data Warehousing: 

• Design, build, and optimize cloud-based data warehouses (e.g. Databricks (must have), Snowflake, AWS Redshift, Google BigQuery, Azure Synapse) to support advanced analytics and reporting needs. Ensure data accuracy, security, and compliance.

Data Modelling: 

• Develop and maintain robust data models (star, snowflake, etc.) that ensure high-quality, scalable, and efficient data storage and retrieval. 
• Implement best practices for data modelling to support analytics and reporting requirements.

Cloud Infrastructure: 

• Develop and maintain scalable, robust, and cost-effective cloud-based data architectures on platforms such as AWS, Azure, and GCP. 
• Provide best practices for data storage, governance, and access control.

Pipeline Development: 

• Build, automate, and monitor data pipelines that handle large volumes of structured and unstructured data. 
• Implement best practices for data cleansing, transformation, and enrichment.

Collaboration & Stakeholder Management: 

• Collaborate with data architects, data scientists, and business teams to understand requirements and translate them into effective data engineering solutions. 
• Communicate technical challenges and provide insights on data-driven solutions.

Performance Optimization: 

• Analyse and improve the performance of data systems and pipelines, ensuring low-latency data access, high availability, and optimized cloud resource usage.

Mentorship & Leadership: 

• Mentor junior engineers, fostering a culture of collaboration and continuous learning. 
• Provide technical guidance, code reviews, and best practices to elevate the overall team performance.

Innovation & Continuous Improvement: 

• Stay updated with the latest trends and technologies in data engineering, cloud platforms, and big data to propose innovative solutions for clients' evolving data needs.

This role is for you if you have

• Proven experience (5 years+) as a data engineer with a focus on data migration, integration and cloud-based data warehousing working with big data for enterprise organisations.
• Expertise in building data architecture on cloud platforms such as AWS, GCP or Microsoft Azure.
• 5+ years of experience of ETL/ELT design and development using tools like Matillion, Informatica, SAP Data Services, Talend and Cloud Data Platforms including Databricks (must have), Snowflake, Redshift or BigQuery.
• A Data Engineer Professional certification with Databricks
• A deep understanding of data modelling principles and techniques (e.g., star schema, snowflake schema), and experience in developing optimized models to support analytics and reporting.
• Experience with version control, CI/CD pipelines, and containerization tools (e.g., Git, Jenkins, Docker, Kubernetes).
• Strong knowledge of relational and non-relational databases and hands on experience with cloud data warehouse including AWS Redshift, Google BigQuery, Azure Synapse.
• A 2:1 University degree or above (or equivalent other).
• Excellent communication skills, with the ability to work collaboratively with both technical and non-technical stakeholders.
• Strong problem-solving skills, with the ability to troubleshoot complex data issues and deliver optimized solutions.

What we offer

• Annual Leave - Everyone needs a healthy, happy and productive life that only comes with regular R&R. We offer a competitive annual leave allowance plus public holidays.
• Flexible, Hybrid Working - We believe variety is the spice of life, so we encourage a healthy mix of office based and remote working to facilitate a great work/life balance.
• Financial Wellbeing - As well as a competitive salary, we offer contributory pension schemes to allow for future financial security.
• Health & Wellbeing - The well being of everyone at Snap is of great importance to the business, all employees from day 1 are entitled to private medical health insurance through Vitality.
• Profit Share - Enjoy a share of our profits with a bonus at the end of each successful year.
• Technical Training - Dedicated time for ongoing technical training and certification on the modern data stack
• Monthly Social Club -From surfing to pottery, once a month there is always something new to try.
• UK Electric Car & Cycle to Work Schemes - We promote healthier lifestyles and reduced environmental pollution. These schemes are our way of trying to make a difference.
• Enhanced Maternity & Paternity Time Off - We recognise that having a baby is an important and exciting time, so our policies are designed to make those early days as flexible as possible when it comes to juggling work commitments with the demands of a new family.