Data Pipeline Jobs in the UK

76 to 100 of 398 Data Pipeline Jobs in the UK

Lead Data Engineer

London, United Kingdom
Hybrid / WFH Options
Mace group
a leadership position that will combine a high standard of technical delivery on client projects with strategic oversight of Mace’s client-facing Data Engineering function.You will be considered a subject matter expert in your area and will use your knowledge and experience to help shape the team … define processes and best practices, establish data platforms (both internally and for clients), and help cement Mace’s position as a provider of a Premium technical service.The ideal candidate must have extensive experience of working with Python/PySpark, data pipelines, Azure Databricks (or similar) and … data warehousing platforms, as well as a good working knowledge of T-SQL.You will play a leading role in shaping Mace Consult’s implementation of Microsoft Fabric. Knowledge of the Microsoft/Azure technology stack is essential. You will interface with subject matter experts in Power BI and more »
Salary: £ 70 K
Posted:

Cloud Architect

Liverpool, England, United Kingdom
Regal Cloud
experienced AWS Cloud Architect to design AWS reference architecture for our services-led client. Responsibilities: Design and implement scalable, secure, and high-performance data architectures on AWS. Develop data models and database designs that align with business requirements and ensure data integrity. Proficiency in … or AWS CodePipeline. Hands-on experience with Infrastructure as Code (IaC) tools like AWS CloudFormation, Terraform, or similar. Create and maintain ETL processes, data pipelines, and data integration workflows using AWS services. Implement data storage solutions, including data lakes, data warehouses, and operational databases. Provide technical leadership and guidance on AWS data services and architecture to the team. Requirements: Proven experience as an AWS Data Architect or similar role, with a strong focus on data architecture and management. In-depth knowledge of more »
Posted:

Data Engineer

South Yorkshire, England, United Kingdom
Pearson Carter
Data Engineer £50,000 - £60,000 - Hybrid My client, industry leading EdTech organisation are currently looking to expand their Data team! become a Data Engineer with vast progression opportunities, where your work is all for a great cause! Requirements Thrive in … a fast paced and dynamic environment Exceptional SQL skills including an appreciation for performance tuning on a variety of database engines Data pipeline development experience in Python (especially using pandas, parsing API responses, posting data to API’s etc.) Excellent analytical and problem-solving skills … An appreciation for the big picture while delivering short/mid-term solutions Experience of building data warehouses, enterprise data warehouses or data lakes with ETL pipelines Experience with AWS tools including Glue, Lambda, S3, RDS, is preferred An understanding of CICD concepts including more »
Posted:

Data Scientist/Engineer - Hybrid/Bristol - Up to £60k

Bristol, United Kingdom
Hybrid / WFH Options
Adecco
Data Scientist/Engineer - Hybrid/Bristol Job Title : Data Scientist/Engineer Location : Hybrid/Bristol Remuneration : £50,000 - £60,000 per annum Contract Type : Permanent Role will be based with the modelling team. 25% Data Submission and Cleansing (Data Engineer … Process Improvement (Data Science). Ideally, seeking someone with strong Data Science exposure but Data Engineering skills. Responsibilities : Play a pivotal role in crafting, enhancing, and managing intricate data ingestion pipelines, ensuring their efficiency, scalability, and dependability. Integrate advanced machine learning elements … into data pipelines to elevate data processing and analytical capabilities. Devise and implement data quality metrics and dashboards for monitoring, ensuring the fidelity and precision of ingested data. Collaborate closely with data scientists, engineers, and cross-functional team members in an agile more »
Employment Type: Permanent
Salary: £50000 - £60000/annum Competitive package
Posted:

Technical Product Specialist

London Area, United Kingdom
Smartedge Solutions
record in the development and management of an Azure cloud-based data & analytics platform. Comprehensive experience in the complete data pipeline development process, encompassing data warehousing, data analytics, and ETL processes. Profound understanding of best practices in data governance … in communication, leadership, and team management. Capability to handle multiple tasks, meet stringent deadlines, and deliver top-notch solutions. Solid grasp of contemporary data architecture concepts and experience in data modelling. Familiarity with the costs associated with data management, including CI/CD driven … of business rule modifications on data. Robust problem-solving, decision-making, and analytical abilities. Self-motivated with a commitment to continual enhancement of data platforms and processes. Previous experience in the Banking and Financial Services sector is advantageous. Deep knowledge or experience with using as much of the more »
Posted:

Azure Data Engineer

Greater Bristol Area, United Kingdom
Anson McCade
Azure Data Engineer (SC Cleared) Location: Bristol Salary: £50,000 - £60,000 We're seeking Azure Data Engineer with active SC Clearance. This is a fantastic opportunity to join one of the most reputable digital solution provider's in the United Kingdom providing exposure to the … biggest and most ambitious programmes undertaken to keep our country safe. The SC Cleared Azure Data Engineer will be joining the Defence & Security arena, where you will help digitise defence with new thinking on technology capabilities and adoption processes, so we need someone who is sensitively able to … combine the latest thinking with traditional military functions. *Must have Active SC Clearance* Role requirements Leveraging Azure cloud technologies for tasks such as ETL pipeline development, data warehousing, data lake creation, and data movement. Utilizing Azure data and analytics services, including more »
Posted:

Data Engineering Manager

London, United Kingdom
Hybrid / WFH Options
NewDay
timeline. The ability to hit the deck running and make valuable contributions quickly will be critical.0-12 months you’ll deliverSupport Head of Data Engineering and contribute to establish/enforce best practices, coding standards, and development methodologies for the data engineering team. Drive continuous improvement … in data engineering processes to enhance efficiency, reliability and scalability.Manage a team of skilled data engineers, providing guidance, mentorship, and support to ensure the team's success in delivering high-quality solutions.Contribute to defining and executing the data engineering roadmap, collaborating with other technical … and business leaders to align data initiatives with overall business goals.Possess and maintain a deep understanding of the technical stack, including Scala, Python, SQL, Snowflake, and DBT. Provide technical guidance and expertise to the team when facing complex challenges.Collaborate with data architects and analysts to design more »
Salary: £ 70 K
Posted:

Data Engineer

London Area, United Kingdom
Immersum
Data Engineer Location: London, 3 days per week in the office Salary range: £60,000-£65,000 + benefits Purpose: Design, build, and maintain scalable data architectures, including pipelines and cloud-based data warehouses. Tech: Python (NumPy, Pandas), SQL, ETL, Cloud (AWS, Azure or … consultancy who solely specialise in the Maritime trading industry. You will work onsite with 1 specific client to design, build and maintain scalable data architectures working with key stakeholders in their business to shape their data-driven strategies. The Company: They have a long history providing … ETL Processes: Deep expertise in developing and optimising ETL pipelines. Version Control: Experience with Git for code collaboration and change tracking. Data Pipeline Tools: Proficiency with tools such as Apache Airflow. Cloud Platforms: Familiarity with AWS, Azure, Snowflake, and GCP. Visualisation: Tableau or PowerBI Delivery Tools: Familiarity more »
Posted:

Data Engineer

London, United Kingdom
Robert Half
DescriptionRobert Half have partnered with a fast growing (PE backed) organisation based in central London who are seeking a skilled Data Engineer to join their team. The ideal candidate should have 3-5 years of hands-on experience in managing and optimising data pipelines, with expertise … in the specified tech stack including Power BI, Data Factory, Databricks, SQL Server, and Oracle. The candidate will be responsible for designing, implementing, and maintaining scalable data solutions to support their upcoming projects across business intelligence and analytics.This is a 4-5 month (potential to extend … business reporting and analytics requirements.Implement data quality checks and ensure data integrity throughout the pipeline.Monitor and troubleshoot data pipeline issues and provide timely resolution.Develop and maintain Power BI dashboards and reports for data visualisation and analysis.Perform data analysis to more »
Salary: £ 70 K
Posted:

Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Anson McCade
Principal Data Engineer £80,000 - £103,000 + 15% Bonus London based - Hybrid working A consultancy at the heart of ground-breaking innovation and transformative solutions where expertise meets ambition. With a focus on collaborative brilliance shaping industries and propelling client towards their full potential whilst driving meaningful … change is seeking to add a Principal Data Engineer to the team based in London. Requirements of a Principal Data Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift … Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Proficiency in the design and deployment of production data pipelines, involving languages like Java, Python, Scala, Spark, and more »
Posted:

Staff Software Engineer (Insights)

London, England, United Kingdom
Bazaarvoice
We Want We are looking for a Staff Backend Engineer to join our Insights Back-End team to help build out data pipeline, data store and API layer of Bazaarvoice data that will power our various client-facing dashboards, raw data reporting, product performance reporting. The ideal candidate has built and operated systems that aggregate and share data sets to support new product offerings and is well experienced in evaluating the right technologies to build those data sets. Success in the role is underpinned by … a strong understanding of the business cases of the product portfolio and building relevant data sets, API layer and access methodologies that support the portfolio goals. What You’ll Be Doing Own, design, implement and support of major components of the unified back end data. Define how data more »
Posted:

Data Engineer

United Kingdom
Complexio
Complexio is Foundational AI. This works to automate business activities by ingesting whole company data – both structured and unstructured – and making sense of it. Using proprietary models and algorithms, Complexio forms a deep understanding of how humans are interacting and using it. Automation can then replicate and improve … Management, C Transport Maritime, Trans Sea Transport and BW Epic Kosan. Key Responsibilities 👥 Collaborate with cross-functional teams to design and build scalable data solutions that support product innovations and business insights. 🔨 Develop and maintain robust data pipelines that support complex data collection, ingestion … engineering or a related field. Proficient in and experience with relational databases (e.g., MySQL, PostgreSQL) as well as Strong experience with data pipeline and workflow management tools (e.g. sbt, Nifi). Familiarity with big data technologies, such as Spark. Especially when to use or not. more »
Posted:

Lead Data Engineer

London, United Kingdom
Hybrid / WFH Options
Methods Consulting
safe, and designed for the future.Our human touch sets us apart from other consultancies, system integrators and software houses - with people, technology, and data at the heart of who we are, we believe in creating value and sustainability through everything we do for our clients, staff, communities, and … public-sector, Methods is now building a significant private sector client portfolio.Methods was acquired by the Alten Group in early 2022.As a Lead Data Engineer at Methods you will be expected to get involved with projects from conception to delivery - leading and supervising other engineers to meet requirements … and deliver quality data products. On a day-to-day basis, you will own best practice for data management and data engineering - providing support to other members of the team and raising awareness across the organisation for data issues and solutions.When contributing more »
Salary: £ 70 K
Posted:

Senior Data Engineer

Scotland, United Kingdom
The Bridge Ltd
Senior Data Engineer Hybrid (flexible) Scotland £45 - 60K + 10% Bonus Are you ready to play a pivotal role as a Data Engineer in a major greenfield project? A FTSE 100 energy company, dedicated to becoming a leader in the low carbon world, is investing … them on their ambitious journey towards net zero and help create a sustainable and inclusive future for everyone. The Role: As a Senior Data Engineer, you will develop and optimise data pipelines within the Microsoft data capability stack, focusing on the new Fabric data platform. Reporting to the Lead Data Engineer, you'll be part of a dynamic team driving innovation and enhancing data-driven decision-making. Key Responsibilities: Lead the design and implementation of sophisticated data models and pipelines. Collaborate with data management more »
Employment Type: Permanent
Salary: GBP 60,000 Annual
Posted:

Senior Data Engineer

Edinburgh, Midlothian, Scotland, United Kingdom
The Bridge (IT Recruitment) Limited
Senior Data Engineer Hybrid (flexible) Scotland £45 - 60K + 10% Bonus Are you ready to play a pivotal role as a Data Engineer in a major greenfield project? A FTSE 100 energy company, dedicated to becoming a leader in the low carbon world, is investing … them on their ambitious journey towards net zero and help create a sustainable and inclusive future for everyone. The Role: As a Senior Data Engineer, you will develop and optimise data pipelines within the Microsoft data capability stack, focusing on the new Fabric data platform. Reporting to the Lead Data Engineer, you'll be part of a dynamic team driving innovation and enhancing data-driven decision-making. Key Responsibilities: Lead the design and implementation of sophisticated data models and pipelines. Collaborate with data management more »
Employment Type: Permanent
Salary: £60,000
Posted:

Head of Data - Principal Software Engineer

London, United Kingdom
JP Morgan Chase
scalable, cost-effective, and secure distributed architectures and solutions, utilizing appropriate GCP and AWS services and technologies.Lead, manage & mentor a small team of data engineers to design, develop, and implement data platforms, pipelines, and infrastructure for our multi-cloud product across GCP and AWS.Develop data pipelines: Design, implement, and maintain data pipelines that efficiently collect, process, and store large volumes of data from various sources, ensuring data quality and integrity.Continuously monitor, analyze, and optimize data pipelines to improve performance, reduce costs, and ensure reliability and … scalability.Ensure that data solutions comply with relevant data security and privacy regulations, and implement best practices for securing data at rest and in transit.Establish & govern a project wide data catalogue where we maintain the list of all data sets across more »
Salary: £ 80 K
Posted:

Senior Data Engineer

London Area, United Kingdom
Anson McCade
Data Engineer Grade: Senior Consultant – Senior Manager Location: London Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based data solutions - transforming raw data … verticals: Consumer & Manufacturing, Defence & Security, Energy & Utilities, Financial Services, Government & Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: • Design and deploy data pipelines using Java, Python, Scala, Spark, and SQL in big data architecture. • Execute tasks involving scripting, API data extraction, and … SQL queries. • Proficient in data cleaning, wrangling, visualization, and reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and more »
Posted:

Lead Data Engineer

London Area, United Kingdom
Ventula Consulting
Lead Data Engineer - Snowflake/DBT/Python - ecommerce - £95k Leading eCommerce client are now searching for a Lead Data Engineer to play a pivotal role in delivering their innovative data strategy. This role will shape our client’s data function, delivering … end to end data requirements and designing data pipelines/warehouses to ensure data is streamlined and enhances overall business success. The role: Design, develop and test an array of data migration processes to streamline the conversation from existing system to a … new Snowflake infrastructure. Manage the end-to-end data lifecycle, enabling the use of data to influence overall business decisions. Streamline our client’s data processes to ensure that customer journeys are personalised. Ensure the accuracy and reliability of data. Collaborate on business projects more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
Solirius Consulting
knowledge on which to develop their careers and progress in the direction they choose. The Role: We are looking for an experienced Senior Data Engineer to join our team here at Solirius. You will be working as part of a team, developing and delivering exciting projects with a … fantastic team of technology experts. You will be responsible for designing, developing, and maintaining data pipelines and systems that enable data analysis and machine learning. You will also collaborate with data scientists, analysts, and other stakeholders to ensure data quality and reliability. … Self motivated, enthusiastic and committed The ideal candidates will share our values and be aligned with our ways of working Key Responsibilities: Develop Data Engineering solutions for our clients/projects Design and build data models, schemas to support business requirements Develop and maintain data more »
Posted:

Data Engineer

Runcorn, Warrington, Cheshire, United Kingdom
SF Recruitment
A Data Engineer is sought to drive impactful data initiatives within a high performing organisation. The Data Engineer will spearhead data strategies and foster innovation across the operations. The organisation is a premier provider of essential products and services across Europe, dedicated … to improving quality and reliability in the sector. In this role, the data engineer will be pivotal in designing and executing solutions for the entire data lifecycle, including data acquisition, storage, modeling, transfer, hosting, visualisation, analysis, and consumption. The Data Engineer will … also be responsible for guiding and developing the skills of team members. Key Responsibilities: Architect and implement comprehensive data pipelines for efficient data acquisition, storage, processing, and interface creation. Generate both machine-readable interfaces and user-friendly data products, encompassing standard and custom reports. more »
Employment Type: Permanent
Salary: £50000/annum
Posted:

Senior Data Engineer

London Area, United Kingdom
La Fosse
Senior Data Engineer 6 month fixed term contract – 2 x a week in London £80,000 - £90,000 per annum + excellent benefits I am very excited to be partnering with a well-known fintech company! We're seeking a talented Senior Data Engineer to join … the data engineering team on a 6-month fixed-term contract, with the potential to extend but within a different department in the company. Role Overview: As a Senior Data Engineer, you'll play a pivotal role in maturing the data warehouse. You'll … collaborate closely with various stakeholders to gather business requirements and translate them into scalable data pipelines. Your expertise in Azure will be crucial in building robust infrastructure to support our data-driven initiatives. Key Responsibilities: with stakeholders to understand business requirements and translate them into technical more »
Posted:

Lead Data Engineer

London, England, United Kingdom
Aviva
Lead Data Engineer Salary - National up to £50,000, London up to £60,000 Do you love working with the latest technology and are interested in enhancing your tech abilities? We have an exciting opportunity for a highly skilled Data Engineer with significant experience of Snowflake. … As well as being an expert in the Snowflake cloud platform, you'll have a strong background in Data Ingestion and Integration, designing and implementing data pipelines on various technologies, Data Modelling and a rounded understanding of data warehousing. Aviva believes strongly … in experimentation leading to industrialisation and we are searching for passionate, energetic data engineers who are focussed on using their skills to drive out real business value for our customers. A bit about the job: An exciting opportunity within one of our Data Engineering teams for more »
Posted:

Principal Data Engineer

Preston, Penwortham, Lancashire, United Kingdom
VIQU Limited
Principal Data Engineer Northwest Up to £76,000 VIQU are seeking Principal Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a dedicated team … across numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will … include data ingestion, quality, modelling, transformation, security, and monitoring. The Principal Data Engineer will also be involved in automation, process improvement, mentoring engineers, setting coding standards, and optimising queries. The Principal Data Engineer will work in collaboration with the Principal Cloud Engineer and Data more »
Employment Type: Permanent
Salary: £60000 - £76000/annum
Posted:

Principal Data Engineer

London, United Kingdom
Hybrid / WFH Options
British Broadcasting Corporation
that we’ve got one of the widest, most diverse, and most exciting datasets to work within the UK.The role responsibilities The Principal Data Engineer is a new role that will support the newly created Product Data Domain teams. You will help to build ETL pipelines … to ingest and transform data to develop the data products that will power key value use cases across the BBC. You will work in an agile multi-disciplinary team alongside product analytics developers, product data managers, data modelers and data … that all work delivers maximum value to the BBC.Role and responsibilities will comprise of:· Leads and architects on developing robust and scalable complex data pipelines to ingest, transform, and analyse large volumes of structured and unstructured data from diverse data sources. Pipelines must be more »
Salary: £ 70 K
Posted:

Principal GCP Data Engineer

Preston, Lancashire, North West, United Kingdom
Viqu Limited
Principal GCP Data Engineer Remote Up to £85,000 VIQU are seeking Principal GCP Data Engineer to join a leading social enterprise working to transform lives by developing and managing vibrant communities. They excel in placemaking, regeneration, development, investment, property management, and leisure services. With a … numerous specialist subsidiaries, they create thriving environments and reinvest profits to enhance community projects, ensuring sustainable and flourishing communities. The successful Principal GCP Data Engineer will be responsible for ensuring robust and compliant data processes on Google Cloud Platform. The key responsibilities of the role will … include data ingestion, quality, modelling, transformation, security, and monitoring. The Principal GCP Data Engineer will also be involved in automation, process improvement, mentoring engineers, setting coding standards, and optimising queries. The Principal Data Engineer will work in collaboration with the Principal Cloud Engineer and more »
Employment Type: Permanent
Salary: £80,000
Posted:
Data Pipeline
10th Percentile
£37,000
25th Percentile
£50,000
Median
£67,500
75th Percentile
£85,000
90th Percentile
£105,000