1 to 25 of 30 Contract Data Pipeline Jobs in the UK

Data Engineer £450-£550 Inside IR35 12 months Hybrid Working - 2 full days a week working in London Talent are seeking a highly skilled Data Engineer with extensive experience in ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. The … ideal candidate will have a strong background in handling big data, cloud technologies, and unstructured data, along with a deep understanding of star schema structure and hybrid data warehouse design. As a Data Engineer your key responsibilities will be: Design, develop, and … maintain robust ETL/ELT processes and data pipelines. Implement data warehousing solutions using Kimball and Inmon methodologies. Develop and manage cloud-based data solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL more »

Principal Data Engineer Job Type: Full-Time Sector: PropTech Location: Preston, Lancashire - Predominantly Remote!! (average expectation of one site visit per month) Salary: £85,000.00+ Standard benefits + Annual Bonus My well established PropTech client is looking for an experienced Principal Data Engineer to join their … team and be instrumental in transforming the way that they consume data and transitioning from On Premise to Google Cloud. This is an exciting time to join a growing business function and gain hands on experience working with market leading technology such as BIG Query, Looker, Data Flow, and more. The Data Team: The Data and Platform Engineering team are the foundation for the Data Office function. Responsible for designing, building, and maintaining their data platform, they extract data from source, transform it into a more »

and annual plan for delivering this is available on our website. Our new team are embarking on a piece of work to monitor data to identify and respond to patterns indicative of potential fraud. This will support our current work that reduces the likelihood of fraud occurring. We … will bring in data science capabilities to be deployed in counter fraud activity and work closely with partners across health and government to further maximise the preventative impact of proactive counter fraud analysis. We will combine this with our range of counter fraud and domain expertise to maximise … Utilise expertise in data management, analytics and stakeholder engagement and management to facilitate and secure datasets and/or data pipeline partnerships across the NHS. Actively work with project managers, functions and workstreams to define detailed and problem centric data requirements for delivery more »

Senior Developer (Data & Analytics) £450-£550 Inside IR35 12 months Hybrid Working - 2 full days a week working in London Talent are seeking a highly skilled Senior Developer with extensive experience in ETL/ELT processes, data warehousing/business intelligence methodologies, and best practices. The … ideal candidate will have a strong background in handling big data, cloud technologies, and unstructured data, along with a deep understanding of star schema structure and hybrid data warehouse design. As a Developer your key responsibilities will be: Design, develop, and maintain robust ETL …/ELT processes and data pipelines. Implement data warehousing solutions using Kimball and Inmon methodologies. Develop and manage cloud-based data solutions using Azure services such as Data Factory, Event Hubs, Data Lake, Synapse, and Azure SQL Server. Create and more »

Senior Databricks Migration Consultant Remote This role demands in-depth knowledge of data engineering, cloud technologies (preferably AWS), and a successful record in enterprise level data migrations into Databricks. You will ensure the efficient and secure transition of our data assets to the Databricks … Lakehouse Platform, working closely with our external vendors. You will - Analyze data requirements, migration impacts, and project dependencies. - Develop detailed data migration strategies, including architectural plans, data quality evaluations, testing, and creating robust data pipelines and workflows for Databricks best practices. - Maintain … data integrity, security, and compliance with regulations like GDPR. - Manage data migration from legacy analytics data warehouses, data lakes, and ETL tools to Databricks within set deadlines. - Comfortable operating in all project phases, adjusting requirements, and supporting the transition from build and more »

Job Role: Principal Data Engineer Job Type: Contract IR35 : Inside IR35 Day Rate: £600/Day Contract Duration: 6 months Working Hours: 5 days per week Remote Working : 4 days remote working. 1 day on-site in London Location: Hybrid Remote/London (UK only) Reference : BH-299c … Role Overview: We are seeking an experienced Principal Data Engineer to join our client's team. You will lead the Data Engineering Acceleration initiative, designing, building, and transitioning a robust data management system that optimises data lifecycle management. Key Responsibilities: A cross … discipline professional who can collaborate with multiple teams, such as DataOps, Data Analytics, Software Development teams, to design solutions with them Provide expert advice and support in designing efficient processes for data discovery, profiling, quality, encryption, and pipelines. Document compliance, security, and data sovereignty more »

Dive into a pivotal role leading data management and analytics transformation. We're on the hunt for an SC Cleared Azure Data Lead with a knack for innovation and a comprehensive skill set: MUST HAVE ACTIVE SC CLEARANCE Key Responsibilities Oversee the evolution of the data platform, encompassing data pipelines, storage, and processing. Establish and nurture robust relationships with stakeholders to guarantee a positive user experience and to identify any potential opportunities for additional services or products. Play a key role in the formulation and execution of the data management … record in the development and management of an Azure cloud-based data & analytics platform. Comprehensive experience in the complete data pipeline development process, encompassing data warehousing, data analytics, and ETL processes. Profound understanding of best practices in data governance more »

Specialist/Architect to join our team. The ideal candidate will possess extensive knowledge and hands-on experience with Palantir Foundry, including its data integration, analytics, and operational decision-making capabilities. As a Palantir Foundry Specialist/Architect, you will be responsible for designing, developing, and maintaining data … driven solutions that leverage Palantir Foundry's platform to address complex business challenges. Key Responsibilities: *Solution Architecture:* - Design and architect end-to-end data solutions using Palantir Foundry, ensuring alignment with business goals and technical requirements. - Develop scalable and efficient data models, pipelines, and workflows within … the Foundry environment. - Collaborate with stakeholders to understand business needs and translate them into technical requirements and solutions. *Data Integration:* - Implement data integration solutions to ingest, transform, and manage large datasets from various sources into Palantir Foundry. - Ensure data quality, consistency, and security throughout more »

About the Role: I am looking for a talented Data Engineer to join our clients dynamic team on a 6-month contract basis. This is an exciting opportunity for a mid-level professional with 3-5 years of experience to make a significant impact on our data …/hybrid working options and a competitive day rate of £250-£400, falling inside IR35 regulations. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using AWS, Databricks, Python, Spark, and SQL. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions. Optimize and troubleshoot data workflows to ensure efficiency and reliability. Implement data quality and validation checks to ensure data integrity. Contribute to the development and maintenance of our data lake and more »

consultancy client. The successful candidate will be responsible for designing, developing, and maintaining KDB databases, as well as creating and optimizing Real Time data analytics solutions. You will work closely with the technology team to enhance our data management systems, ensure data accuracy and … integrity, and help us make data-driven decisions. Key Responsibilities: Design and develop KDB databases and data processing systems to support Real Time data analysis and reporting. Optimize database performance, troubleshoot issues, and implement improvements as needed. Collaborate with data analysts and … other teams to understand data requirements and develop efficient data retrieval processes. Write and maintain KDB Q scripts, ensuring code is well-documented and follows best practices. Monitor data quality and accuracy, implementing data validation and cleansing processes. Develop and maintain data more »

Senior Data Engineer (Databricks) – Remote - 6 Months Contract (Initial) – Outside IR35 VIQU are seeking 4 Senior Data engineers (Databricks) on a contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses and consolidating/centralising a number of BI tools. Senior Data Engineers should have extensive experience working with Databricks on recent projects and be exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. … Implement data processing workflows in Python and SQL. Manage and optimise data storage solutions on AWS. Ensure data quality and integrity across all stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta more »

Senior Data Engineer (Databricks) – Remote – Leeds - 6 Months Contract (Initial) – Outside IR35 We are seeking 4 Senior Data engineers (Databricks) on a contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses and consolidating/centralising a number of BI tools. Senior Data Engineers should have extensive experience working with Databricks on recent projects and be exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. … Implement data processing workflows in Python and SQL. Manage and optimise data storage solutions on AWS. Ensure data quality and integrity across all stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta more »

Position: Software Engineer - Data & AWS We are seeking a Software Engineer to build and optimize data platforms leveraging AWS and key technologies like CDAP, Snowflake, and Databricks. You will design and implement robust and scalable data pipelines, ETL, and analytics systems in the cloud. … Responsibilities: Develop and enhance data pipelines, ETL processes using CDAP on AWS infrastructure. Build data integration flows to migrate large datasets into Snowflake data warehouse. Implement AWS infrastructure-as-code solutions for deployment automation. Instrument data pipelines and leverage monitoring for performance … tuning and reliability. Work with data scientists to optimize data workflows and models on Databricks. Follow security best practices for access control, encryption, and auditing across data platforms. Participate in architecture reviews and technology selections. Continuously monitor and improve data platforms for more »

Data Scientist - Lead Generation & Prospecting Contract Role - Inside IR35 via umbrella Our client, a London based Financial Services/Payements Solutions provider is seeking a Data Scientist to join the team on contract with experience within new business/prospecting - Please only aply if you have … demonstrable experience in these areas. Responsibilities: Utilise advanced data analytics and machine learning techniques to identify high-value prospects and generate leads in the payments industry. Design and implement propensity models to predict potential client engagement and conversion rates, optimising our prospecting strategies. Analyse transactional and financial data … or Master's degree in Statistics, Mathematics, Computer Science, Finance, or a related field. Experience working with Salesforce from a data/pipeline management perspective along with Snowflake Data Connectors a plus. If you are a results-oriented Data Scientist with a passion more »

contract basis to assist our client as they migrate over from legacy to AWS. The main focus will be to centralise the organisations data warehouses and consolidating/centralising a number of BI tools. Databricks Engineers should have extensive experience working with Databricks on recent projects and be … exposed to the latest features and toolsets of Databricks Role Responsibilities: Design and develop scalable data pipelines using Databricks. Implement data processing workflows in Python and SQL. Manage and optimise data storage solutions on AWS. Ensure data quality and integrity across all … stages of data processing. Develop and maintain documentation for data engineering processes. Utilise Databricks features, including Delta Live Tables (DLT) to simplify streaming and ensure data quality. Work with asset bundles in Databricks for streamlined data operations. Key Skills: Proven experience as more »

troubleshooting of the SOC's technology stack (hardware and software). The engineer will also assist with the continued development and maintenance of data pipelines and signature updates and the professional development of the system engineering team. Tasks: Perform system administration on specific cyber defence applications and systems … network tools in response to new or observed threats within the network environment or enclave. Manage the compilation, cataloguing, distribution, and retrieval of data from a range of enterprise networks and data sources. Implement data management standards, requirements, and specifications. Develop data standards, policies, and procedures. Analyse data sources to provide actionable recommendations and facilitate data-gathering methods. To share knowledge, skills and experience, create and improve documentation, and train new members of the data engineering team Knowledge: Knowledge of big data more »

troubleshooting of the SOC's technology stack (hardware and software). The engineer will also assist with the continued development and maintenance of data pipelines and signature updates and the professional development of the system engineering team. Tasks: * Perform system administration on specific cyber defence applications and systems … network tools in response to new or observed threats within the network environment or enclave. * Manage the compilation, cataloguing, distribution, and retrieval of data from a range of enterprise networks and data sources. * Implement data management standards, requirements, and specifications. * Develop data standards, policies, and procedures. * Analyse data sources to provide actionable recommendations and facilitate data-gathering methods. * To share knowledge, skills and experience, create and improve documentation, and train new members of the data engineering team. Knowledge: * Knowledge of big data more »

troubleshooting of the SOC's technology stack (hardware and software). The engineer will also assist with the continued development and maintenance of data pipelines and signature updates and the professional development of the system engineering team. Tasks: Perform system administration on specific cyber defence applications and systems … network tools in response to new or observed threats within the network environment or enclave. Manage the compilation, cataloguing, distribution, and retrieval of data from a range of enterprise networks and data sources. Implement data management standards, requirements, and specifications. Develop data standards, policies, and procedures. Analyse data sources to provide actionable recommendations and facilitate data-gathering methods. To share knowledge, skills and experience, create and improve documentation, and train new members of the data engineering team. Knowledge: Knowledge of big data more »

Senior Data Engineer - 6 Months - Remote with Ad hoc travel The Senior Data Engineer will be responsible for the development of Data Pipelines and an Analytics Platform, maintain and extend our Data Model as we grow, and implement Data Governance … principles. The role will collaborate with the team of data scientists and be critical to achieving additional value through innovative modelling. Experience: Experience of Advanced analytics tool stack and developing pipelines from different data sources- API especially. Experience of Databricks is fundamental, working with data scientists and other stakeholders to develop sophisticated analytical solutions. Must have experience in setting up the data pipelines (ELT) from complex API's using Python/PySpark in Data bricks/ADF ersg are an equal opportunities employer; we are committed to promoting equality more »

ML systems, CI/CD and data pipelines. Participate in enterprise-wide architecture initiatives for AI/ML. Understand the workflow and pipeline architectures of ML and deep learning workloads. Conduct security risk assessments and threat modeling for AI/ML and other business projects performed thorough … models, LLM and development of trustworthiness, safety, fairness, bias and inappropriateness detection, as well as adversarial test specification, development, and execution. Collaborate with data scientists, engineers, and other stakeholders to embed security controls and measures into AI/ML applications, models, algorithms, and data pipelines. Define … and enforce robust access controls, authentication mechanisms, and encryption standards to safeguard AI/ML systems, training data, provenance, and any sensitive data. Stay abreast of emerging AI security threats, trends, and technologies, evaluating their impact and proactively adapting security measures to mitigate potential risks. Provide technical guidance more »

Azure Data Engineer- Birmingham - £500pd Outside I'm currently looking for a Data Engineer to join a company that is based in Birmingham. They need someone to start in the next few weeks. Location: Birmingham (on site 2 times a week) Length: 6 months Day Rate … per day. IR35 Status: Outside of IR35 Required experience will include: Expertise in designing and implementing data pipelines using Azure services such as Azure Data Factory and Azure Databricks. Hands-on experience with SQL database design Experience of product lifecycle management principles and tools (e.g. DevOps … terraform ) and relational database manipulation and interrogation. Experience working with Power BI If you are interested in this Data Engineer role please apply with your most recent CV. Alternatively email me on George . batson @ Randstad . co . uk Azure Data Engineer- Birmingham - £500pd Outside more »

a Senior Go Lang Developer. Job Responsibilities/Objectives - Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. … Extensive ETL and Data warehousing experience - Strong experience in GoLang programming - Google Cloud Services and BigQuery Required Skills/Experience - Assess, analyse, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application ) - Understand and provide inputs for STT documents. - Design and develop the data pipelines more »

a Senior Go Lang Developer. Job Responsibilities/Objectives - Strong programming skills on GoLang with experience on building APIs and having knowledge on Data warehousing/ETL who can design and develop the data pipelines for Group data consolidation platform built on Google Cloud. … Extensive ETL and Data warehousing experience - Strong experience in GoLang programming - Google Cloud Services and BigQuery Required Skills/Experience - Assess, analyze, data ingestion, transformation & storage layers (RAW, Exploratory, Curated .application) - Understand and provide inputs for STT documents. - Design and develop the data pipelines more »

Azure Data Engineer- Birmingham - £350pd Outside I'm currently looking for a Data Engineer to join a company that is based in Birmingham. They need someone to start in the next few weeks. Location: Birmingham (on site 2 times a week) Length: 6 months Day Rate … per day. IR35 Status: Outside of IR35 Required experience will include: Expertise in designing and implementing data pipelines using Azure services such as Azure Data Factory and Azure Databricks. Hands-on experience with SQL database design Experience of product lifecycle management principles and tools (e.g. DevOps … terraform ) and relational database manipulation and interrogation. If you are interested in this Data Engineer role please apply with your most recent CV. Alternatively email me on George . batson @ Randstad . co . uk Azure Data Engineer- Birmingham - £350pd Outside Randstad Technologies is acting as more »

Data Analyst - Spotfire, PowerBI, Mendix, RShiny, Java, SQL, Python - 100% Remote A large global organisation are in need of Data Analysts to join the team to assist with a backlog of digital solutions which need to be built. These include dashboards, Low-code applications and simple … data manipulation pipelines. This will be an initial 6 months contract with the opportunity for extensions. The position can be worked 100% remotely. Key responsibilities: Ability to scope, assess and develop dashboards Proven experience with Low-code applications Data Manipulation Qualification of Data Pipelines … Exposure to High-code applications and industrialised solutions Technical Skills required: Spotfire PowerBI Mendix RShiny Java SQL Python R Data Analyst - Spotfire, PowerBI, Mendix, RShiny, Java, SQL, Python - 100% Remote more »