76 to 100 of 492 Data Engineer Jobs

Senior Data Engineer Location: London (2 days a week in office) Salary: £75k - £90k (DOE) About the Company: Our client, a leading technology-driven organization, is seeking a talented and experienced Senior Data Engineer to join their dynamic team. The company prides itself on fostering innovation … cutting-edge technology to drive business success. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions. Key Responsibilities: • Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and integration … across various systems. • Utilize Python for data manipulation, transformation, and automation tasks. • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions. • Implement data pipelines and workflows to support real-time and batch data processing. • Optimize database performance more »

Lead Data Engineer (Contract/ASAP Start) Location| Workplace policy: Fully Remote (Must be based in the UK without visa/sponsorship requirements ) Day Rate: up to £600 (outside IR35) Contract Length: 6-month term initially An exciting market-leading tech-savvy organization that works directly alongside some … of the biggest brands in the retail sector is seeking a contract Lead Data Engineer with hands-on experience working directly with C-Suite execs. Technical Expertise Needed At least 4 years recent Databricks (must have) At least 10+ years experience in a Lead Data Engineer Educated to degree level in a QS top 100 university Proven experience delivering scalable data pipelines PySpark SQLDevOps/DataOps/CICD Expertise in designing, constructing, administering, and maintaining data warehouses and data lakes Data Modelling/Data Architecture Data Migration Programmes With more »

Lead Data Engineer Location: London Salary: £90k - £105k (DOE) About the Company: Our client, a leading technology-driven organization, is seeking a talented and experienced Lead Data Engineer to join their dynamic team. The company prides itself on fostering innovation and utilizing cutting-edge technology to … drive business success. This is a fantastic opportunity to work with a team of experts who are passionate about harnessing data to create impactful solutions. Key Responsibilities: Design, develop, and maintain robust ETL (Extract, Transform, Load) processes to ensure efficient data flow and integration across various systems. Utilize … Python for data manipulation, transformation, and automation tasks. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions. Implement data pipelines and workflows to support real-time and batch data processing. Optimize database performance, including tuning queries and more »

Data Engineer Our client based near Manchester is looking for a skilled Data Engineer to join their agile team. In this role, you'll play a pivotal part in designing, building, and maintaining data pipelines, ensuring the integrity and availability of data for various … stakeholders, including BI Teams, Analytics, and Data Scientists. Responsibilities: Design, build, and automate data flow processes and ELTs to provide comprehensive data from business systems. Collaborate with product development teams to ensure best practices and data integrity from source to destination. Assist in integrating data between systems, including third-party platforms. Write specifications and documentation for data processes. Continuously explore new solutions, tools, and processes to enhance data operations. Requirements: Bachelor's or Master's degree in Computer Science, related field, or equivalent commercial experience. Proficiency in ETL/ELT processes and more »

Job Description for Data Engineer Work Location: London/Birmingham, UK Looking for a Data Engineers to analyse large amounts of raw information to find patterns and data migration that will help improve business goals. We will rely on you to build data products to … valuable business insights. Your goal will be to help our company analyse trends to make better decision. Roles and Responsibilities:  Analyse and organize raw data  Build data systems, pipelines, and data products.  Evaluate business needs and objectives  Interpret trends and patterns  Conduct complex data analysis and … report on results  Prepare data for prescriptive and predictive modelling  Build algorithms and prototypes  Combine raw information from different sources  Explore ways to enhance data quality and reliability  Identify opportunities for data acquisition  Develop analytical tools and programs  Collaborate with data scientists and architects on several more »

Your new company A high-Profile Emergency Organisation based in London Your new role Data Engineer - NPPV3 Cleared What you'll need to succeed Our client is looking for an experienced Data Engineer to join the Data Analytics Platform Project team. The successful candidate will … be detail-oriented, with excellentOrganisational skills and experience as a Data Engineer for Analytics Platforms. Successful candidates will need to hold a valid and active Warwickshire NPPV3 clearance. Requirements: Previous experience as a data engineer, ideally in the policing sector or similar Technical expertise with data models, data mining, and segmentation techniques Experience of Architecting and implementing Azure Services e.g. Azure cloud services, Azure storage, IIS, Azure Active Directory (AD), Azure Resource Manager (ARM), Azure Storage, Azure, Blob Storage, Azure VMs, SQL Database, Azure Functions, Azure Service Fabric, Azure Monitor, and Azure Service Bus more »

Are you passionate about leveraging cutting-edge data technologies to drive business success? Do you thrive in dynamic environments where innovation and collaboration are valued? If so, we have an exciting opportunity for you! Position: Lead Data Engineer Responsibilities: Lead Data Management and Architecture: Spearhead the … design and implementation of robust data solutions across the organization, ensuring scalability and efficiency. Next Gen Data Platform Leadership: Act as the primary data engineer supporting the development of our next-generation data platform, collaborating closely with third-party vendors to build a highly scalable … and robust data hub. Develop and Optimize Data Pipelines: Design, construct, install, test, and maintain highly scalable data management systems, ensuring they meet business requirements and industry best practices. Data Integration and Storage Solutions: Implement data storage solutions and manage large-scale processing systems, overseeing more »

Job Title: Junior Data Engineer Location : London (Anywhere in UK) Pay Rate : £150/Day We are looking to hire a Junior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and architectures on AWS. You will work closely with … senior data engineers, data scientists, and other stakeholders to ensure data is accessible, reliable, and ready for analysis. Key Responsibilities: Data Pipeline Development : Design, build, and maintain data pipelines to ingest, transform, and load data from various sources into AWS data storage solutions. … Data Integration : Implement ETL (Extract, Transform, Load) processes using AWS services such as AWS Glue, AWS Lambda, and AWS Data Pipeline. Data Storage Management : Manage and optimize data storage solutions, including Amazon S3, Amazon Redshift, and AWS RDS. Data Quality and Validation : Ensure data more »

not afraid to speak our minds to help steer our customers towards understanding and achieving their key goals. We are looking for a Lead Data Consultant to help us grow and on our journey of taking OC to the next level. Your experience as a data focused technologist … strategise, and deal with the ingestion, processing, integration and ability to get insights out of their data. What you’ll spend your time on: Data Strategy & Architecture: Help customers make sense of, and understand their data in the context of what their business is trying to achieve. Create … data models and articulate the tradeoffs around different data approaches. Design and Architect complex data platforms and solutions across a variety of different scenarios. Leadership & Consulting: Provide technical leadership and guidance for our customers and your fellow team-mates in the area of data and data more »

Data Engineer - Manchester - £35,000 - Hybrid Working My client is hiring a full time Data Engineer to contribute to their expanding data science and analytics initiatives. Your role involves designing, building, and maintaining data pipelines, ensuring seamless data flow into their central Microsoft … Azure repository. Collaborate with Data Analysts and Scientists to optimise data quality, reliability, security, and automation. Skills & Responsibilities: Configure and troubleshoot Microsoft Azure, manage data ingestion Develop ETL scripts using Python, handle web scraping, APIs, and relational databases Familiarity with Power BI (you will not have to … use Power BI, but being aware of how to collaborate with people that do is important) Work closely with data analysts and scientists, contribute to data models and algorithms, and participate in data events Working knowledge of Git If you have the required skills and experience and more »

Role – Lead Data Engineer Skills – Leadership/Python/Any Cloud Location – Manchester Work Pattern – Once every 2 weeks in the office Salary – up to £80,000 plus benefits package including a significant Bonus. The Company We are looking for Data Engineer to join a very … well-established company and data team. They have a huge amount of data, it’s one of the strategic pillars of the company and they are heavily investing in a new system, which will be a vast improvement. This role will focus on exploring solutions to maintain, improve … and scale their use of data. They do an awful lot with data, it’s a huge asset to the business and they have a large number of people who have access to their data systems for analytical and insight purposes. The Role This is an amazing opportunity more »

Data Engineer - Leading Pharmaceutical Company - Exeter (Tech Stack: Data Engineer, Databricks, Python, Power BI, TSQL, ETL, Agile Methodologies, Refactoring) Are you a talented Data Engineer looking for a new challenge? Our client, a leading pharmaceutical company based in Exeter, is seeking a dedicated and … skilled Data Engineer to join their innovative team. This role offers the flexibility of remote work, with the requirement to be in the office just once a month. Key Responsibilities: Develop and maintain advanced data pipelines using Databricks. Implement and manage rigorous testing processes. Utilise Python for … data manipulation and automation tasks. Create dynamic reports and visualisations with Power BI. Optimise and manage databases using TSQL. Handle complex ETL processes efficiently. Collaborate within Agile frameworks to enhance project delivery. Refactor code to improve performance and maintainability. Essential Skills: Strong proficiency in Databricks. In-depth knowledge of more »

Data Engineer - Leading Pharmaceutical Company - Bristol (Tech Stack: Data Engineer, Databricks, Python, Power BI, TSQL, ETL, Agile Methodologies, Refactoring) Are you a talented Data Engineer looking for a new challenge? Our client, a leading pharmaceutical company based in Bristol, is seeking a dedicated and … skilled Data Engineer to join their innovative team. This role offers the flexibility of remote work, with the requirement to be in the office just once a month. Key Responsibilities: Develop and maintain advanced data pipelines using Databricks. Implement and manage rigorous testing processes. Utilise Python for … data manipulation and automation tasks. Create dynamic reports and visualisations with Power BI. Optimise and manage databases using TSQL. Handle complex ETL processes efficiently. Collaborate within Agile frameworks to enhance project delivery. Refactor code to improve performance and maintainability. Essential Skills: Strong proficiency in Databricks. In-depth knowledge of more »

employees, they are always looking to adapt to technological changes to stay at the forefront of the industry About the Role: As a Principal Data Engineer, you’ll play a pivotal role to help drive the adoption of Microsoft Power platform and streamline reporting and analytics processes across … the organisation, we are looking for a Data Engineer with extensive multi-cloud data engineering experience and in-depth understanding of end-to-end development and deployment processes. Whilst this is a data engineer role, the focus is on data analytics and migrating from … Tableau to Power BI. Experience/skills required: Proficient in data analysis, data modelling and designing ETL processes. Familiar with Data Mesh architecture and Data Products Highly skilled in T-SQL with experience in performance tuning and dealing with large data volumes Extensive experience of more »

Data Engineer - Frimley/Preston - Permanent I am currently recruiting for a Data Engineer to join a leading Aerospace and Defence organisation, you will be working in a rapidly expanding team whose aim is to work with all areas of the business to embed MDM within … Activities working directly with Customers to understand their requirements & data. Development activities to support the embedding of MDM. Activities to support the development of data governance/data quality practices in support of MDM & other Data services. Activities supporting the operation of MDM tools, providing advice & training … with customers on MDM projects to understand their requirements. Experience of communicating complex technical processes to customers in an understandable way. Experience of building data services including aspects of creating design specifications, data modelling/conditioning/integration, improving data quality, data governance, testing and deployment more »

Im currently working with a forward-thinking financial services company who are looking for a Data Engineer to join their team on a hybrid basis (3 days per week on-site) in central Manchester. Offering up to £50K, this is an excellent opportunity for an innovative and enthusiastic … data engineer to join a close-knit team and work with the latest technology! The company itself is a specialist financial services provider who hold good customer service as a core value. Culturally, they strive to continuously push the limits technically and provide the opportunity to upskill and … learn on the job. The data team itself is close-knit and has a collaborative attitude and outlook to their work. As a Data Engineer, you will work closely with the team lead to enable the most effective data driven decisions in order to carry out more »

understanding of how people think, feel and act; globally and locally in over 90 markets. By combining the deep expertise of our people, our data resources and benchmarks and our innovative analytics and technology, we help our clients understand people and encourage growth. Backed by industry-leading anti-fraud … more than 100 markets worldwide. Our clients include many of leading brands, who trust us to collect reliable insights. Join Kantar Profiles as a Data Engineer, where your technical expertise and collaborative spirit will contribute to the success of our data-driven initiatives. Apply now and be … part of a team that is shaping the future of data analytics at Kantar Profiles. Job Summary As a Data Engineer at Kantar Profiles, you play a crucial role in the development and maintenance of robust data pipelines, facilitating seamless access to data for our more »

We are seeking an experienced Python Data Engineer Consultant to join a leading hedge fund. The ideal candidate should have a proven ability to design and implement data solutions, with expertise in extracting, transforming, and loading (ETL) data from various sources, including websites, PDFs, and Real … Time data streams. Role: Python Data Engineer Client: Leading Hedge Fund Type of role: contract (6 months) Location: London office Rate: up to £1500/day Key Responsibilities: Architect, develop, and optimize data pipelines for extracting, transforming, and loading data from diverse alternative data sources, such as web scrapes, PDF files, and Real Time data infrastructures. Implement and manage database solutions in SQL Server and various cloud-based environments, ensuring data integrity, efficiency, and accessibility. Build and maintain Real Time data processing systems capable of handling large volumes of data more »

A global leading commodities trading firm have partnered with Referment to find a skilled Data Engineer to join their London team on a contract basis. This organisation has some exciting Greenfield projects focussed on modernisation of data warehouse, data lakes and data streaming services. This … is critical role, which will require designing, implementing, and enhancing data solutions to support the businesses trading operations. This role will involve building out data pipelines, ETL processes and data warehouses and will require a well-rounded data engineer with deep experience in Python and … other OO languages like Java. Delivery is vital within this role so experience in scaling up data systems using the best data engineering processes is required. Due to the nature of commodities trading, there is exciting problems to solve from data storage, reporting analytics and processing data more »

Our client is a successful financial services provider offering an exciting opportunity for a Data Engineer who will have the chance to work with new technology and delve deep into data. The Data Engineer will work closely with IT, Finance and Operations to deliver the business … reporting requirements within a timely and consistent manner. They are required to develop and provide trusted data on performance, financial positions to aid decision making across the business. They also to provide tactical information to end users to support process. The role is offered on a hybrid basis, but … you should live within commutable distance of Wimborne, Dorset. Responsibilities of the Data Engineer Manage presentational reporting to support decision making Automate the collection of disparate data sources to Data Lakes and Data Warehouses Work across all functions to test and produce reporting solutions Publish more »

Data Engineer Grade: Senior Consultant – Senior Manager Location: London Employment Type: Full Time The Opportunity: A Tier One Technology Consultancy seeks a highly ambitious and technically astute AWS Data Engineer to help design, build and deploy cloud-based data solutions - transforming raw data into … industry verticals: Consumer & Manufacturing, Defence & Security, Energy & Utilities, Financial Services, Government & Public Services, Healthcare, Life Sciences, and Transport. Essential Skills & Experience: • Design and deploy data pipelines using Java, Python, Scala, Spark, and SQL in big data architecture. • Execute tasks involving scripting, API data extraction, and SQL queries. … Proficient in data cleaning, wrangling, visualization, and reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and unstructured data on AWS. more »

Data Engineer (6-Month Contract) - £450 per day inside IR35 – Birmingham/Hybrid We are recruiting on behalf of a leading company dedicated to innovative solutions in waste management. As part of our ongoing commitment to excellence, we are currently seeking a skilled Data Engineer to … join our Commercial Waste programme on a 6-month contract basis. Role Overview We are looking for a talented Data Engineer to support enterprise data platforms and warehouses in Azure. You will play a crucial role in gathering detailed requirements from business sponsors/owners and executing … data ingestion and modelling tasks. Experience in producing Power BI reports is desirable but not essential. Key Responsibilities Collaborate with business sponsors/owners to understand and document detailed requirements. Design, develop, and maintain data pipelines using Azure Data Factory and Azure Databricks. Implement and manage SQL more »

Lead Azure Data Engineer | PySpark (Python) & Synapse | Tech for Good/Charity Essential skills required: Azure – solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You will be tested on PySpark Azure Synapse - ESSENTIAL as is used heavily Spark Azure Data Lake/Data Bricks/Data Factory Be happy to act as a lead and mentor to the other permanent Azure Data Engineers This is the chance to work for a unique organisation! Our client is a not-for-profit charity that reviews/certifies companies … circa in the UK). You will be reporting to the CTO who manages the tech team of circa 30 people comprising developers, data engineers, QA and DevOps. Essential skills required: Azure – solid experience required of the Azure Data ecosystem Python - ESSENTIAL as PySpark is used heavily. You more »

Senior Data Engineer - SQL/SSIS Frimley - (Hybrid - 2 days in office p/w min) £40,000 - £48,000 + bonus The Master Data Management team (MDM) team is a rapidly expanding team whose aim is to work with all areas of the business to embed … communication skills as foundations for the technical skills which are key to the development of our product line. What you'll be doing - Senior Data Engineer - SQL Activities working directly with Customers to understand their requirements & data Development activities to support the embedding of MDM Activities to … support the development of data governance/data quality practices in support of MDM & other Data services Activities supporting the operation of MDM tools, providing advice & training as required Experience we are looking for could include - Senior Data Engineer - SQL Recent experience of working with more »

The role: In this role, you will play a lead role in the conception, planning, and execution of Brompton Bicycle's data infrastructure. You will be working directly with diverse data sets from multiple systems, orchestrating their seamless integration and optimisation to enable our business to derive valuable … insights. This process will encompass everything from the raw development of data pipelines to the management and optimisation of these pipelines using all tools available in the Azure Cloud. A significant aspect of your role will be the migration of our existing on-premises databases to the Azure Cloud … a complex project requiring a deep understanding of cloud architecture and database management, as well as change management, ensuring the continuation of data as a product to your stakeholders through a smooth data infrastructure transition As a vital part of our team, you will collaborate with diverse departments more »