51 to 75 of 537 Data Engineer Jobs

Data Engineer We are seeking a Data Engineer to join our friendly team. Our client is building a new data platform centred around a Microsoft SQL server-based data warehouse that runs on AWS RDS. This role is crucial in expanding our client's … data capabilities and supporting the launch of our new platform and mobile app. Key Responsibilities: Support and maintain the central Data Platform, ensuring its availability and performance to meet business needs. Build data pipelines to connect APIs, files, databases, and data streams to our client's … Data Platforms. Shape data from various sources into a transactional ODS for detailed reporting and a Kimball-modelled Data Warehouse for analytics and dashboards. Define and embed data quality measures within data pipelines. Ensure data integrity, monitoring, and alerting are integrated into all solutions. more »

Senior Data Engineer 6 month fixed term contract – 2 x a week in London £80,000 - £90,000 per annum + excellent benefits I am very excited to be partnering with a well-known fintech company! We're seeking a talented Senior Data Engineer to join … the data engineering team on a 6-month fixed-term contract, with the potential to extend but within a different department in the company. Role Overview: As a Senior Data Engineer, you'll play a pivotal role in maturing the data warehouse. You'll collaborate closely … with various stakeholders to gather business requirements and translate them into scalable data pipelines. Your expertise in Azure will be crucial in building robust infrastructure to support our data-driven initiatives. Key Responsibilities: with stakeholders to understand business requirements and translate them into technical solutions. build, and maintain more »

Job title: Lead Data Engineer Client: Elite Fintech Salary: Up to £160,000 + Bonus Location: London/Hybrid My client are seeking a Lead Data Engineer to own delivery of scalable data pipelines that are critical to the entire firms infrastructure. Being a Lead … Data Engineer at a truly elite hedge fund, you will join an environment that prides themselves on working with the most cutting edge technologies and boast a world class technical team where you will work with and learn from the best. Responsibilities: As a Lead Data Engineer, you will engage with data scientists, software engineer's and product managers to deliver high-quality product based on very specifically tailored data requirements. Architect and implement data ingestion, transformation, and storage processes. Optimise data pipeline performance. Keep up with market developments in the more »

career growth and development opportunities in an environment that embraces your unique skills and experience. Your Role and Responsibilities We are looking for a Data Engineer to join our growing team. You will be responsible for expanding and optimizing our data, data pipeline architecture and optimizing … data flow across functional teams. The Data Engineer will work with our software developers, database architects, data analysts and data scientists on data initiatives. Responsibilities for Data Engineer: Configuring Azure Event Hubs Writing Azure Function Apps in C# Creating data pipelines … in Azure Data Factory Creating PowerBI reports and visualisations Analysing analytics business requirements to determine the data models and data flows required to deliver new dashboards and reports Creating Solution Design documents for analytics solutions Documenting Architectural Decisions that are relevant for analytics solutions Designing Extract-Transform more »

Requirements At least two years of professional experience as a data engineer with a proven ability to provide effective data solutions in a production setting. Knowledge of developing real-time data stream systems (ideally Kafka). Proven track record in developing data systems using PySpark … and Apache Spark for batch processing. Capable of managing data intake from various sources, including data streams, unstructured data, relational databases, and NoSQL databases. Extensive knowledge in distributed systems, cloud architecture, and data pipelines. Proficiency in Python programming (knowledge of Scala or Rust is a plus … . Familiarity with ETL principles in contemporary data applications (Dagster, Airflow, Perfect). Familiarity with AWS services such as Glue, Redshift, Athena, and S3. Proficiency with Terraform, Kubernetes, and ArgoCD (expertise not required; cloud team support available). Thorough understanding of software engineering techniques, including version control, continuous integration more »

Job descriptionLead Azure Data Engineer - London/Hybrid - GBP90,00005122023APNFI4_1701855804Lead Azure Data Engineer - London/Hybrid - 90,000I am working with a well-established high street retailer based who are looking for a Lead Data Engineer to join their team. In this role … you will be hands on leading on the development of the organisations Azure data platform whilst also managing the close-knit data engineering team.You will join the organisation at a significant point in their data journey and a time of significant investment in its data function. … They are looking to revolutionise the way they use data, and you will have the opportunity to implement best practice across the department. You will be responsible for designing and implementing the technical roadmap as the business look to develop their Azure Data PlatformThis is a salaried role more »

Job Title: Data Engineer Job Type: Full Time, Permanent Working location: London, Hybrid Role Purpose At Travelex we are developing modern data services, which will be at the heart of our relationship with our customers. Our data architecture is becoming more service-oriented and more real … problems for you to solve. Our work is fast-paced although our team remains collaborative and flexible even when delivering fast. Your role as data engineer has a wide remit: working with product owners, subject matter experts and managers across the company, to design and deliver new components … of our data landscape. You will have an end-to-end responsibility for your deliverables: from leading the work to agree the right approach, through coding, configuration and documentation, all the way to going live. In this process you will have significant impact on the way our business evolves more »

Data Engineer Location: London, UK Hybrid: 3x a week in office Salary: £63,000 About the Client Our client is a top-tier professional services firm known for its exceptional workplace culture and some of the most sought-after office spaces in London. Role Overview Our client is … in search of a skilled Data Engineer to manage and engineer the data warehouse. The opportunity will be amazing for a Data Engineer who is happy to work in a small team. Incredible opportunity to mentor/lead a small Data Engineering team … within a year! Main Responsibilities Build scalable data pipelines on a daily basis Code on a daily basis with Azure SQL and python Develop and maintain the logical and technical architecture to fulfil the client’s information, insights, and reporting needs. Stay informed on the latest developments in data more »

Data Engineer – Azure A fast growing and innovative company are looking for a Data Engineer to join their team. They are a people focused company, who since 2021 have won 3 best place to work awards, representing a fantastic working environment. Based in either Derby or … to the Chief Operating Officer, the candidate will play a crucial role in driving the company's digital initiatives forward. Key Responsibilities As a Data Engineer, you will play a pivotal role in supporting the delivery and evolution of the company's digital portfolio. Collaborating with a talented … team, the candidate will oversee the management and maintenance of existing data pipelines, monitor workloads, conduct root cause analysis, ensure data quality, and escalate technical issues as necessary. What you’ll be getting up to: Monitoring and recovery of Azure Data Factory and Databricks jobs Proactive monitoring more »

Data Engineer (Azure) Up to £80,000 North London office x1 day per week OVERVIEW A successful & established B2C Insurance giant are hiring for a Data Engineer to join a strong, cross-functional Data team in the UK. You will be spearheading some of their … key Data Engineering projects, working on an Azure tech stack. Proven experience using Azure Cloud Technology is essential for this role. Your responsibilities as a Data Engineer will include, but not be limited to: Spearhead Data Engineering work within the team, including ETL pipelines, CI/… CD, platform engineering. Help guide and mentor junior team members on key Data Engineering projects for the business. Engage with senior business stakeholders and communicate technical concepts and projects to non-technical audiences. YOUR SKILLS & EXPERIENCE A successful Data Engineer (Azure) will have the following. Strong proficiency more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. … This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal Data Engineer will: Identify … opportunities for automation and process improvement. Mentor and guide data engineers. Establish coding standards and best practices. Implement and document data integrity and quality checks. Optimize queries. Facilitate collaboration within the data engineering team. This role involves close collaboration with the Principal Cloud Engineer and the more »

Data Engineer – London/Hybrid – Leading Communications Consultancy – Upto £120k Salary D.o.E + The Company A highly innovative and creative communications agency is looking for an experienced Data Engineer to join their insights practice. This company are a true powerhouse within their industry. They work with … major challenges of our time through science, technology and engineering. They help them tell their story! The Role Collaborate closely with business operations and data science teams to comprehend data sources and business requirements. Develop, cleanse, enrich, and transform structured, semi-structured and unstructured data through the … implementation of data pipelines. Monitor pipeline performance, document infrastructure changes, and ensure compliance with ETL and programming best practices. Play a key role in contributing to the evolution of our data architecture and pipeline design, making valuable inputs to the global data strategy. Ensure data integrity more »

Job Title: Data Engineer Location: Edinburgh, Scotland (Hybrid) - All employees must be eligible to work without sponsorship Salary: £50,000 - £70,000 The Role: Design and develop ETL processes Design, build and maintain end-to-end data pipelines Identify, root cause analysis, and fix incidents related to … data management Manage company data, monitor accuracy and completeness, and advise ways that data quality can be improved Routinely provide status updates to colleagues and stakeholder groups Data Engineer Requirements: Hands-on experience with SQL database design Experience writing automated tests for data pipelines … Technical expertise with data models, data mining, and segmentation techniques Knowledge of programming languages (e.g. Python, R) Data Engineer Desirable's: Proven experience of Azure Services Knowledge of Data bricks and Jupyter notebooks Experience in data science and Machine learning models Azure | SQL | ETL more »

Job title: Data Engineer Client: Elite Prop Trading Firm Salary: Up to £1500 p/d Location: London/Hybrid My client are seeking a Data Engineer to own the design and implementation of data solutions, with previous expertise in data extraction, transformation, and … loading (ETL) processes from a variety of sources, including websites, PDFs, and real-time data streams. Being a Data Engineer at a truly tech driven fintech, you will join an environment that prides themselves on working with the most cutting edge technologies and boast a world class … technical team where you will work with and learn from the best. Responsibilities: As a Data Engineer, you will design, build and continuously optimise extremely scalable and performant data pipelines. Architect and implement data ingestion, transformation, and storage processes. Develop and maintain real-time data more »

Senior Data Engineer (Snowflake) London - x2 days in office a month as a rough expectation. Xcede is delighted to be recruiting a Senior Data Engineer on behalf of a market leader in the retail and e-commerce space. Our continues to invest in innovation, delivering unparalleled … millions of customers in several formats. As they continue to expand their operations and enhance their digital capabilities, they're seeking an experienced Senior Data Engineer who shares their ambition for well-structured, stable, scalable Data management systems. The Senior Data Engineer should come with … a proven track record in managing large-scale data infrastructures and pipelines that support sophisticated analytics. The ideal candidate will be responsible for designing, building, and maintaining robust data solutions that drive strategic decision-making across multiple business units. This role is for someone who principally still loves more »

before applying - Informatica IICS & IDMC proficiency is essential as well as working from their Liverpool office 2-3 days a week - rest remote* Senior Data Engineer, Data, Datamodelling, Migration, ETL, ETL Tooling (Informatica IICS & IDMC ) SQL, Python or PySpark, Agile, migrating data from on-prem to … cloud. *Informatica (IICS & IDMC) is essential* A top Reinsurance firm are looking for a Senior/Lead Data Engineer (Informatica IICS/IDMC) to work with the end to end support for acquisition, organization, integration, transformation and secure storage of mission-critical data. Essential/core experience required … 10+ years of experience and in-depth knowledge of data delivery and associated architecture principles, Datamodelling concepts, ETL procedures, and all steps of data production process Prior experience in insurance and/or reinsurance in support of specialty lines is a plus. Extensive hands on experience in SQL more »

Title: Principle Data Engineer Location: Hybrid - Once per Month Travel to office in North West. Salary: £75,000 + Package Role Overview: The Principal Data Engineer holds a key position within the Data Engineering function, reporting directly to the Head of Data & Platform Engineering. … This role requires a deep understanding of Google Cloud Platform to ensure that all production data processes are reliable, efficient, and compliant. Key responsibilities include overseeing data ingestion, quality, integrity, modeling, warehousing, transformation, security, encryption, monitoring tools, and batch management. The Principal Data Engineer will: l … Identify opportunities for automation and process improvement. l Mentor and guide data engineers. l Establish coding standards and best practices. l Implement and document data integrity and quality checks. l Optimize queries. l Facilitate collaboration within the data engineering team. l This role involves close collaboration with more »

Typically x1 day a week in the office (Thursday)Salary 90,000 - 95,000 per annumAbout the roleWhich? is currently seeking an exceptional Lead Data Engineer to take the helm in driving our innovative data strategy forward. In this role, you'll be at the forefront of … crafting and executing our data vision, operating within a dynamic Greenfield environment. The successful candidate will have the unique opportunity to form a diverse, talented team, while also spearheading the development of our data function from inception to fruition across various projects.Our forthcoming data platform represents a … significant leap forward in our organisational capabilities, enabling us to leverage data in unprecedented ways. As the Lead Data Engineer, your prowess in architecting robust data pipelines, overseeing data warehouses, and implementing sophisticated ELT processes will be pivotal in ensuring a smooth data flow more »

Your new company You will be working for a welcoming and engaging organisation which is currently going through a comprehensive data transformation programme, designed to establish a robust approach to modernising the use and management of all data, to inform decision-making and support regulatory activity. Your new … role As a data engineer, you will help build and maintain the data infrastructure and systems that collect, manage and transform raw data for onward use by data analysts and data scientists. You will implement efficient data systems that are aligned appropriately to … business goals, and will make all the organisation's data accessible to be used in support of relevant aspects of the organisation. Key responsibilities: Working to Extract, Transform and Load (ETL) data sets from a variety of data sources across the enterprise technology stack. Monitoring the execution more »

Job Purpose As a Data Engineer, you'll be at the forefront of enhancing our client's data capabilities, ensuring every bit is optimised for success. You will be collaborating closely with their visionary Data Scientists, crafting intricate data models and stunning visualisations that will … drive strategic decision-making to new heights. Your expertise in programming languages and data analysis tools will be the key to unlocking their data's full potential. Your contributions will be pivotal in driving strategic decision-making, fueling various impactful use cases. Harness your prowess in programming languages … and data analysis tools, while showcasing your formidable analytical and communication skills. Responsibilities Support the design and maintenance of data integrity checks across our client's various systems. Collaborate with the Data Scientists to understand data needs, representing key data insights in a meaningful way. more »

Playtech’s overall commitment to responsible business practices. Ready to level up your career? Playtech‘s BI Unit is looking for an expert Senior Data Engineer with excellent analytical mind set and problem-solving skills to join our Data Programme team Job Description Your influential mission. You … will... Be designing, implementing, and maintaining scalable and efficient data pipelines, ensuring data quality, and optimizing data processing performance Strength our data stack to bear the load of our ever expanding, data driven business Develop and maintain data models, ETL processes, and data warehousing solutions to support analytics, machine learning, and reporting Ensure data security and compliance with industry regulations and best practices Identify, analyse, and resolve data-related issues to improve data reliability and maintain data integrity Proactively identify opportunities for data architecture improvements and implementing more »

Introduction Axtria is a global provider of cloud software and data analytics to the Life Sciences industry. We help Life Sciences companies transform the product commercialization journey to drive sales growth and improve healthcare outcomes for patients. We are acutely aware that our work impacts millions of patients and … deploy Artificial Intelligence and Machine Learning. Our cloud-based platforms - Axtria DataMax™, Axtria InsightsMax™, Axtria SalesIQ™, and Axtria MarketingIQ™ - enable customers to efficiently manage data, leverage data science to deliver insights for sales and marketing planning and manage end-to-end commercial operations. With customers in over … legacy to be the leaders we produce for the industry. Will you be next? Job Description: We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have 5-7 years of recent experience in data engineering and hold a more »

Job Title: Technical Lead Data Engineer Location: Edinburgh, Scotland (Hybrid) - All employees must be eligible to work without sponsorship Salary: £70,000 - £85,000 The Role: Lead the Data team to deliver ETL processes, build and maintain data pipelines, enhance scalability, performance, maintainability, configurability and usability … Be involved in the entire life-cycle of the Data Strategy, including idea creation, deployment, and longer term updates and enhancements Support the product and Software Development Managers in prioritisation, scoping and leading delivery of Data Strategy features in the exciting world of Future State Architecture Manage company … data, monitor accuracy and completeness, and advise ways that data quality can be improved Able to zero-in on bugs without looking at the code Technical Lead Data Engineer Requirements: Good SQL and NoSQL experience Expert-level ability in TSQL development Integrations utilising a range of more »

Job descriptionSenior Data Engineer - AzureNFIBI21022023ALEW-b_1676974064Senior Data Engineer Are you a talented Data Engineer with Azure experience who is looking for a new and exciting opportunity to work for a growing, ambitious, innovative, expanding company? My client are putting a focus on their … It's an exciting time to join the company, as they have recently been acquired, and been given lots of investment into the BI & Data function. This role has come about as a result of growth. This is currently a team of 19 people, with half based in London … and half in Newcastle. They have 4 technical team leads who are business-aligned and then a pool of Data Engineers and Senior Data Engineers.The purpose of the this team is to support the development of a data platform so that they can provide data and more »

Data Engineer | Bristol (Hybrid) | £50,000 - £60,000 Peaple Talent have partnered exclusively with a family-owned farming and dairy company located in the heart of the picturesque Somerset countryside. With a legacy spanning over four generations, they are dedicated to producing delicious, organic dairy products while maintaining … our commitment to sustainability and environmental stewardship. Position Overview: We are seeking a talented and experienced Data Engineer with expertise in Azure to join our dynamic team. As a Data Engineer, you will play a crucial role in transforming raw data into actionable insights that … drive business decisions and enhance operational efficiency. You will work closely with cross-functional teams to design, develop, and implement robust data pipelines and solutions that support our growing data needs. Responsibilities: Build data pipelines that clean, transform, and aggregate data from disparate sources. Work closely more »