Data Engineering
UK

The following table provides summary statistics for permanent job vacancies with a requirement for Data Engineering skills. Included is a benchmarking guide to the salaries offered in vacancies that have cited Data Engineering over the 6 months to 18 May 2024 with a comparison to the same period in the previous 2 years.

6 months to
18 May 2024
Same period 2023 Same period 2022
Rank 184 129 172
Rank change year-on-year -55 +43 +85
Permanent jobs citing Data Engineering 1,592 2,727 3,958
As % of all permanent jobs advertised in the UK 1.59% 2.75% 2.46%
As % of the Processes & Methodologies category 1.87% 2.88% 2.57%
Number of salaries quoted 912 1,182 1,500
10th Percentile £41,492 £46,250 £47,500
25th Percentile £54,813 £57,500 £55,000
Median annual salary (50th Percentile) £70,000 £75,000 £75,000
Median % change year-on-year -6.67% - +15.38%
75th Percentile £88,750 £97,500 £90,000
90th Percentile £105,000 £130,000 £108,750
UK excluding London median annual salary £63,500 £60,249 £65,000
% change year-on-year +5.40% -7.31% +13.04%

All Process and Methodology Skills
UK

Data Engineering is in the Processes and Methodologies category. The following table is for comparison with the above and provides summary statistics for all permanent job vacancies with a requirement for process or methodology skills.

Permanent vacancies with a requirement for process or methodology skills 85,135 94,784 153,905
As % of all permanent jobs advertised in the UK 85.22% 95.58% 95.76%
Number of salaries quoted 59,872 55,911 82,488
10th Percentile £29,089 £34,000 £33,635
25th Percentile £40,000 £45,000 £43,750
Median annual salary (50th Percentile) £55,000 £61,180 £60,000
Median % change year-on-year -10.10% +1.97% +9.09%
75th Percentile £72,500 £81,250 £80,000
90th Percentile £92,500 £100,000 £96,250
UK excluding London median annual salary £50,000 £55,000 £52,500
% change year-on-year -9.09% +4.76% +9.38%

Data Engineering
Job Vacancy Trend

Job postings citing Data Engineering as a proportion of all IT jobs advertised.

Job vacancy trend for Data Engineering in the UK

Data Engineering
Salary Trend

3-month moving average salary quoted in jobs citing Data Engineering.

Salary trend for Data Engineering in the UK

Data Engineering
Salary Histogram

Salary distribution for jobs citing Data Engineering over the 6 months to 18 May 2024.

Salary histogram for Data Engineering in the UK

Data Engineering
Top 17 Job Locations

The table below looks at the demand and provides a guide to the median salaries quoted in IT jobs citing Data Engineering within the UK over the 6 months to 18 May 2024. The 'Rank Change' column provides an indication of the change in demand within each location based on the same 6 month period last year.

Location Rank Change
on Same Period
Last Year
Matching
Permanent
IT Job Ads
Median Salary
Past 6 Months
Median Salary
% Change
on Same Period
Last Year
Live
Jobs
England -55 1,406 £70,000 -9.68% 384
UK excluding London -34 1,041 £63,500 +5.40% 186
Work from Home -81 567 £70,000 - 190
London -66 486 £82,500 -5.71% 249
North of England -33 317 £60,000 -0.97% 35
South East +32 199 £67,500 -3.57% 73
Midlands -35 186 £58,400 +6.18% 31
North West -32 176 £54,500 +3.81% 21
South West -26 149 £75,000 +20.00% 29
Scotland -36 119 £70,000 +16.67% 7
West Midlands -39 118 £60,733 +10.42% 23
Yorkshire -32 87 £65,066 -0.44% 8
East Midlands +8 66 £45,000 -18.18% 8
North East +19 54 £75,000 +15.38% 6
East of England -49 43 £70,000 +21.74% 7
Wales -4 19 £97,500 +118.29% 5
Northern Ireland +22 9 £55,000 - 5

Data Engineering
Co-occurring Skills and Capabilities by Category

The follow tables expand on the table above by listing co-occurrences grouped by category. The same employment type, locality and period is covered with up to 20 co-occurrences shown in each of the following categories:

Application Platforms
1 175 (10.99%) Apache Spark
2 101 (6.34%) Apache
3 88 (5.53%) Apache Airflow
4 29 (1.82%) Confluence
5 25 (1.57%) SAS
6 20 (1.26%) Jupyter
7 17 (1.07%) nginx
8 3 (0.19%) Apache Pulsar
9 2 (0.13%) Luigi
9 2 (0.13%) SharePoint
Applications
1 27 (1.70%) Microsoft Excel
2 6 (0.38%) Spreadsheet
3 4 (0.25%) Microsoft Office
4 3 (0.19%) MS Visio
4 3 (0.19%) SPSS
Business Applications
1 3 (0.19%) Dynamics CRM
2 1 (0.063%) NetSuite
2 1 (0.063%) SAP ERP
Cloud Services
1 720 (45.23%) Azure
2 565 (35.49%) GCP
3 560 (35.18%) AWS
4 262 (16.46%) Power Platform
5 174 (10.93%) Azure Data Factory
6 146 (9.17%) Azure DevOps
7 138 (8.67%) Snowflake
8 131 (8.23%) Azure Synapse Analytics
9 98 (6.16%) Amazon S3
10 80 (5.03%) dbt
11 56 (3.52%) Azure Cosmos DB
12 52 (3.27%) Serverless
13 48 (3.02%) GitHub
14 37 (2.32%) AWS Lambda
15 36 (2.26%) SaaS
16 33 (2.07%) Matillion
17 29 (1.82%) Amazon EC2
18 25 (1.57%) Amazon Kinesis
19 22 (1.38%) Cloud Computing
20 18 (1.13%) GitHub Actions
Communications & Networking
1 6 (0.38%) Network Security
2 5 (0.31%) Firewall
3 3 (0.19%) VoIP
3 3 (0.19%) Wi-Fi
4 2 (0.13%) Broadband
4 2 (0.13%) LAN
4 2 (0.13%) WAN
4 2 (0.13%) Wireless
5 1 (0.063%) 3GPP
5 1 (0.063%) 5G
5 1 (0.063%) PPP
5 1 (0.063%) VPN
Database & Business Intelligence
1 573 (35.99%) Data Warehouse
2 423 (26.57%) BigQuery
3 375 (23.56%) Looker
4 260 (16.33%) Power BI
5 238 (14.95%) Data Lake
6 149 (9.36%) SQL Server
7 125 (7.85%) Big Data
8 113 (7.10%) Tableau
9 86 (5.40%) Amazon Redshift
10 75 (4.71%) Hadoop
11 68 (4.27%) SQL Server Integration Services
12 66 (4.15%) Relational Database
13 59 (3.71%) NoSQL
14 54 (3.39%) Metadata
15 50 (3.14%) Azure SQL Database
16 42 (2.64%) SQL Server Reporting Services
16 42 (2.64%) Star Schema
17 39 (2.45%) PostgreSQL
18 37 (2.32%) Elasticsearch
19 32 (2.01%) Amazon Athena
Development Applications
1 74 (4.65%) Git
2 63 (3.96%) Jenkins
3 50 (3.14%) GitLab
4 37 (2.32%) JIRA
5 17 (1.07%) Atlassian Bamboo
6 14 (0.88%) CircleCI
7 13 (0.82%) MLflow
7 13 (0.82%) Spinnaker
8 8 (0.50%) ERwin
9 6 (0.38%) Oracle Forms
10 5 (0.31%) ER Studio
11 4 (0.25%) Bitbucket
11 4 (0.25%) Snakemake
12 3 (0.19%) Deequ
12 3 (0.19%) Octopus Deploy
12 3 (0.19%) Visual Studio
13 1 (0.063%) JMeter
13 1 (0.063%) Postman
13 1 (0.063%) Selenium
13 1 (0.063%) Toad
General
1 513 (32.22%) Analytical Skills
2 293 (18.40%) Finance
3 267 (16.77%) Social Skills
4 139 (8.73%) Inclusion and Diversity
5 95 (5.97%) Law
6 81 (5.09%) Banking
7 74 (4.65%) Marketing
8 72 (4.52%) Billing
9 68 (4.27%) Retail
10 45 (2.83%) Legal
11 42 (2.64%) Presentation Skills
12 39 (2.45%) Games
13 36 (2.26%) Public Sector
14 22 (1.38%) Influencing Skills
15 12 (0.75%) Investment Banking
15 12 (0.75%) Manufacturing
15 12 (0.75%) Retail Banking
15 12 (0.75%) Telecoms
16 11 (0.69%) Front Office
17 10 (0.63%) Pharmaceutical
Job Titles
1 721 (45.29%) Data Engineer
2 268 (16.83%) Senior
3 202 (12.69%) Data Manager
4 193 (12.12%) Principal Engineer
5 182 (11.43%) Principal Data Engineer
6 176 (11.06%) Lead
7 175 (10.99%) Platform Engineer
8 171 (10.74%) Architect
9 156 (9.80%) Engineering Manager
10 153 (9.61%) Data Architect
11 138 (8.67%) Senior Data Engineer
12 81 (5.09%) Lead Data Engineer
13 80 (5.03%) Software Engineer
14 76 (4.77%) Azure Engineer
15 61 (3.83%) Developer
16 60 (3.77%) Azure Data Engineer
17 47 (2.95%) Analyst
18 44 (2.76%) Python Engineer
19 40 (2.51%) Senior Software Engineer
20 38 (2.39%) Head of Engineering
Libraries, Frameworks & Software Standards
1 134 (8.42%) PySpark
2 60 (3.77%) Kafka
3 41 (2.58%) React
4 35 (2.20%) AngularJS
5 32 (2.01%) Apache Beam
6 30 (1.88%) Pandas
7 28 (1.76%) NumPy
7 28 (1.76%) TensorFlow
8 25 (1.57%) Spring
9 22 (1.38%) .NET
9 22 (1.38%) RabbitMQ
10 21 (1.32%) ActiveMQ
10 21 (1.32%) RESTful
10 21 (1.32%) YAML
11 19 (1.19%) Apache NiFi
11 19 (1.19%) PyTorch
12 17 (1.07%) Elastic Stack
13 16 (1.01%) Web Services
14 15 (0.94%) Keras
15 14 (0.88%) REST
Miscellaneous
1 315 (19.79%) Self-Motivation
2 115 (7.22%) Product Ownership
3 85 (5.34%) Data Structures
4 79 (4.96%) Algorithms
5 76 (4.77%) Cloud Native
6 45 (2.83%) Management Information System
7 36 (2.26%) Onboarding
8 24 (1.51%) Hybrid Cloud
9 23 (1.44%) Greenfield Project
10 20 (1.26%) Reference Data
11 15 (0.94%) Client/Server
11 15 (0.94%) Distributed Systems
11 15 (0.94%) Taxonomies
12 14 (0.88%) IoT
12 14 (0.88%) NHS
12 14 (0.88%) Public Cloud
13 10 (0.63%) Mainframe
14 9 (0.57%) Data Protection Act
14 9 (0.57%) Online Games
14 9 (0.57%) Renewable Energy
Operating Systems
1 40 (2.51%) Linux
2 10 (0.63%) Windows
3 5 (0.31%) Windows Server
4 3 (0.19%) Unix
5 1 (0.063%) Red Hat Enterprise Linux
Processes & Methodologies
1 638 (40.08%) ETL
2 625 (39.26%) Agile
3 613 (38.51%) Data Modelling
4 612 (38.44%) Problem-Solving
5 556 (34.92%) Analytics
6 514 (32.29%) Data Pipeline
7 493 (30.97%) Data Science
8 453 (28.45%) Mentoring
9 448 (28.14%) DevOps
10 399 (25.06%) Platform Engineering
11 347 (21.80%) Business Intelligence
12 309 (19.41%) Data Governance
13 308 (19.35%) CI/CD
14 299 (18.78%) Machine Learning
15 269 (16.90%) Data Architecture
16 257 (16.14%) Visualisation
17 253 (15.89%) Data Integration
18 201 (12.63%) DataOps
19 190 (11.93%) Change Management
20 181 (11.37%) Artificial Intelligence
Programming Languages
1 679 (42.65%) SQL
2 634 (39.82%) Python
3 182 (11.43%) Java
4 76 (4.77%) Scala
5 63 (3.96%) T-SQL
6 51 (3.20%) R
7 37 (2.32%) C#
8 29 (1.82%) MATLAB
9 23 (1.44%) Bash
9 23 (1.44%) Go
9 23 (1.44%) Shell Script
10 21 (1.32%) Data Analysis Expressions
11 17 (1.07%) PowerShell
12 11 (0.69%) C
13 10 (0.63%) C++
13 10 (0.63%) TypeScript
13 10 (0.63%) VBA
14 9 (0.57%) Kusto Query Language
14 9 (0.57%) Ruby
15 8 (0.50%) PL/SQL
Qualifications
1 175 (10.99%) Degree
2 71 (4.46%) Security Cleared
3 66 (4.15%) Computer Science Degree
4 43 (2.70%) DV Cleared
5 41 (2.58%) DBS Check
6 36 (2.26%) Master's Degree
7 32 (2.01%) Azure Certification
8 30 (1.88%) SC Cleared
9 24 (1.51%) Microsoft Certification
10 16 (1.01%) PhD
11 8 (0.50%) PMI Certification
12 7 (0.44%) ISTQB
13 6 (0.38%) MBA
14 4 (0.25%) AWS Certification
14 4 (0.25%) OCP
14 4 (0.25%) Oracle Certification
15 3 (0.19%) AWS Certified Solutions Architect
15 3 (0.19%) PMP
16 2 (0.13%) MCP
17 1 (0.063%) MCSE
Quality Assurance & Compliance
1 371 (23.30%) Data Quality
2 298 (18.72%) GDPR
3 109 (6.85%) QA
4 24 (1.51%) Accessibility
5 10 (0.63%) California Consumer Privacy Act
6 4 (0.25%) ISO/IEC 27001
6 4 (0.25%) Solvency II
7 3 (0.19%) Actionable Recommendations
7 3 (0.19%) SLA
8 2 (0.13%) COBIT
8 2 (0.13%) Cyber Essentials
8 2 (0.13%) PCI DSS
9 1 (0.063%) NCSC
9 1 (0.063%) SNOMED CT
System Software
1 72 (4.52%) Docker
2 11 (0.69%) IAG
3 9 (0.57%) HDFS
4 2 (0.13%) Active Directory
4 2 (0.13%) Apache Flume
4 2 (0.13%) Apache ZooKeeper
4 2 (0.13%) Virtual Machines
Systems Management
1 107 (6.72%) Kubernetes
2 96 (6.03%) Terraform
3 34 (2.14%) Ansible
4 17 (1.07%) Grafana
4 17 (1.07%) HAProxy
4 17 (1.07%) Prometheus
5 7 (0.44%) SysTrack
6 5 (0.31%) logstash
7 3 (0.19%) Argo
7 3 (0.19%) Kubeflow
8 2 (0.13%) Oozie
9 1 (0.063%) Podman
9 1 (0.063%) Progress Chef
9 1 (0.063%) Puppet
Vendors
1 441 (27.70%) Google
2 236 (14.82%) Databricks
3 180 (11.31%) Microsoft
4 73 (4.59%) Oracle
5 29 (1.82%) Informatica
6 24 (1.51%) Teradata
7 19 (1.19%) Cloudera
8 10 (0.63%) SAP
9 9 (0.57%) Alteryx
10 8 (0.50%) Samsung
11 7 (0.44%) Dataiku
11 7 (0.44%) ServiceNow
11 7 (0.44%) SnapLogic
11 7 (0.44%) Snow
12 6 (0.38%) F5
13 5 (0.31%) OpenAI
14 4 (0.25%) Ab Initio
14 4 (0.25%) Dell
14 4 (0.25%) Salesforce
14 4 (0.25%) Talend