PySpark Jobs

1 to 25 of 87 PySpark Jobs

Data Engineer

Birmingham, England, United Kingdom
Hybrid / WFH Options
Lorien
and experience of this is a strong preference. However other Cloud platFforms like AWS/GCP are acceptable.Coding - Experience using Python with data (Pandas, PySpark) would be an advantage. Other languages such as C# would be beneficial but not essential.What’s next?If you believe you have the desired more »
Posted:

Data Engineer

Birmingham, England, United Kingdom
Hybrid / WFH Options
Lorien
experience of this is a strong preference. However other Cloud platFforms like AWS/GCP are acceptable. Coding - Experience using Python with data (Pandas, PySpark) would be an advantage. Other languages such as C# would be beneficial but not essential. What’s next? If you believe you have the more »
Posted:

Data Engineer

Bournemouth, Dorset, South West, United Kingdom
Hybrid / WFH Options
LV= General Insurance
experience of writing clean, well-documented, and unit-tested python ETL processes to read, transform, and verifying data using tools such as SQL and PySpark Cloud technologies and architecture including Databricks, Kubernetes, Data/Delta Lake, Azure Machine Learning, Data Factory. Azure is preferable, but AWS and GCP experience more »
Employment Type: Permanent, Work From Home
Posted:

Data Engineer

Bristol, Avon, South West, United Kingdom
Hybrid / WFH Options
LV= General Insurance
experience of writing clean, well-documented, and unit-tested python ETL processes to read, transform, and verifying data using tools such as SQL and PySpark Cloud technologies and architecture including Databricks, Kubernetes, Data/Delta Lake, Azure Machine Learning, Data Factory. Azure is preferable, but AWS and GCP experience more »
Employment Type: Permanent, Work From Home
Posted:

Senior Data Engineer

South East London, England, United Kingdom
Venturi
candidate needs experience and confidence to speak up when several teams can be involved in delivering the project. There is a massive emphasis on Pyspark and Databricks for this particular role.Technical Skills Required:Azure (ADF, Functions, Blob Storage, Data Lake Storage, Azure Data Bricks)DatabricksSparkDelta LakeSQLPythonPySparkADLSDay To Day Responsibilities more »
Posted:

Expert IT Solution Architect - ML/AI

Dumfries, Virginia, United States
IT
in Azure Cloud technologies e.g., ML/OPS, ML Flow, Azure Data Factory, Azure Function, Data Bricks, Event Hub, Microservices/API, Python/PYSPARK/R, or SQL 2+ years of experience designing, developing, and implementing Big Data platforms using Azure Cloud architecture with structured and unstructured data more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Expert IT Solution Architect - ML/AI

Lothian, Maryland, United States
IT
in Azure Cloud technologies e.g., ML/OPS, ML Flow, Azure Data Factory, Azure Function, Data Bricks, Event Hub, Microservices/API, Python/PYSPARK/R, or SQL 2+ years of experience designing, developing, and implementing Big Data platforms using Azure Cloud architecture with structured and unstructured data more »
Employment Type: Permanent
Salary: USD Annual
Posted:

Senior Data Engineer

Teddington, London, United Kingdom
Matchtech
following technologies Azure Synapse, Data Factory, Databricks, SQL Db, Datalake, Key Vault Azure Dev Ops and CI/CD pipelines Coding in SQL and PySpark/Python DW/Data Vault concepts Power BI Experience with core Finance reporting (Projects, GL, AP, AR etc) - Highly desirable Preferred experience Knowledge more »
Employment Type: Permanent
Salary: £55000 - £60000/annum
Posted:

Data Engineer

Derby, England, United Kingdom
Mirai Talent
related field Certifications such as Azure Data Engineer Associate are desirable. Knowledge of data ingestion methods for real-time and batch processing Proficiency in PySpark and debugging Apache Spark workloads. What’s in it for you? Annual bonus scheme – up to 10% Excellent pension scheme Flexible working Enhanced family more »
Posted:

Data Scientist/Engineer - Hybrid/Bristol - Up to £60k

Bristol, United Kingdom
Hybrid / WFH Options
Adecco
the insurance domain is advantageous. - Education : A degree in Computer Science, Data Science, Engineering, or a related discipline. Technical Skills : Proficient in Python, SQL, PySpark, and Databricks. Demonstrated proficiency in modern NLP techniques and tools. Proven track record in developing and managing data quality metrics and dashboards. Experience collaborating more »
Employment Type: Permanent
Salary: £50000 - £60000/annum Competitive package
Posted:

Lead Data Engineer

London Area, United Kingdom
Tredence Inc
Azure Cloud platform Knowledge on orchestrating workloads on cloud Ability to set and lead the technical vision while balancing business drivers Strong experience with PySpark, Python programming Proficiency with APIs, containerization and orchestration is a plus Qualifications: Bachelor's and/or master’s degree About you: You are more »
Posted:

Senior Data Warehouse Engineer

West Midlands, Dudley, West Midlands (County), United Kingdom
Hybrid / WFH Options
Concept Resourcing
standardise the Data Warehouse environment and solutions. Required Skills, Knowledge, and Experience: Experience designing, developing, and testing Azure Data Factory/Fabric pipelines, including PySpark Notebooks and Dataflow Gen2 workflows. Previous experience with Informatica Power Centre is desired. Significant experience in designing, writing, editing, debugging, and testing SQL code more »
Employment Type: Permanent
Salary: £55000 - £70000/annum
Posted:

Python Developer

Glasgow, Scotland, United Kingdom
Morgan McKinley
Cycle · Solid understanding of agile methodologies such as CI/CD, Applicant Resiliency, and Security Preferred qualifications, capabilities, and skills: · Skilled with Python or PySpark · Exposure to cloud technologies (Airflow, Astronomer, Kubernetes, AWS, Spark, Kafka) · Experience with Big Data solutions or Relational DB. · Experience in Financial Service Industry is more »
Posted:

Lead Data Engineer

Leeds, England, United Kingdom
HCLTech
Lead Data Engineer: We need some strong Data engineer profiles… they need good experience with Pyspark, Python, SQL, ADF and preferably Databricks experience Job description: Building new data pipelines and optimizing data flows using the Azure cloud stack. Building data products from scratch. Support Business Analysts and Data Architects more »
Posted:

Data Models Lead - Data Engineering - MarTech

Greater London, England, United Kingdom
Mars
understand consumers. Hands-on data engineering/development experience, preferably in a cloud/big data environment Skilled in at least one of Python, PySpark, SQL or similar Experience in guiding or managing roles in insight or data functions, delivering data projects and insight to inspire action and drive more »
Posted:

Data Models Lead - Data Engineering - MarTech - Adtech

London Area, United Kingdom
Mars
understand consumers. Hands-on data engineering/development experience, preferably in a cloud/big data environment Skilled in at least one of Python, PySpark, SQL or similar Experience in guiding or managing roles in insight or data functions, delivering data projects and insight to inspire action and drive more »
Posted:

Data Engineer

City of London, London, United Kingdom
Hybrid / WFH Options
Concept Resourcing
V2, Azure Databricks, Azure Function Apps& Logic Apps, Azure Stream Analytics, Azure Resource Manager skills (Terraform, Azure Portal, Az CLI and Az PowerShell) Strong PySpark, Delta Lake, Unity Catalog and Python skills. Includes ability to write unit and integration tests in Python with unittest, pytest, etc. Strong understanding of more »
Employment Type: Contract
Rate: £500 - £600/day
Posted:

Senior Data Scientist - Hybrid/Bristol - Up to £90k

Bristol, United Kingdom
Hybrid / WFH Options
Adecco
applied machine learning, probability, statistics, and quantitative risk modelling. High proficiency in Python & SQL. Experience with big data technologies and tools, particularly Databricks and Pyspark, is highly desirable. Experience in agile software development processes is a plus. Experience in insurance, cyber, or a related domain is ideal. Understanding of more »
Employment Type: Permanent
Salary: £70000 - £90000/annum Competitive package
Posted:

Lead Data Scientist

Exeter, Devon, South West, United Kingdom
Hybrid / WFH Options
Staffworx Limited
Ability to optimise workflows and analysis for map reduce processing Experience with BI software (Power BI, Tableau, Qlik Sense) Any experience with data engineering, PySpark, Databricks, Delta Lakes beneficial Confident presenting complex problems in ways suitable to target audience Experience leading or managing a small analysis team Familiarity working more »
Employment Type: Permanent, Work From Home
Posted:

Lead Data Engineer

South East London, England, United Kingdom
Tredence Inc
cloud platformsExpertise on Azure Cloud platformKnowledge on orchestrating workloads on cloudAbility to set and lead the technical vision while balancing business driversStrong experience with PySpark, Python programmingProficiency with APIs, containerization and orchestration is a plusQualifications:Bachelor's and/or master’s degree About you:You are self-motivated more »
Posted:

Senior Technical Business Analyst

London Area, United Kingdom
InfoCepts
and industry standards for the organization. Strong experience on Azure cloud services like Azure, ADF, ADLS, Synapse Proficiency in querying languages such as SQL, Pyspark, Python and familiarity with data visualization tools (e.g. Power BI). Strong communication skills to gather the business requirements from stakeholder and propose best more »
Posted:

Date Warehouse Engineer

West Midlands, Dudley, West Midlands (County), United Kingdom
Hybrid / WFH Options
Concept Resourcing
standardise the Data Warehouse environment and solutions. Required Skills, Knowledge, and Experience: Experience designing, developing, and testing Azure Data Factory/Fabric pipelines, including PySpark Notebooks and Dataflow Gen2 workflows. Previous experience with Informatica Power Centre is desired. Significant experience in designing, writing, editing, debugging, and testing SQL code more »
Employment Type: Permanent
Salary: £55000 - £70000/annum
Posted:

Senior Data Engineer - Python

London Area, United Kingdom
Hybrid / WFH Options
Michael James Associates
can offer you exposure to the latest technologies. We are looking for a senior Data Engineer who has solid Python skills as well as Pyspark, DataBricks and SQL, as well as Data Modeling, and Azure Data Factors . Azure Devops would be a distinct advantage. Strong communication and business more »
Posted:

Senior Data Scientist (Insurance)

Surrey, England, United Kingdom
Hybrid / WFH Options
Hawksworth
that are comfortable with terms like; Statistical Models, Computer Vision, Predictive Analytics, Data Visualization, Large Language Models (LLM), NLP, AI, Machine Learning, MLOPs, Python, Pyspark, and Azure. Flexible Working : The role is 60% work from home Sponsorship : Sadly sponsorship isn't available for these roles. About You: Bachelors Degree more »
Posted:

Senior Data Engineer

London Area, United Kingdom
Hybrid / WFH Options
MBN Solutions
Quality and Information Security principles Experience with Azure, ETL Tools such as ADF and Databricks Advanced Database and SQL skills, alng with SQL, Python, Pyspark, Spark SQL Strong understanding of data model design and implementation principles Data warehousing design patterns and implementation Benefits : £50-£60k DOE Mainly home based more »
Posted:
PySpark
10th Percentile
£52,500
25th Percentile
£57,500
Median
£70,000
75th Percentile
£87,500
90th Percentile
£100,000