101 to 125 of 238 Data Lake Jobs in the UK

Data Platform Engineer - London/Hybrid - £70,000 FTC I am currently working with a well-established, global organisation within the education sector who are looking for a Data Platform Engineer to join their established IT team. Their current project is based around the creation and … implementation of a brand new Azure Data Platform. You will take responsibility for the design, development and maintenance of the data platform utilising your experience with the Azure tech stack. You will join a growing team. This is an opportunity to join a team who are … Excellent understanding of Azure Databricks Experience creating data pipelines using Azure Data Factory Experience working with Azure Data Lake storage. Good working knowledge of other Azure cloud services and technologies This is just a brief overview of the role. For the full information more »

Key Responsibilities Assist the Data Team Lead in system improvements. Develop, maintain, and troubleshoot software components. Identify and solve data/software issues. Collaborate with stakeholders and peers. Plan tasks and deployments. Conduct peer reviews and advocate for best practices. Ensure compliance with IT and Security … systems experience. Proficiency in traditional Data Warehouse tools. Understanding of Dimension Modelling. Strong SQL skills. Knowledge of Azure Data Lake, Data Factory, Databricks, and Functions. Essential Experience Support for Data Warehouses. Building Azure data pipelines. Agile methodology experience. more »

A Senior Data Engineer required by this leading research and analytics vendor to join an existing Data engineering/product function as they look to continually improve their product and application suite. As a senior member of the data practice you will - Promote best … practice for data related projects Mentoring engineers Coordinating resources Aim for continuous improvement of the team Innovate with the use of new technologies Ideally you can demonstrate experience across a breadth of tools and technologies, including - Demonstrable professional Data experience Experience of working with semi or … warehouses and data lakes. Knowledge of Azure Cloud Services Good understanding T-SQL programming Good exposure to Azure Data Lake technologies such as ADF, HDFS and Synapse Good knowledge of Data Governance, Data Catalog, Master Data Management Knowledge more »

SC Cleared) London (Hybrid) Permanent £70,000 - £90,000 (DOE) Software Developer needed with active SC Security Clearance and strong Python, SQL + Data Visualisation tools (PowerBI/Tableau). Working in London on a hybrid remote basis (typically 2-3 days/week in the office). … + implementing innovative banking applications and systems. Python and SQL programming/development experience. Developing high-quality, maintainable Python and SQL code. Developing data interfaces to connect multiple banking systems including: SQL queries, data retrieval, data manipulation, data modelling + data … web applications. Azure Cloud: designing + implementing Azure cloud based solutions + using data tools like Snowflake and Azure Data Lake Services (ADLS). Developing solutions for Proof of Concept (POC) + Minimum Viable Products (MVP). Advantageous: Banking, JavaScript, HTML, CSS + front-end more »

SC Cleared) London (Hybrid) Permanent £70,000 - £90,000 (DOE) Software Developer needed with active SC Security Clearance and strong Python, SQL + Data Visualisation tools (PowerBI/Tableau). Working in London on a hybrid remote basis (typically 2-3 days/week in the office). … + implementing innovative banking applications and systems. Python and SQL programming/development experience. Developing high-quality, maintainable Python and SQL code. Developing data interfaces to connect multiple banking systems including: SQL queries, data retrieval, data manipulation, data modelling + data … web applications. Azure Cloud: designing + implementing Azure cloud based solutions + using data tools like Snowflake and Azure Data Lake Services (ADLS). Developing solutions for Proof of Concept (POC) + Minimum Viable Products (MVP). Advantageous: Banking, JavaScript, HTML, CSS + front-end more »

Java Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

least 4 years of design and development.experience with various relevant Microsoft platforms, tools, technologies, patterns, and techniques related to Azure tools, integration, and data is required.Experience with industry/domains like pharmaceutical, finance, HR, sales, marketing, and manufacturing is highly preferred.Experience with healthcare industry regulations, data … etc., and connectivity & security configurations (certificates, encryptions, etc.).In-depth knowledge and experience with Azure data storage (SQL Server, Data lake, Synapse, etc.) & access tools, APIs, cloud connectivity, and ETL processes.Knowledge and some experience of MS Office/MS Office 365 suite, SharePoint Online, Power … Azure DevOps and CI/CD pipeline.Experience working with APIs, Postman/SOAPUI tools, MS D365, ServiceNow, Azure Analytics tools, Azure Data lake, Azure Synapse, Azure BYOD & Data verse, Informatica, BI tools, etc. is a big plus.General business skills:Clear communication to translate and explain more »

infrastructure investments. Be part of a dynamic team driving growth and maximizing value in the alternative asset management industry. Key Responsibilities: Support the Data Team Lead in system updates. Develop, modify, and maintain software components. Resolve data/software issues and suggest technical solutions. Collaborate with … experience in Azure data systems. Proficiency in Data Warehouse technologies and SQL. Familiarity with Azure services like Data Lake and Data Factory. Essential Experience: Supporting traditional Data Warehouses. Building Azure data pipelines and data lakes. more »

located in Stamford, CT, USA as a hybrid role.Position Description/Requirements The Azure Cloud AI Engineer is a member of the Enterprise Data Services (EDS) team within Global IT Services. In this capacity, the candidate will work with a team of empathetic, autonomy-supported, well-connected, competent … and passionate data analysts, data engineers, data architects, and data scientists (i.e., a data team) responsible for empowering the organization with modern data science and AI tools, technologies, and workflows. The ideal candidate will be highly empathetic, collaborative … and securing Azure solutions. - Strong experience in automating CI/CD pipelines in Azure. - Strong experience with integrating Azure storage (e.g., Data Lake, Cosmos DB, Microsoft SQL Server, etc.) in broader solutions. - Experience in deployment and functionality of container services (e.g., Azure Kubernetes Service). - Good understanding more »

Python Solutions Architect (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Python Team Lead (Architecture Programmer Developer Java Python Software Engineer Data Enterprise Engineering Developer Programmer AWS GCP Python Athena Glue Airflow Ignite JavaScript Agile Pandas NumPy SciPy Spark Dremio Apache Iceburg Iceberg PySpark MWAA Arrow DBT gRPC protobuf Snowflake TypeScript Manager Finance Trading Front Office Investment Banking Asset … external sources such as Bloomberg and Reuters and it's distribution across investment technology. The data enters an AWS data lake which, over the next 12 months, will be migrated to a data mesh architecture. You will be leading one of the teams … in the area that is responsible for this core data lake and its migration to a data mesh. You will be working with Java, Python, AWS (EC2, ECS, EKS, Glue), SQL, Spark, MWAA/Airflow, Iceberg and DBT. You will have line-management responsibility for more »

Senior Data Engineer 💰 £80,000-£100,000 🖥️ AWS, Python, Docker 🌍 London, 3 days a week in office We are exclusively partnered with a high growth, early stage startup operating in the beauty and wellness industry (in the UK and now US!) and supporting them on their search for … a Senior Data Engineer. The role... As the company's 1st Data Engineer, you’ll be the central player in building the integrated data architecture from the ground up. You'll gather data from diverse sources, build and maintain data … What you'll be doing... You will gather data from various departments and tools, integrating it into a central data lake or warehouse. You will design and construct data pipelines to automate data flow, involving ETL processes as needed. You will more »

Data Product Solutions Lead Salary: Up to £68,000 Our Data Analytics Platform Design team is currently recruiting for a Data Product Solutions Lead to play a key role shaping and delivering a number of exciting data projects. This role has a … key function driving how we manage, prepare, and assure a wide selection of data assets to support a diverse group of business areas. As a Data Product Solutions lead, you will define solutions to support a range of development and transformation projects working with Business Data … to be a part of our team and business! We are constantly modernising our complex data estate - cloud and data lake are our strategic targets, with business self-service and the concept of Mesh computing also in our sights. A bit about the job: Key more »

Write high-quality, maintainable code using languages such as Python , SQL . Establish data tools like Snowflake and Azure Data Lake Services (ADLS) Gen 2 Utilize PowerBI, Tableau, or similar tools to design and create interactive and visually appealing dashboards and reports. Work closely with … PoCs to validate new technologies, frameworks, or solutions. Drive the development of MVPs, ensuring timely delivery and alignment with business goals. Azure and Data Engineering: Leverage your Azure expertise to design and implement cloud-based solutions. Collaborate with data engineers to build robust data pipelines and ensure data quality. SQL and Data Interface: Develop and optimize SQL queries for data retrieval and manipulation. Work on data interfaces to connect various systems within the bank. Qualifications: Bachelor’s degree in Computer Science, Information Technology, or more »

Senior Data Engineer - Rapidly growing highstreet brand - Hybrid - up to £100,000 Burns Sheehan is partnered with a rapidly growing high-street chain who have seen great success recently and are in the process of expanding further in the UK and abroad. This will be s a great … opportunity to have a real impact on the strategy and roadmap for data across the business. Working closely with the wider tech teams on a super greenfield project, this is the perfect opportunity to have a real impact on a scaling business. You will be working very closely … be up to?: Data Integration: Gather data from various departments and tools, integrating it into a central data lake or warehouse. Data Pipeline Development: Design and construct data pipelines to automate data flow, involving ETL processes as more »

We are searching for an experienced Data Engineer for an outstanding technology focused business based in Devon. The role is offered on a hybrid working basis, so to be considered for the vacancy you need to either live within a commutable distance of Exeter/East Devon or … Methodologies Any experience working with the following is an advantage but is NOT essential: - PowerShell Azure AWS PowerBI/Power BI Data Lake We are looking to speak with candidates who are good team players and communicators, people that are happy to present their ideas in meeting … Engineer, Databricks, Python, TSQL, T-SQL, Test Automation, Unit Testing, Mocking, Refactoring, Agile, Scrum, PowerShell, Azure, AWS, PowerBI, Power BI, Data Lake Please note that due to a high level of applications, we can only respond to applicants whose skills and qualifications are suitable for this more »

as a Power BI Developer Analyse large datasets and draw on your expertise with Power BI to provide expert reporting and intelligence into data driven decision making for key Customer Focused areas across the business. Work with data engineers across IT & Data teams to … provide guidance and consultancy on producing an efficient and accurate reporting infrastructure. To mentor and provide training to the Data Team, to develop their skills with Power BI and surrounding processes. Experience & Skills Required Expertise with Data Visualisation and Report Presentation using Power BI. Able to … design, data transformation and engineering for reporting purposes. Proficiency with the Azure Suite, Data Factory, SQL DB, Data Lake Storage Must have experience in working with consultancies and end-clients If this is something of interest to you, please send your CV across more »

and platforms. Role purpose/summary Collaborate with stakeholders to understand business requirements and translate them into effective solution designs for our party data model data platform. Architect and implement cloud-based solutions that leverage popular data platforms to enable efficient storage, processing, and … analysis of large-scale data. Design scalable and resilient architectures that ensure high availability, fault tolerance, and disaster recovery for our data platform. Assess and select appropriate data platforms and technologies based on functional and non-functional requirements, considering factors such as performance, scalability, security, and … platforms such as Amazon Web Services (AWS) (e.g., S3, RDS, Redshift, Athena), Microsoft Azure (e.g., Blob Storage, SQL Database, Data Lake Analytics), or Google Cloud Platform (e.g., Cloud Storage, BigQuery). Deep understanding of cloud computing concepts, including infrastructure as code, serverless computing, and containerization. more »

About the AWS Data Engineerj ob Stride Recruitment are looking for skilled and motivated AWS Data Engineers to join a consulting firm offering end-to-end data solutions, delivering best-in-class experiences for their external clients. To be successful in this AWS Data Engineer role, you will need to have a strong background in AWS, with experience in data warehousing, data lakes, and data integration. You should also have a good understanding of data modelling, ETL processes, and data governance. Technical … Skills: Proficiency in AWS Glue, AWS Redshift, and Python Experience with ETL processes, data integration, and data warehousing. Strong SQL skills Experience with Big Data technologies such as Hadoop, Spark, and Kafka Familiarity with cloud platforms (AWS, Azure, Google Cloud) Working knowledge of data more »

Lead Azure Data Engineer - Manchester - £60,000-£75,000 My client has an immediate and exciting opportunity available for an experienced Azure data engineer to join and help lead their small team of developers. You'll have the opportunity to expand your skills by delivering valuable … data insights to drive change across various business areas. Key Responsibilities: Develop and implement data and reporting solutions using the latest Microsoft technologies: SQL Server Integration Services, Azure Synapse Analytics, Azure Analysis Services, Azure Data Lake, Azure SQL Database, Azure Data Factory, and Power BI. Collaborate with team members or directly with business users to understand requirements and more »

Data Engineer London - Hybrid working £55,000 - £60,000 A global leading HR staffing organisation based in London is currently looking to recruit a Data Engineer who will play a crucial role in designing, developing, and maintaining the data infrastructure that powers innovative solutions … within the client. We require an engineer who has a passion for data and has a good background in Azure, synapse, Databricks, SQL, Python and DataOps. This is a fantastic opportunity for a Data Engineer to gain exposure to different business areas from Visualisation, Machine Learning … Alongside this my client is going to be going through a cloud migration to Azure. Responsibilities : Collaborate with cross-functional teams to understand data requirements and design efficient data pipelines. Develop and maintain scalable data models and databases. Design and implement data more »

Data Engineering Lead Salary - Circa £65,000 Are you someone with a proven track record in data engineering, ready to lead and innovate? We have an exciting opportunity for an experienced Data Engineering Manager to manage a data development team who are … responsible for delivering IT data solutions across Aviva. As demand for data continues to grow across the organisation, we are in need of an experienced team lead from a technology … background to manage development projects through the full project life cycle with specific focus on ETL/data store (data lake/warehouse) in an Amazon Web Services environment. A bit about the job: This is a great opportunity for the right technology-aware individual more »

term objectives. As a BI Specialist, you will be responsible for: Transitioning to Azure cloud technologies, such as Azure Fabric and Data Lake, to optimise data storage and processing. Overseeing the release of SQL Code, stored procedures, and table changes. Deploy source code into production … environment. Addressing sustainability concerns with the current Data Lake setup, potentially involving external consultancy for guidance. Reviewing and enhancing the architecture of data solutions, with a focus on replacing reporting tools like Snap with more efficient alternatives. Collaborate with DevOps Engineers to ensure seamless integration … deploy, particularly focusing on .NET changes and code deployment. Eliminating internal delays in software releases, streamlining processes, and enhancing overall efficiency within the data and architecture function. To be successful in this role, you should have the following skills and experience: Data Release Octopus Deploy Stored more »

and growth of our bespoke development capabilities. Leading design phases on Business IT programmes, validating requirements and ensuring that all aspects of UX, data and solution design are within scope, complete, and deliverable. Having responsibility for the architecture of data and solutions delivered to the business … premise application to the cloud Azure Cloud development, Blazor, NServiceBus, CQRS and Domain-driven design, Scrum/Agile, API Design and management skills Data Engineering projects using Data Lakes, Data factories, ETL techniques, Synapse and PowerBI … MS Logic and Power Apps Azure DevOps Experience with the following would be beneficial: AI + Machine Learning Analytics: Analysis Services, Data Lake Analytics, Data Catalog DevOps: Application Insights Key Competencies Will use a coaching and influencing style to achieve outcomes rather than taking a more »

they are always looking to adapt to technological changes to stay at the forefront of the industry About the Role: As a Principal Data Engineer, you’ll play a pivotal role to help drive the adoption of Microsoft Power platform and streamline reporting and analytics processes across the … organisation, we are looking for a Data Engineer with extensive multi-cloud data engineering experience and in-depth understanding of end-to-end development and deployment processes. Whilst this is a data engineer role, the focus is on data analytics and migrating … from Tableau to Power BI. Experience/skills required: Proficient in data analysis, data modelling and designing ETL processes. Familiar with Data Mesh architecture and Data Products Highly skilled in T-SQL with experience in performance tuning and dealing with large data more »