description, key responsibilities, and job description: Hands on Senior Engineer with experience of working within high performance development teams Significant AWS Engineering experience implementing Amazon well architected frameworks, serverless solutions and improving existing platforms using AWS technologies with Agile delivery methods Demonstrable experience of Python 3, Python data management … or equivalent IT related experience. Skills Deep experience of AWS solutions incl. Step Functions, Glue, Lambda, RDS, (e.g. DynamoDB, Aurora Postgres), SQS, API Gateway, Athena Experience of Python Experience of the delivery and optimization of high-performance data pipelines from ingestion to storage to distribution Comfortable with data analysis more »
with both streaming data sets and more traditional data sets Experience with AWS data stack, would consider other cloud platforms (such as S3, Glue, Athena,) Experience with infrastructure as code Terraform Have working SQL knowledge and experience working with several relational databases Experience in Python Women in Tech: Cirium more »
Leeds, West Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
DWP Digital
setting direction, building and maintaining networks and collaborating across teams with a diverse range of stakeholders You have a deep understanding of AWS, Azure, Athena, EMR processing, relational & non-relational databases, and understand how these fit into the wider technical landscape You have experience designing, coding and testing data more »
Lead Data Architect will design and implement solutions using a range of AWS infrastructure, including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, RDS, Athena, Kinesis, Quicksight. We also widely use other tech such as Snowflake, DBT, Databricks, Informatica, Matillion, Airflow, Tableau, Power BI etc. The Lead Data Architect … aligned to the functional and non-functional requirements Work closely with other members of agile deployment team Selection & configuration of appropriate, base technologies (eg Amazon Redshift, RDS) Selection & application of appropriate standards & principles Capture & implementation of functional & non-functional requirements Expert in data modelling and latest data trends including more »
analytics, data integration, data platform) using cloud-based hyperscales, with emphasis on AWS services including S3, Redshift, Lambda, Step Functions, DynamoDB, AWS Glue, RDS, Athena, Kinesis, Quicksight. Hands on experience on design solutions using Snowflake and DBT. Familiarity with Databricks or Informatica. Hands on experience in designing data models more »
Blackpool, Lancashire, North West, United Kingdom Hybrid / WFH Options
DWP Digital
setting direction, building and maintaining networks and collaborating across teams with a diverse range of stakeholders You have a deep understanding of AWS, Azure, Athena, EMR processing, relational & non-relational databases, and understand how these fit into the wider technical landscape You have experience designing, coding and testing data more »
Birmingham, West Midlands, United Kingdom Hybrid / WFH Options
DWP Digital
setting direction, building and maintaining networks and collaborating across teams with a diverse range of stakeholders You have a deep understanding of AWS, Azure, Athena, EMR processing, relational & non-relational databases, and understand how these fit into the wider technical landscape You have experience designing, coding and testing data more »
Manchester, North West, United Kingdom Hybrid / WFH Options
DWP Digital
setting direction, building and maintaining networks and collaborating across teams with a diverse range of stakeholders You have a deep understanding of AWS, Azure, Athena, EMR processing, relational & non-relational databases, and understand how these fit into the wider technical landscape You have experience designing, coding and testing data more »
Sheffield, South Yorkshire, Yorkshire, United Kingdom Hybrid / WFH Options
DWP Digital
setting direction, building and maintaining networks and collaborating across teams with a diverse range of stakeholders You have a deep understanding of AWS, Azure, Athena, EMR processing, relational & non-relational databases, and understand how these fit into the wider technical landscape You have experience designing, coding and testing data more »
Knutsford, England, United Kingdom Hybrid / WFH Options
Capgemini
their I&D Consulting career. What you’ll do and bring: Proficiency in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, and Lambda. Hands-on experience with Snowflake, Redshift cloud data warehousing solutions. Familiarity with DBT (Data Build Tool) for managing transformations in the data more »
Northamptonshire, England, United Kingdom Hybrid / WFH Options
Capgemini
their I&D Consulting career. What you’ll do and bring: Proficiency in AWS services relevant to data engineering such as S3, Glue, EMR, Athena, and Lambda. Hands-on experience with Snowflake, Redshift cloud data warehousing solutions. Familiarity with DBT (Data Build Tool) for managing transformations in the data more »
cloud technologies. Strong experience with data orchestration tools: e.g. Apache Airflow, Dagster. Experience with big data storage and processing technologies: e.g. DBT, Spark, SQL, Athena/Trino, Redshift, Snowflake, RDBMSs (PostgreSQL/MySQL). Knowledge of event-driven architectures and streaming technologies: e.g. Apache Kafka, Kafka Streams, Apache Flink. more »
an understanding of Data modelling Principles & best practices and also needs prior experience leading a data engineering team. Key Tech: - AWS (S3, Glue, EMR, Athena, Lambda) - Snowflake, Redshift - DBT (Data Build Tool) - Programming: Python, Scala, Spark, PySpark or Ab Initio - Data pipeline orchestration (Apache Airflow) - Knowledge of SQL This more »
Sheffield, England, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
Lincoln, England, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
Preston, England, United Kingdom Hybrid / WFH Options
Uneek Global
in Python or Go Lang. • AWS Services: Significant hands-on experience with AWS services such as EKS, EC2, S3, IAM, Networks, serverless, Lambda, DynamoDB, Athena, CloudWatch. • CI/CD: Experience with CI/CD platforms and creating CI/CD pipelines. Such as Jenkins, ArgoCD, GitOps • Containerization and Microservice more »
Kafka or equivalent distributed event store and stream-processing platform. Experience working with Redis or equivalent in-memory storage. Experience working with AWS S3, Athena, ECS, Cloud Formation, Lambdas & Cloudwatch. Experience with concurrent development source control (GIT). Systems integration experience with networking, data migrations, API integration and design. more »
cloud hosting provider (AWS (preferred), Google Cloud, Azure or similar). Experience using modern build tools such as Maven, Jenkins, GitHub, etc. Experience with Amazon Web Services a strong plus - CloudFormation, EMR, S3, EC2, Athena etc. Experience with scheduling services such as Airflow, Oozie. Experience with Data ETL more »
Kingdom Work Mode: Hybrid Package: Competitive + Benefits Start Date: ASAP Permanent Role: Yes Responsibilities: Help customers learn and use AWS services such as Athena, Glue, Lambda, S3, DynamoDB, NoSQL, Relational Database Service (RDS), Amazon EMR and Amazon Redshift Deliver on-site technical engagements with customers. This more »
as Flask). Familiarity with SQL Server and/or PostgreSQL database technologies. Linux experience. Cloud development experience (e.g. AWS). Familiarity with SecDB, Athena or Quartz. Team Player with Excellent Communication Skills. more »
Reading, England, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
Edinburgh, Scotland, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
Glasgow, Scotland, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »
Leeds, England, United Kingdom Hybrid / WFH Options
BJSS
variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc. About You You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications more »