availabilityData integration: Familiarity with data integration tools and techniques, including ETL (Extract, Transform, Load) processes and real-time data streaming (e.g., using Apache Kafka, Kinesis, or Pub/Sub), exposing data sets via GraphQLCloud platforms expertise: Deep understanding of GCP/AWS services, architectures, and best practices, with hands more »
services (Apache Spark, Beam or equivalent). • In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc. • Excellent consulting experience and ability to design and build solutions, actively contribute more »
a technical leadership roleExperience in one of the main cloud services (AWS, Google Cloud or Azure) and Big Data services (EMR, Databricks, Synapse, HDInsight, Kinesis, Snowflake, etc.)Experience Skilled in use of the Power Platform, including Power Apps, Power Automate and Power BIAdvanced knowledge of Microsoft Excel and other more »
reporting. • Specialised in AWS cloud technologies for ETL, data warehouse, and data lake design. • Hands-on experience with AWS services like EMR, Glue, RedShift, Kinesis, Lambda, DynamoDB. • Capable of processing large volumes of structured and unstructured data on AWS. • Familiarity with AWS best practices in data engineering, data science more »
Engineer; Adeptness in utilising AWS and Azure data and analytics services (or their open-source equivalents), including but not limited to EMR, Glue, RedShift, Kinesis, Lambda, Data Factory, and Databricks. Strong experience in data engineering, data science, and product development, encompassing experience in both stream and batch processing. Proficiency more »
working knowledge of AWS services (EMR, ECS, IAM, EC2, S3, DynamoDB, MSK). Our Technology Stack ð» Scala and Python Kafka, Spark, Kafka Streams, Kinesis, Akka and KSQL AWS, S3, Iceberg, Parquet, Glue and Spark/EMR for our Data Lake Elasticsearch, Dynamodb and Redis Starburst and Athena Airflow more »
operates at peak performance, scalability, and reliability. Technical Skills required: RedShift Glue (inc. Glue Studio, Glue Data Quality, Glue DataBrew) Step Functions Athena Lambda Kinesis Python, Spark, Pyspark, SQL Your contributions as a Data Engineer will directly impact the organization's operations and revenue. In addition to a competitive more »
and Snowflake. Experience with various programming languages, such as Python and Java. Familiarity with streaming/event-driven architecture, including tools like Kafka and Kinesis/Firehose. Expertise in data ingestion techniques, encompassing both stream and batch processing. Proficiency using tools like Terraform for Infrastructure-as-Code and AWS more »
energetic and dynamic environmentCompetent and comfortable working with Typescript, Serverless technologiesYou should have extensive experience working with AWS (API Gateway, Lambda, Dynamo, DB, SQS, Kinesis, S3, ELK + More)Great experience in implementing best practices like TDD, SOLID and clean codeExperience in developing REST-APIs, Microservices, relational databases and more »
structure organizationPreferred qualifications, capabilities and skillsPrior experience with customer-centric, multi-channel applicationsExperience running applications on KubernetesFamiliarity with event based streaming systems like Kafka, Kinesis or PulsarFamiliarity with non-relational databases (DynamoDB, MongoDB, Bigtable)Familiarity with authn/z protocols like OAuth2/OIDC and IdPs like (Auth0, Forgerock more »
as Adobe Campaign, Braze or moEngage.Experience in integrating and working with marketing technologies and third-party platformsFamiliarity with event based streaming systems like Kafka, Kinesis or Pulsar#ICBcareers #ICBEngineering J.P. Morgan is a global leader in financial services, providing strategic advice and products to the world’s most prominent corporations more »
similar regulated environment. Technologies they use: Cloud: AWS with a preference for native and serverless services (e.g., API Gateway, AWS Lambda, AWS Step Functions, Kinesis, DynamoDB) Programming languages: Python for software engineering, Terraform, AWS SAM, and Cloud Formation for IaC Database: SQL (Postgres) and NoSQL (DynamoDB) APIs: Primarily RESTful …/CD: GitHub Actions, AWS CodePipeline, Jenkins, and tools such as Trivy, Bandit, Sonarqube, Dependabot, etc. Big data: AWS services like S3, Redshift, Glue, Kinesis The role is mostly remote but there is a requirement to head to either their London or North office once a week (some weeks more »
Implement Data Solutions: Develop scalable and efficient data architecture solutions on AWS. Create and maintain data pipelines using AWS services such as Glue, Lambda, Kinesis, and Data Pipeline. Design data models and databases using AWS RDS, Redshift, DynamoDB, and other relevant technologies. Data Integration and Management: Integrate various data … Information Technology, or a related field. Master’s degree preferred. Technical Expertise: Proven experience with AWS data services including S3, Redshift, RDS, Glue, Lambda, Kinesis, and Athena. Strong understanding of data modeling, ETL processes, and data warehousing. Proficiency in SQL and experience with database management systems. Familiarity with data more »
across hybrid cloud on premise data platforms In-depth knowledge on key technologies like Big Query/Redshift/Synapse/Pub Sub/Kinesis/MQ/Event Hubs, Kafka Dataflow/Airflow/ADF etc Strong proven knowledge of Kimball/Dimensional data modelling and/or more »
certifications on the training platform of your choice. As a Senior Solution architect, you'll be implementing and driving large-scale cloud implementations on Amazon AWS. Other duties include: Architecting and implementing cloud solutions for different applications, automating cloud operations and cloud deployments Assume responsibility for the architecture of … consulting with application development teams on same Cloud technology, ideally AWS including PaaS services such as S3, Lambda, Step Functions, ECS, Docker, SNS, SQS, Kinesis, SageMaker etc. Understanding of distributed application design, patterns, and experience producing design diagrams and documenting standards Qualifications Security Clearance eligible. You musthavethe right to more »
Grabyo is the video platform built for live, social and mobile. The amazon web services hosted platform removes the traditional complexities of professional video production and distribution. Grabyo is trusted by major sports teams, federations and broadcasters such as ITV, the Premier League and UFC to name only a … the team architecting our platform to improve our path to microservices. Java, JavaScript, Go, NoSQL, serverless architectures, microservices, auto-scaling and auto-recovery, AWS Kinesis, ECS Fargate, DynamoDB, media processing, Terraform - these are a few of the state-of-the-art techs you will be working with. To make more »
London, England, United Kingdom Hybrid / WFH Options
Jobleads-UK
requirements are well understood and stakeholders have accurate expectations on dates and functionality Requirements Experience building a data platform with streaming tech (Pulsar, Kafka, Kinesis) Design, build and launch highly available and distributed systems data extraction, transformation and loading of datasets Excellent communication and leadership skills. Including the ability … custom data frameworks and platforms Agile and Continuous Delivery Continuous integration pipelines Strong Python AWS or Azure with large-scale streaming data (Pulsar, Kafka, Kinesis, etc) ETL management; structured or custom (Airflow, Luigi, etc) Bonus Robust experience managing and developing an engineering team Delta lake or Iceberg Trino or more »
Technical Skills Architecture & Design Enterprise Architecture and good knowledge of object-oriented programming and design patterns AWS services: API gateway, Lambda, SNS, SQS, DynamoDB, Kinesis, EC2, Athena, Elastic Beanstalk REST API Design and specification using Swagger/OpenAPI Programming Experience of both functional programming and object-orientated programming Excellent … and building R/Python-based REST APIs, and API specifications using Swagger/OpenAP Functional programming and object-orientated programming AWS services (including Kinesis, ECR, Lambdas, SageMaker and DynamoDb) or other cloud services Sound understanding of risk and risk mitigation design in relevant areas, including (but not limited more »
features across their estate of cloud native software products and services. The DevOps Engineer will have deep knowledge of the AWS data engineering stack: Kinesis, Redshift, Glue, EMR and be passionate about writing high-quality code that not only solves problems but improves the overall estate. The role will … organisation going forward. Required DevOps Engineer experience. AWS skills. Docker, Kubernetes skills. knowledge across the AWS data engineering stack including but not limited to: Kinesis, Redshift, Glue, EMR, Databricks. of the software development lifecycle and the role DevOps plays within it. working in autonomous agile teams and environments. to more »
