Some of the main Objectives of the Data Intelligence Platform are: • Efficiently load and transform data into a DWH • Provide advanced orchestration to use Data Lake based approach • Integration with 3rd party sources, open-source APIs • Data movement in both batch and real-time change data capture • Leverage BigData technologies (Spark) to ingest, clean & transform data • Apply Machine Learning on DWH to proactively figure out issues and generate insights • Create dashboards in Oracle Analytics Cloud to drive decision-making Your Opportunity You will be responsible for applying your extensive knowledge as … a dataengineer and building Digital Government Data Platform . Our Ideal Candidate We are looking for a strong DataEngineer who thrives on research and development projects. Be technically strong and hands-on, who works efficiently with other product groups and engineering leaders to more »
Senior DataEngineer Hybrid AND Flexible Up to £75,000 + 10% bonus + share scheme MBN Solutions are delighted to have been retained to secure a DataEngineer (BigData Technologies) for our client who are firmly positioned in the "Tech For Good … space. This is a key hire for the client during the early stages of the growth of their Data team and it is therefore essential this person is highly experienced in all the areas of skills required. Our client are a start up/scale up and we are … ideally looking for a Senior DataEngineer who has previous experience and success in this environment previously. Your Role: Building reusable data pipelines at scale with the capability of integrating data from multiple sources automatically. Work with structured and unstructured data, and curate datamore »
Lead BigDataEngineer - Hybrid - £120K My client is a leading trading platform that is looking to add a talented Senior BigDataEngineer You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's … in design, processes, and implementation to improve operational management, scalability, and extensibility. The following skills/experience is essential: -Proven experience as a Lead BigDataEngineer with excellent knowledge of BigData -Excellent knowledge of Hadoop and tools such as Hbase/Hive and … Spark etc -Excellent experience of ETL, data warehousing and handling a variety of data types -Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI) -Experience implementing data visualisation and reporting tools -Excellent communication and business-facing more »
Technology (IT) Group Functions Job Reference # 294845BR City London Job Type Full Time Your role Do you have proven track record of building bigdata solutions? Are you confident at iteratively refining user requirements and removing any ambiguity? Do you want to design and build best-in … class, cloud native bigdata solutions? We’re looking for a BigData Lead Engineer to: • engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using cloud (Azure) data platform infrastructure effectively. • transform data into … valuable insights that inform business decisions, making use of our internal data platforms and applying appropriate analytical techniques. • develop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems. • ensure the quality, security, reliability, and compliance of our solutions by applying our digital more »
South East London, England, United Kingdom Hybrid / WFH Options
Oliver Bernard
Job DescriptionLead BigDataEngineer - Hybrid - £120KMy client is a leading trading platform that is looking to add a talented Senior BigDataEngineer You'll be responsible for providing technical leadership in architecting and designing end-to-end solutions for the organisation's … improvements in design, processes, and implementation to improve operational management, scalability, and extensibility.The following skills/experience is essential:-Proven experience as a Lead BigDataEngineer with excellent knowledge of BigData-Excellent knowledge of Hadoop and tools such as Hbase/Hive and … Spark etc-Excellent experience of ETL, data warehousing and handling a variety of data types-Very strong knowledge of database technologies such as NoSQL, Relational, Graph stores, OLAP, Data Lakes and Business Intelligence (BI)-Experience implementing data visualisation and reporting tools-Excellent communication and business-facing more »
Data DevOps Engineer - DevOps, Bigdata - Permanent - Gloucestershire Location: Gloucestershire/Bristol (full-time onsite) Salary: £65 - £95K per annum Negotiable DOE Benefits: Flexible working hours, career opportunities, private medical, excellent pension, and social benefits Active DV Clearance is highly desirable. Please note that candidates will … with a global edge-to-cloud company advancing the way people live and work. They help companies connect, protect, analyse, and act on their data and applications wherever they live, from edge to cloud, so they can turn insights into outcomes at the speed required to thrive in today … The Candidate: We are looking for a bright, driven, customer focussed professional to join our clients Hybrid Cloud Delivery team, and work alongside Enterprise Data Engineering Consultants to accelerate and drive data engineering opportunities. This is a fantastic opportunity for a dynamic individual with big ambitions, who more »
The role involves the design, development, implementation, and support of a cutting-edge real-time data platform, which includes data streaming, a data lake, and a blazing fast analytics database. We are looking for someone who is passionate, motivated, driven, and up for the challenge. Strong knowledge … of database design and development with previous experience in developing ETL processes, and multidimensional data models. High understanding of both relational and multidimensional modelling principles. Deep knowledge of Object-Oriented Programming languages and must have a strong experience in Java. Strong experience on data quality standards and contribution … on defining and monitoring data quality metrics and KPIs Key Skills Needed: Flink Beam Kafka Connect Java more »