Job title: Senior Data Engineer
Location: London
Salary: £65,000 pa - £80,000 pa
Type: Permanent full time
Capita are looking for a Senior Data Engineer to be a technical contributor with hands-on experience. You will be part of the Data and Analytics engineering technology team and will partner closely with a team of data scientists, business analysts and data engineers to lead Capita's cloud based Big Data and Analytics strategy.
The candidate will be expected to be an innovative forward-thinker who will help lead full lifecycle execution of data engineering initiatives and contribute directly to existing and emerging business strategies and goals.
Key Responsibilities:
- Lead the design, implementation, and continuous delivery of pipelines using distributed Azure based big data technologies, supporting data processing initiatives across batch and streaming datasets.
- Provide administrative support on deployed Azure platform components.
- Identify, evaluate and implement the cutting edge, big data pipelines and frameworks required to provide requested capabilities in order to integrate external data sources and APIs.
- Review, analyse and evaluate market requirements, business requirements and project briefs in order to design the most appropriate end-to-end technology solutions.
- Process and manage high volume real time customer interaction streams.
- Provide architectural support by building Proof of Concepts and Prototypes.
Requirements:
- Bachelor's Degree or higher in Computer Sciences or similar.
- Development experience with cloud services (Azure, GCP, AWS etc).
- Experience with Spark.
- Exeprince of Python or similar prpogramming language.
- Able to tune Big Data solutions to improve performance and end-user experience.
- Knowledge of Visualization and Data Science Tools.
The Senior Data Engineer should be passionate about working with cutting edge technologies and developing prototypes using both proprietary data sets and open source tools for the selected solutions.
Senior Data Engineer / Cloud / Azure / Python / Spark / London
Capita IT Resourcing is acting as an Employment Agency in relation to this vacancy.