Data Engineer 2 (DE)

Closing date for applications: 25/10/2021
Specialist role
Data engineer
Summary of the work
Cyber Mission Data require a Data Engineer to work within a team of 7 in a Data Operations Team. The Data Engineer will be required to work alongside 5 x Cyber Security Consultants to run and support the onboarding of data feeds and to map out data for use cases.
Latest start date
Expected contract length
This contract will expire Sept 22
South West England
Organisation the work is for
Defence Digital, MOD
Maximum day rate
Early market engagement
Who the specialist will work with
The Data Engineer will work within a small Data Operations Team, which is part of a wider Team - Cyber Mission Data Alpha. This team consists of Authority Crown Servants, current contract supplier technical resource, and separately procured technical resource.The Cyber Mission Data Alpha team fits within the current construct of the Data as a Service function, which forms part of the wider Defence Cyber Operations.
What the specialist will work on
• The increase in onboarded Cyber related data. • Work within a Data Operations Team, to turn use cases into value added data visualisation to better inform decision making• Support the identification of additional data that will add Cyber Value. • Identify valuable data sources and automate collection processes• Undertake pre-processing of structured and unstructured data• Propose solutions and strategies to business challenges• Collaborate with operations, engineering and product development teams
Address where the work will take place
MOD Corsham / Working from home.
Working arrangements
5 days per week, with a mixture of working from MOD Corsham and remote working. The task will dictate the location of the work e.g. if the specialist is working at secret, then the work will be completed mainly on site. They can default to remote working but if the task dictates that they attend the office then the individual must do this.
Security clearance
Active SC clearance is required by the start date of the contract and will not be sponsored by MOD. Candidates must also be eligible for DV clearance as this will need to acquired for this role. Due to the clearance level required, only UK nationals can apply for this role.
Additional terms and conditions
Off-payroll working rules apply (IR35 in-scope). Any Personal Services Company (PSC) candidates will require to come through an umbrella company.
How many specialists to evaluate
Cultural fit criteria
-work as a team with our organisation and other suppliers (1%) -be transparent and collaborative when making decisions (1%) -have a no-blame culture and encourage people to learn from their mistakes (1%) -take responsibility for their work (1%) -share knowledge and experience with other team members (1%)
Assessment methods
Evaluation weighting
Technical competence 65% Cultural fit 5% Price 30%
Essential skills and experience
  • Proven experience as a Data Engineer
  • BSc/BA in Computer Science, Engineering or relevant field; graduate degree in Data Engineering or other numerical field is preferred
  • Experience in data mining
  • Awareness of machine-learning and operations research, statistical data analysis and data visualisation
  • Familiarity with Scala, Java or C++ is an asset
  • Experience using business intelligence tools (e.g. Tableau) and data frameworks (e.g. Hadoop)
  • Experience of Agile development CI/CD pipeline
  • Excellent communication and presentation skills and ability to communicate effectively with both technical and non-technical audiences
  • Understanding of data connectivity to visualisation tools such as ODBC, JDBC, OLEDB etc.
  • Comprehensive understanding of Regex Syntax, use of capture groups and experience of creating Regex pattern matching syntax.
Nice-to-have skills and experience
  • Understanding of computer networking (WAN), including network design, security and logging
  • Experience of open source data processing/management tools such as NiFi, Spark, Kafka, Druid, Oozie Storm, Hive, HDFS etc.
  • Understanding of Regex Syntax, use of capture groups and experience of creating Regex pattern matching syntax
  • Experience of working with network security data sets, including Syslog, CEF, IDS/IPS Log etc
  • Familiarity with Red Hat Linux Operating System
  • Able to write scripts using Python or Bash

Closing date for applications: 25/10/2021

Data Engineer 2 (DE)

Closing date for applications: 25/10/2021

Specialist role:

Data engineer


South West England


Defence Digital, MOD

Maximum day rate:


IT Recruitment Marketplace
The Hive Enterprise Centre, Victoria Avenue
Southend-on-Sea, Essex SS2 6EX
© IT Recruitment Marketplace
To change your subscription email us here