Project Contacts

For further information about this project, please contact:

• Mrs Carol Booth (carol.booth2@newcastle.ac.uk)
• Mr John Snowdon (john.snowdon@newcastle.ac.uk)

Project Description

csv data transformation, manipulation. This project was used to extract historical data from the Rocket HPC facility, and this was in turn used to pull out trends and shape/sizing data on Newcastle University workloads from that system.

Software or Compute Methods

This was mainly using command line tools to extract and process Slurm accounting data: bash, sacct, python, sqlite, simple slurm tools: https://github.com/megatron-uk/Simple-Slurm-Tools as well as the slurm2sql project: https://github.com/NordicHPC/slurm2sql