rdc@fri - Storage, relocation of tiered data – Incident details

All systems operational

Storage, relocation of tiered data

Resolved
Degraded performance
Started 2 months agoLasted 11 days

Affected

Frida

Degraded performance from 5:30 PM to 4:34 PM

Storage

Degraded performance from 5:30 PM to 4:34 PM

Updates
  • Resolved
    Resolved

    Data relocation completed successfully.

    We've increased the amount of storage available. Note that both /shared/home and /shared/workspace are tiered; common datasets should be shared within groups using the groups' appropriate WORK path. You can check data location on an individual file basis with the command weka fs tier location <file_path> (write-cache, read-cache, or object storage), fetch data with weka fs tier fetch <file_path> (copy from object storage to read-cache), and release data with weka fs tier release <file_path> (remove from read-cache). Note that these commands work only on files, not directories, see weka fs tier <command> --help for more advanced usage.

  • Identified
    Identified

    In the last couple of days we've been doing relocation of tiered data. Although transparent for most users, it may be having impact on work job performance. Be mindful if you are doing any benchmarking. The relocation should be finished by December 5th.

    We appreciate your patience.