Automatic Deletion of Files from Cloud File System (CFS) Upon Archival
Overview
As part of Rescale’s ongoing enhancements to policy-based file management, we’ve introduced a new automation that simplifies data lifecycle management and improves storage efficiency. When users archive a job or workstation, the associated files are now automatically and permanently deleted from the Cloud File System (CFS). This enhancement provides consistent file management across storage options, including CFS and Rescale Files.
NOTE: This feature is turned on by default, meaning that upon archival of jobs and workstation, the associated files will be deleted from both Rescale Files & CFS. Users who wish to retain output files can do so by downloading them before deletion.
Highlights
- Streamlined Data Cleanup
- Archiving a job/workstation now triggers immediate deletion of its job folder and files from CFS.
- The job folder is also removed from the Project directory if shared under a project.
- Consistent Behavior Across Interfaces
- UI: Users receive visual confirmation of file deletion.
- CLI: The delete job command reflects the same behavior with no user-facing warnings.
- API: Applies to both single and batch job deletions, with consistent responses.
- Comprehensive Clean Up
- Includes all Output Files and other job-related data.
- Deleted files cannot be recovered, even if the job/workstation is later unarchived.
Why This Matters
This change supports smarter data management by automatically cleaning up archived job files, helping users stay within CFS limits, and reducing the need for manual cleanup. It’s part of Rescale’s broader initiative to make workflows more efficient through policy-driven automation.
How to Get Started
- Archive jobs/workstations via the UI, CLI, or API as usual.
- Review our documentation