Data Storage and Transfer Limits

You can set limits for data storage and data transfer as a means of monitoring and controlling usage costs on the Rescale platform. For these options, set a value (in Gibibytes) desired as the target limit, and percentages of the target limit when you would receive email notifications.

Note: There are no global platform data storage and transfer limits. However, administrators can impose limits on the account level for visibility.

Setting “Enforce” to “OFF” makes a soft limit, in which you will receive an email notification when the limit is exceeded, but does not change whether you can store or transfer more files to the platform.

Setting “Enforce” to “ON” makes a hard, or strict limit.

Enforced storage limit

When the storage limit is enforced, cloud files are automatically deleted until your total active storage is less than your target limit. The oldest files will be deleted first. The deletion procedure runs every hour, such that it is possible to exceed the storage limit by up to an hour.

Note that while file storage is tracked in real-time on the platform, storage limit notifications are checked every 10 minutes. This means that if you set a limit to facilitate cost control, but exceed your storage limit in the way described above, you may receive notifications after your storage limit has already been exceeded.

Learn more about how storage usage is calculated here.

Enforced transfer limit

If the transfer limit is exceeded and enforced, users will not be able to upload files to or download files from cloud storage. Provided that there is no storage limit or that it is not exceeded, Rescale compute nodes can still upload and download from Rescale Cloud Storage. Data transfer to and from a Compute node on a running job is not added to the data transfer count.

The file transfer total is, generally speaking, calculated upon completion of an upload, with a 1-hour buffer window. In other words, the file transfer size may not be updated for up to an hour after an upload completes. During this window, it will be possible to exceed the transfer limit, even if enforced, assuming that at the time of starting the upload, the transfer size reflected on the platform has not exceeded the enforced limit. At this point, the size of data that one can upload beyond the enforced limit will depend purely on the user’s upload bandwidth.

×