Rescale Data Connectors

Overview

Rescale Data Connectors create a secure bridge between your existing data storage systems and the Rescale platform. By connecting directly to your data sources, engineers can browse, search, and attach files to simulations without manual transfers — streamlining job setup and keeping your data in place.

For workspaces with the Agentic Engineering tier, connected sources go further: documents are indexed into a knowledge base, enabling the Rescale AI Assistant to answer questions grounded in your organization’s own engineering data. This transforms siloed storage into an accessible, queryable resource for your R&D workflows.

Supported Connectors

ConnectorBrowseSearchAttach to JobsKnowledge Base
AWS S3
Azure Blob Storage
SharePoint

Additional connector types are in development.

Key Capabilities

Browse Connected Files

Navigate the folder structure of any connected source directly from the Rescale platform. View file names, sizes, and folder hierarchy — the same structure you’d see in the source system.

Available for: AWS S3, Azure Blob Storage, SharePoint

Search Files by Name

Find files across a connected source using filename search without needing to navigate the folder tree. Enter a filename or path prefix, and results are returned immediately.

Available for: AWS S3, Azure Blob Storage

Attach Connected Files to Jobs

Select files from connected storage during job or workstation setup and attach them directly as inputs. Files are transferred to the compute environment automatically at launch — no need to download and re-upload.

You can combine files from connected storage and Rescale Files in the same job.

Available for: AWS S3, Azure Blob Storage

AI-Powered Insights (Knowledge Base)

For workspaces with the Agentic Engineering tier, connected document sources are indexed as a knowledge base. Ask the Rescale AI Assistant questions in natural language and get answers grounded in your organization’s engineering documents, with citations back to the source files.

Available for: AWS S3, Azure Blob Storage, SharePoint (requires Agentic Engineering tier)

Getting Started

For Admins: Connecting a Data Source

  1. Navigate to Connectors in the left sidebar
  2. Click Manage Connectors
  3. Select Add new and choose your connector type
  4. Provide the required credentials:
    • AWS S3: Access Key ID, Secret Access Key, Region, Bucket Name
    • Azure Blob Storage: Account Name, Container Name, SAS Token
    • SharePoint: Tenant ID, Client ID, Client Secret, Site URL
  5. Click Test Connection to validate credentials
  6. Click Save to create the connector

Once saved, the connector is active and available to all users in the workspace.

image 287 edited
Create & Manage Connectors

For Users: Browsing and Searching Files

  1. Navigate to Connectors > Browse Files
  2. Select a connected source from the dropdown
  3. Browse the folder structure or use the search bar to find files by name
  4. Click the preview icon to view file contents (for supported file types)

For Users: Attaching Connected Files to a Job

  1. Create a new job or workstation
  2. In the Inputs section, click Attach from Cloud Storage
  3. Under External Storage, select your connected source
  4. Browse or search for the files you need
  5. Select one or more files and click Attach
  6. Continue with job setup — selected files will transfer to the compute cluster at launch

You can mix files from connected storage with files from your Rescale Files library in the same job. Files are not imported into Rescale Files — they are transferred directly to the compute environment at job launch.

FAQ

What is a Data Connector?

A Data Connector establishes a secure, read-only link between your external data storage and the Rescale platform. Once connected, engineers can browse, search, and attach files directly from the Rescale UI without manually downloading and re-uploading data.

What connectors are currently supported?

Rescale supports AWS S3, Azure Blob Storage, and SharePoint as file system connectors. Additional connector types are in development.

Can I search for files across my connected storage?

Yes — for AWS S3 and Azure Blob connectors, you can search for files by name directly from the search bar without navigating through the folder hierarchy. Search matches filenames that start with the prefix you enter.

Can I attach files from connected storage directly to a job?

Yes — for AWS S3 and Azure Blob connectors, you can select files from connected storage during job setup and attach them as inputs. Files are transferred automatically when the job launches. You can combine connected storage files with Rescale Files in the same job.

Do connectors import files into Rescale?

No. Your data stays in your existing storage systems. When you attach a file from connected storage to a job, it is transferred directly to the compute environment at launch — it is not copied into Rescale Files. Connectors provide a bridge for access, not a migration of data.

What information do I need to connect to my cloud storage?

It depends on the connector type:

  • AWS S3: Access Key ID, Secret Access Key, Region, Bucket Name
  • Azure Blob Storage: Account Name, Container Name, SAS Token
  • SharePoint: Tenant ID, Client ID, Client Secret, Site URL
How is security maintained for my connected data?

Connectors use your cloud provider’s native security mechanisms. Access is read-only — Rescale cannot modify or delete files in your connected storage. Credentials are encrypted at rest and never exposed in API responses.

What is the relationship between Data Connectors and the Knowledge Base?

Data Connectors establish the connection to your external storage. For workspaces on the Agentic Engineering tier, connected sources can also serve as a knowledge base — documents are indexed so the AI Assistant can answer questions using your organization’s own data. Browse and search work at the file level; the knowledge base works at the content level.

Do connectors replace my existing storage systems?

No. Connectors provide a bridge — your data stays in your existing systems. Rescale reads from them when needed (for browsing, searching, attaching to jobs, or knowledge base queries) but does not move or duplicate your data.

Who can configure connectors?

Workspace admins or org admins can add and manage connectors. Once configured, all users in the workspace can browse and use the connected files.