Amazon DataSync

AWS DataSync is an online data transfer service that simplifies, automates, and accelerates moving data between on-premises storage systems, AWS storage services, and other cloud storage. DataSync can transfer data at speeds up to 10 times faster than open-source tools by using purpose-built network protocol and parallel multi-threaded architecture. It supports NFS, SMB, HDFS, S3, EFS, FSx, and more as transfer endpoints.

1 APIs 7 Features

Data TransferMigrationStorageAutomationHybrid Cloud

APIs

Amazon DataSync REST API

RESTful API for AWS DataSync enabling management of data transfer tasks, locations, agents, and task executions for automated data movement between on-premises storage systems a...

Collections

Amazon DataSync REST API

OPEN

Pricing Plans

Amazon Datasync Plans Pricing

3 plans

PLANS

Rate Limits

Amazon Datasync Rate Limits

5 limits

RATE LIMITS

FinOps

Amazon Datasync Finops

FINOPS

Features

High-Speed Data Transfer

Transfer data at speeds up to 10 times faster than open-source tools using purpose-built multi-threaded network protocol over TLS.

Multi-Protocol Support

Connect to NFS, SMB, HDFS, Amazon S3, Amazon EFS, FSx for Windows, FSx for Lustre, and FSx for NetApp ONTAP as transfer endpoints.

Automated Data Validation

Automatically verify data integrity using checksums at both source and destination to ensure byte-for-byte data consistency after transfer.

Scheduled Transfers

Configure recurring scheduled transfers on hourly, daily, or weekly cadences for ongoing data synchronization between systems.

On-Premises Agent

Deploy the DataSync agent VM on-premises to connect local NFS and SMB storage to AWS without opening inbound firewall ports.

Bandwidth Throttling

Control the network bandwidth consumed by DataSync transfers to minimize impact on production workloads during business hours.

CloudWatch Integration

Monitor transfer metrics, task execution history, and set up alarms for failed transfers using Amazon CloudWatch.

Use Cases

Data Center Migration

Migrate petabytes of data from on-premises NAS and SAN systems to Amazon S3 or EFS during cloud adoption and data center exit projects.

Ongoing Hybrid Synchronization

Keep on-premises and cloud storage in sync on a scheduled basis for hybrid cloud architectures and distributed workloads.

Backup and Archive to Cloud

Transfer on-premises file data to Amazon S3 Glacier for cost-effective long-term archival and backup storage.

Data Distribution

Transfer datasets between AWS Regions or across AWS accounts for data sharing, disaster recovery, or multi-region analytics.

HPC Data Staging

Stage large datasets from S3 or on-premises storage to FSx for Lustre for high-performance computing workloads on AWS.

Semantic Vocabularies

Amazon Datasync Context

0 classes · 3 properties

JSON-LD

API Governance Rules

Amazon DataSync API Rules

18 rules · 13 errors 4 warnings 1 info

SPECTRAL

JSON Structure

Agent Structure

0 properties

JSON STRUCTURE

Create Location S3 Request Structure

0 properties

JSON STRUCTURE

Create Task Request Structure

0 properties

JSON STRUCTURE

Create Task Response Structure

0 properties

JSON STRUCTURE

Error Structure

0 properties

JSON STRUCTURE

Location Structure

0 properties

JSON STRUCTURE

Options Structure

0 properties

JSON STRUCTURE

Task Execution Structure

0 properties

JSON STRUCTURE

Task List Entry Structure

0 properties

JSON STRUCTURE

Task Structure

0 properties

JSON STRUCTURE

Example Payloads

Agent Example

4 fields

EXAMPLE

Create Location S3 Request Example

3 fields

EXAMPLE

Create Task Request Example

3 fields

EXAMPLE

Create Task Response Example

1 fields

EXAMPLE

Error Example

2 fields

EXAMPLE

Location Example

3 fields

EXAMPLE

Options Example

5 fields

EXAMPLE

Task Example

5 fields

EXAMPLE

Task Execution Example

5 fields

EXAMPLE

Task List Entry Example

3 fields

EXAMPLE

Resources

DeveloperPortal

DeveloperPortal

Documentation

TermsOfService

PrivacyPolicy

GitHubOrganization

GitHubOrganization

StackOverflow

SpectralRules

Sources

opencollection: 1.0.0
info:
  name: Amazon DataSync REST API
  version: '2018-11-09'
request:
  auth:
    type: apikey
    key: Authorization
    value: '{{Authorization}}'
    placement: header
items:
- info:
    name: Default
    type: folder
  items:
  - info:
      name: Amazon DataSync Create Task
      type: http
    http:
      method: POST
      url: https://datasync.{region}.amazonaws.com/
      body:
        type: json
        data: '{}'
    docs: Configures a task, which defines where and how DataSync transfers your data.
- info:
    name: '#ListTasks'
    type: folder
  items:
  - info:
      name: Amazon DataSync List Tasks
      type: http
    http:
      method: POST
      url: https://datasync.{region}.amazonaws.com/#ListTasks
      body:
        type: json
        data: '{}'
    docs: Returns a list of the DataSync tasks you created.
- info:
    name: '#DescribeTask'
    type: folder
  items:
  - info:
      name: Amazon DataSync Describe Task
      type: http
    http:
      method: POST
      url: https://datasync.{region}.amazonaws.com/#DescribeTask
      body:
        type: json
        data: '{}'
    docs: Provides information about a DataSync transfer task.
- info:
    name: '#StartTaskExecution'
    type: folder
  items:
  - info:
      name: Amazon DataSync Start Task Execution
      type: http
    http:
      method: POST
      url: https://datasync.{region}.amazonaws.com/#StartTaskExecution
      body:
        type: json
        data: '{}'
    docs: Starts an existing DataSync task. By starting a task, you tell DataSync to immediately begin transferring data.
- info:
    name: '#CreateLocationS3'
    type: folder
  items:
  - info:
      name: Amazon DataSync Create Location S3
      type: http
    http:
      method: POST
      url: https://datasync.{region}.amazonaws.com/#CreateLocationS3
      body:
        type: json
        data: '{}'
    docs: Creates a transfer location for an Amazon S3 bucket.
- info:
    name: '#CreateAgent'
    type: folder
  items:
  - info:
      name: Amazon DataSync Create Agent
      type: http
    http:
      method: POST
      url: https://datasync.{region}.amazonaws.com/#CreateAgent
      body:
        type: json
        data: '{}'
    docs: Activates an AWS DataSync agent that you've deployed in your storage environment.
bundled: true