bitsdoor.com

System for Migrating and Backing up

Large Volumes of Files and Objects

Application Scenarios and Pain Points

The legacy storage device requires decommissioning.

The current storage device is running out of capacity.

Competitor tools have slower migration speeds.

Lack of support for incremental migration.

Open-source tools are command-line only and not user-friendly.

Need for secure offsite backups.

FAQ

Q: What is this tool used for?

A: This tool is designed to help users migrate or back up massive amounts of unstructured data from one data center to another.

Q: Why use this tool instead of open-source products for data migration/backup?

A: Open-source tools typically require command-line operations, which are complex and difficult to configure. They have a high learning curve and often come with limitations such as restrictions on the maximum number of files that can be processed. Our solution provides a graphical user interface (GUI), making it easy to operate and clearly displaying the entire migration process. Additionally, it offers faster migration speeds and supports a larger number of files. For more details, please refer to the Comparison of Migration Solutions section.

Q: How do I migrate or back up data from Data Center A to Data Center B?

A: First, perform a full migration to copy all data from Data Center A to Data Center B. Then, conduct several incremental migrations to transfer any newly added data to Data Center B.

Q: What are full data and incremental data? What are full migration and incremental migration?

A: Full data refers to all the data currently stored in the storage device at a given point in time.Incremental data refers to the new data written to the storage device within a specific time period.Full migration means migrating all the data stored in a storage device at a certain point in time to another storage device.Incremental migration means transferring only the new data generated between the last migration time and the current time to another storage device.Generally speaking, full migration takes longer, while incremental migration is faster and more efficient.

Q: What types of data migration are supported by the migration/backup solution?

A: This solution supports the migration of massive volumes of unstructured data between NAS and object storage devices.

Q: Will the migration/backup operations affect normal business operations?

A: No. Migration/backup operations are performed in a side-mounted manner and does not modify the I/O access path of the business data. Additionally, various methods are available to control the impact of migration/backup on the storage device's I/O performance, ensuring no disruption to normal business operations. These controls can be easily configured through the graphical user interface and take effect immediately after being updated.

Q: How is data integrity and consistency ensured during the migration/backup process?

A: A patented algorithm is used to ensure that the directory structure and data remain fully consistent before and after migration/backup.

Q: How can the task status be monitored and managed during the migration/backup process?

A: The migration/backup tasks can be easily viewed and managed through a graphical user interface. The migration speed and file transfer rate are displayed in real time. From the GUI, users can also start or stop tasks, configure QoS policies, set task execution start times, and schedule recurring task cycles.

The difference between MassPorter and Rsync, Rclone.

MigrationType	Full / Incremental	Incremental	Full / Incremental
Protocol Support	S3, FTP, NFS, SMB, WebDAV, Any Local File Systems	SSH, rsync protocol	S3, FTP, WebDAV
Destination Storage Support	Object Storages, File Systems	File systems	Object Storages, File Systems
Source Storage Support	Object Storages, File Systems	File systems	Object Storages, File Systems
Cross-Protocol Migration	NFS->S3, S3->NFS
Error Handling / Logging	Rich	Basic logging	Advanced logging
Authentication Methods	Tokens, Keys	SSH keys	Tokens, Keys
UI / UX	Web UI / API	CLI	CLI
Scalability	hundreds of PB scale	Limited by system	Scales well
Fault Tolerance	Retry logic and HA	Minimal	Retry Logic
Observability / Metrics Export	Prometheus / Logs		Some logging, not metrics
Bandwidth Throttling
Transfer Resumption / Retry
Parallel / Multi-threaded Transfer
Data Integrity Checks
Scheduling / Automation
Cloud Native Integration
Migration Progress Status
Operation Auditing
Resume Interrupted Migration Tasks
License / Cost	Commercial	Open source (GPL)	Open source (MIT)

Notes: = Support = Partial Support = Not Support

Advantages of the Solution

Lightweight Sidecar Design

No changes required to the application IO path during migration/synchronization.

High Efficiency

Fast migration with significantly lower CPU and memory usage.

Seamless Incremental Migration

No impact on live business operations.

Web-Based Interface

Visualize migration progress and system status with ease.

Flexible Go-Live Timing

enabling deployment before migration or disaster recovery or during ongoing data transfer

Case Study: Object Storage Data Migration

Solution Overview

Migrate image data from one vendor's object storage to another vendor's object storage.

Key Benefits

Blazing-fast Migration Performance

Achieved 600–700MB/s migration speed, far exceeding the customer's expectations.

High-Efficiency Resource Utilization

Used only 1/3–1/2 the computing resources of competitors.

Intelligent QoS Policy

Intelligent QoS policies maintained business continuity.

Case Study: Insurance Industry

Solution Overview

To migrate data from over twenty NAS devices in Data Center A (City A) to Data Center B (City B).

Use the NAS in City A as the primary storage and periodically synchronize incremental data to City B.

Key Benefits

Delta Data Synchronization

Enabled incremental data sync between two data centers.

Intelligent Bandwidth Optimization

QoS-managed bandwidth optimized network usage.

Visual Monitoring Dashboard

Intuitive interface clarified progress and performance.