IBM Cloud Object Storage System 3.14.8 Rebuilder Utility Guide

This guide explains how a IBM Cloud Object Storage System™ maintains data integrity.


IBM Cloud Object Storage System 3.14.8 Rebuilder Utility Guide - cover page
Brand
IBM
Category
Storage
Document type
User Manual
Language
English
Pages
16
File format
PDF
File size
458 KB
Published
30 November, 2023
Updated
30 November, 2023
MD5 checksum
E9636F75E7F75D488906FDD1F929775F

About this manual

This guide explains how IBM Cloud Object Storage System maintains data integrity through a group of software agents collectively known as the Rebuilder. It covers the scanning, rebuild, integrity, and synchronization agents, bandwidth usage for rebuild operations, and the theory of operation of the prioritized rebuilder.

The Rebuilder detects missing or corrupted Slices, reconstructs them from remaining Slices, and deprecates Slices that cannot be reconstructed. Rebuild activity is scheduled adaptively so that it becomes more aggressive when client I/O utilization drops and reduces its rate when client performance is affected.

What's inside

  • Document information
  • Intended purpose and audience
  • Data challenges on a dsNet system
  • Agents
  • Scanning agent
  • Rebuild agents
  • Integrity agent
  • Bandwidth usage
  • Prioritized rebuilder
  • Rebuild queue

Specifications

Full scan duration48 hours
Integrity checksum4-byte CRC32 checksum
Example annual data rebuild rate80 TB
Example total annual rebuild network traffic1600 TB
Example individual annual Slicestor rebuild traffic2.8 TB
Example per-appliance average rebuild traffic435.52 KBps

Frequently asked questions

What agents make up the IBM Cloud Object Storage System Rebuilder?

The Rebuilder includes the Scanning Agent, Rebuild Agent, Integrity Agent, and Synchronization Agent.

How long does a full scan of the system take?

A full scan should take 48 hours, so any issue with a Slice is detected within 48 hours.

How does the Rebuilder respond to changes in client I/O activity?

When client operations increase, the Rebuilder decreases its activity; when client operations reduce, it increases rebuilding activity as much as possible without negatively impacting client operations.

What happens when a Slice fails its integrity check?

The Slice is deprecated and then rebuilt from the other Slices for that Object on the Slicestor node.

Download PDF (458 KB)

More IBM Manuals


View all IBM manuals →