Use Case 08 - Replication Policy CommunicationΒΆ

View document revision history.
Communication of replication policy metadata between Member Nodes and Coordinating Nodes.

The replication policy of Member Nodes (MN) indicates factors such as the amount of storage space available, bandwidth constraints, the types of data and metadata that can be managed, and perhaps access control restrictions. This information is used by Coordinating Nodes (CN) to balance the distribution of data packages throughout the DataONE system to achieve the goals of data package persistence and accessibility.

Initial implementation of the infrastructure emphasizes the preservation goals of replication, i.e. ensuring sufficient copies of data and metadata objects are available to ensure ongoing access to the content. The replication system offers the possibility of more dynamic control over the flow of information between systems to support science research. For example, the replication services may be exploited as a mechanism for staging data in preparation for experiments at HPC nodes or centers.

Member Node, Coordinating Node
  • Member Node is registered with a Coordinating Node
  • Member Node is operational
  • A Member Node changes available capacity, bandwidth or some other operating characteristic
  • A Member Node changes available services
  • A Member Node software stack is updated (e.g. new version)
Post Conditions
  • The DataONE system is updated with current state of available resources
  • Change in replication policy may trigger adjustments to content that is replicated to that node (e.g. if storage capacity shrinks or is enlarged)
  • Operation is logged
  • Watchers are notified in change in DataONE system property

Figure 1. Use case 08.


Figure 2. Communication of Replication Policy Metadata


  • The goal as stated originally for this use case was “Communication of replication policy metadata among Member Nodes and Coordinating Nodes.”
  • There should be some restriction on how often replication policy can be changed to avoid thrashing that might occur for example, if a MN flips between significant differences in storage capacities (low to high, then low again).