DataONE Architecture

The Data Observation Network for Earth (DataONE) is an NSF funded project in the DataNet program charged with implementing and deploying core services and infrastructure to improve the long term accessibility and re-use of data collected through NSF funded and other research projects.

These documents provide the reference for implementation of services and tools that together form the DataONE cyberinfrastructure.

Note

These documents are subject to ongoing revision. Please consider subscribing to the DataONE project or discussing with project members before investing effort in implementing services or other activities dependent on information contained in these documents.

The source for these documents is located in the subversion repository. For hints on editing, please review About These Documents. The HTML version of the document is generated from the current version of the source documents and is available from:

http://mule1.dataone.org/ArchitectureDocs/

The footer of each page contains a link to the source for the page and to the subversion revision history for the page.

Design Documents

• DataONE Overview
• User Scenarios
• Use Cases
• Node Identity and Registration
• What is Data (DataONE Perspective)?
• Data Packaging
• DataONE Preservation Strategy
• Identifiers in DataONE
• Content Discovery
• Supporting Online Citation Managers through COinS
• Querying DataONE
• Identity Management and Authenticated Session Management
• Authorization in DataONE
• System Metadata
• Getting a Handle on Systems Metadata for the Long Haul
• Natural History of System Metadata
• Supporting Access Control in Search
• Analysis and Modeling Tools
• Investigator Toolkit
• Serialization of Types for Transfer Over HTTP
• Event Logging and Reporting
• NodeList
• DataONE Cybersecurity Plan
• Coordinating Node Internals
• Log Aggregation Overview

API Reference

• DataONE APIs
  • REST Interface Overview
    • Message Serialization
    • Parameters in Requests
    • REST Endpoint Summary
  • Member Node APIs
    • Core API
    • Read API
    • Authorization API
    • Storage API
    • Replication API
  • Coordinating Node APIs
    • Core API
    • Read API
    • Authorization API
    • Identity API
    • Replication API
    • Register API
  • Investigator Toolkit APIs
  • Data Types in CICore
  • Data Types from SAML used in CICore
  • Exceptions Raised by MN and CN APIs
    • General
    • HTTP Exception Handling Codes
    • Serializing Exception Information
    • The Exceptions
  • Infrastructure Monitoring APIs
  • APIs Internal to Coordinating Nodes

Implementation Notes

• Implementation Notes
  • Implementation Roadmap
  • Components of the DataONE Infrastructure
  • Implementation Priority
  • Integration Testing
  • Infrastructure Versions

Notes and Miscellanea

• General Design and Implementation Notes
  • Logging and Privacy concerns
  • Cross Domain Indexing and Access for Data and Metadata
  • Replication Notes
  • Notes for MN API
  • Coordinating Node Requirements
  • Apache Configuration for DataONE Services
  • Mutability of Metadata
  • Selectors for Data Package Components
  • Time and Bandwidth Constraints
  • Proposal for API Refactoring
• License and Copyright Policy
  • Copyright
  • Open source licensing
  • Copyright and license notification
• Acknowledgements
• About These Documents
  • Editing Content
  • Building the Documentation
• Glossary
• Change Log
  • 2012-05-31: Version 1.0, Correction to URIs in Resource Maps
  • 2012-05-02: Version 1.0, MethodCrossReference.xls
  • 2012-05-01: Version 1.0, MethodCrossReference.xls
  • 2012-03-26: Version 1.0, MethodCrossReference.xls
  • 2012-03-26: Version 1.0, MethodCrossReference.xls
  • 2012-03-25: Version 1.0, MethodCrossReference.xls
  • 2012-02-27: Version 1.0, MethodCrossReference.xls
  • 2012-02-24 : dataoneTypes.xsd
  • 2012-02-17 : Version 1.0, MethodCrossReference.xls
  • 2012-02-15 : Version 1.0, MethodCrossReference.xls
  • 2012-02-02 : Version 1.0, MethodCrossReference.xls
  • 2012-02-01 : Version 1.0, MethodCrossReference.xls
  • 2012-01-20 : Version 1.0, MethodCrossReference.xls
  • 2012-01-19 : Version 1.0, MethodCrossReference.xls
  • 2012-01-12 : Version 1.0, MethodCrossReference.xls
  • 2012-01-10 : Version 1.0, MethodCrossReference.xls
  • 2012-01-03 : Version 1.0, MethodCrossReference.xls
  • 2011-12-19 : Version 1.0, dataoneTypes.xsd
  • 2011-12-13 : Version 1.0
  • 2011-12-12 : Version 1.0
  • 2011-12-08 : Version 1.0
  • 2011-12-06 Version 1.0.0 Branch
  • 2011-12-05 Version 1.0.0 Branch
  • 2011-11-08 Version 1.0.0 Branch
  • 2011-11-03 Version 1.0.0 Branch
  • 2011-11-02 Version 1.0.0 Branch
  • 2011-11-01 Version 1.0.0 Branch
  • 2011-10-26 Version 1.0.0 Branch

Indices, Tables, and Change Log

• Index
• Module Index
• Search Page