Electronic Records Archiving Research: PAT and TPAP Projects

Transcontinental Persistent Archives Prototype (TPAP) Project (2006)

The SLAC Archives and History Office one of the collaborators with the San Diego Supercomputer Center, an NSF sponsored program, and the University of Maryland on research and development for a Transcontinental Persistent Archive Prototype (TPAP). The TPAP research is funded by the National Archives and Records Administration (NARA).

Note: Some links on this page open pdf files, which require the free Acrobat Reader.

TPAP Project activities at SLAC

• Working Documents/Drafts

  • Metadata Development for the Persistent Archives Testbed (PAT) Project: slides. SAA 2007 Metadata Roundtable, Chicago IL.
  • 21ST Century Tools For Archivists: A Progress Report on Persistent Archives at the Stanford Linear Accelerator Center (SLAC): slides. NAGARA 2007, Kansas City, MO.
  • PAWN presentations to the National Archives Assembly, July 2006:
    Jean Deken (SLAC): slides and notes
    Mike McGann (UMIACS): slides
  • SLD Matrix for Pawn by Mark Conrad, NARA ERA. (Maps SLD records to DOE schedule and provides PAWN Categories for the SLD records series.)
  • SLAC Metadata Scheme v.8
  • SDSC Crawl Sorted by URL Root -- Refined, V.3. Jean Deken. 25 April 2007

  TPAP Project Resources

  • Department of Energy Research and Development Records Control Schedule, 8/25/2003
  • NARA NWM 05.2001: Guidelines to Agencies on Preserving a Snapshot of Their Web Sites at the End of the Clinton Administration. Attachment to Memorandum to CIOs, January 12, 2001
  • NARA Records Management-Electronic Records Management (ERM) Initiative Guidance Products
    • Web Content Records Guidance
  • PAWN Producer-Archive Workflow Network homepage.
  • PAWN: Producer - Archive Workflow Network in Support of Digital Preservation. Mike Smorul, Joseph JaJa, Yang Wang, and Fritz McCall. Institute for Advanced Computer Studies, University of Maryland. UMIACS-TR-2004, 2004.
  • PREMIS Working Group (PREservation Metadata: Implementation Strategies)
  • Research Libraries Group and NARA. An Audit Checklist for the Certification of Trusted Digital Repositories. Draft for Public Comment. RLG Mountain View, August 2005.
  • Storage Resource Broker (SRB)

  TPAP / PAT Project in the news ...

  • Award-Winning TPAP Digital Preservation Prototype Keeps Growing by Paul Tooby. D-Lib Magazine, July/August 2007, Volume 13 Number 7/8
  • Building Preservation Environments with Data Grid Technology, by Reagan W. Moore. American Archivist, Volume 69 Number 1, Spring/Summer 2006.
  • San Diego Supercomputer Center Staff Help Nation's Archivists with Digital Preservation Expertise
  • IDEA Award Winner 2006. Transcontinental Persistent Archives Prototype (PAT Project)
  • PAT Project Lessons Learned: Part 2, IT Professionals' Perspectives archival outlook march/april 2006 p. 8 and 27. (Society of American Archivists, Chicago)
  • PAT Project Lessons Learned: Archivists' Perspectives archival outlook november/december 2005 p.10-11, 23. (Society of American Archivists, Chicago)
  • "The Fading Memory of the State" by David Talbot, Technology Review.com, MIT: July 2005.

Persistent Archives Testbed (PAT) Project (2003-2006)

The SLAC Archives and History Office participated in the Persistent Archives Testbed (PAT) Project, a collaboration between the San Diego Supercomputer Center (SDSC), the University of Maryland (UMD) and several other institutions. Funding for the project was provided by the National Archives and Records Administration (NARA) and the National Partnership for an Advanced Computational Infrastructure (NPACI) .

PAT Project participants are conducting case studies that test the ability to implement the SDSC's Storage Resource Broker (SRB) data grid technology in the archiving of electronic records.

General information about the PAT project

• PAT Project press release
• A Pilot Persistent Archive: Partnership Between SDSC, UMD, and NARA. Reagan Moore, San Diego Supercomputer Center (SDSC), Joseph JaJa, University of Maryland Institute for Advanced Computer Studies (UMIACS), Robert Chadduck, National Archives and Records Administration (NARA). Presentation from "Partnerships in Innovation" Conference, November 15-16, 2004.

PAT Project activities at SLAC

At SLAC, the SRB technology is being implemented to archive the electronic records of the SLAC Large Detector (SLD) Collaboration.

• Working Documents/Drafts

  • PAWN presentations to the National Archives Assembly, July 2006:
    Jean Deken (SLAC): slides and notes
    Mike McGann (UMIACS): slides
  • SLD Matrix for Pawn by Mark Conrad, NARA ERA. (Maps SLD records to DOE schedule and provides PAWN Categories for the SLD records series.)
  • PAT Project SLD records descriptions (FY2006, Version 5) Includes some manually constructed draft metadata sets.
  • SLAC PAT presentation (PowerPoint) to Future Proof III, Preserving the Records of Science, Strasbourg France 19-21 April, 2006
  • SLAC PAT Metadata Scheme - v7 (Working Document - January 2006). The skeleton has enough flesh on it now: it has graduated to being a scheme.
  • DOE R&D Records Schedule
  • SLAC PAT Metadata Discussions (Working Document - 2005)
  • SDSC Crawl Sorted by URL Root -- Refined. Jean Deken. 31 May 2005
  • SDSC Crawl Sorted by URL Root. Wilko Kroeger. 31 May 2005.
  • Archiving SLD Records in SRB: The Persistent Archives Testbed (PAT) Project at SLAC in 2004. A Briefing for Future Proof II, 20-22 April 2005, Munich DE.
  • Deken, Jean and Hasan, Adil. Archiving SLD Records in SRB: The Persistent Archives Test-Bed (PAT) Project at SLAC in 2004. SLAC-PUB-10857, December 2004.
  • PAT Project SLD records descriptions (2004)
  • SLD Collaboration description

   

PAT Project Resources

• Department of Energy Research and Development Records Control Schedule | pdf | html|
• NARA NWM 05.2001: Guidelines to Agencies on Preserving a Snapshot of Their Web Sites at the End of the Clinton Administration. Attachment to Memorandum to CIOs, January 12, 2001
• NARA Records Management-Electronic Records Management (ERM) Initiative Guidance Products
  • Web Content Records Guidance
• PAWN Producer-Archive Workflow Network.
• PAWN: Producer - Archive Workflow Network in Support of Digital Preservation. Mike Smorul, Joseph JaJa, Yang Wang, and Fritz McCall. Institute for Advanced Computer Studies, University of Maryland. UMIACS-TR-2004, 2004.
• PREMIS Working Group (PREservation Metadata: Implementation Strategies)
• Research Libraries Group and NARA. An Audit Checklist for the Certification of Trusted Digital Repositories. Draft for Public Comment. RLG Mountain View, August 2005.