Archival Stewardship of Email using ePADD Software

Overview and update on ePADD software development from Stanford University Library's Special Collections Dept. (released July 2015) with some notes about future development.

1. Glynn Edwards SAA – August 22, 2015 Director, ePADD Project Archival Stewardship of Email using ePADD Software

2. Developed and funded by:

3. ePADD program

4. Appraisal Module

5. ePADD Technical Information ePADD is written in Java and Javascript and powered by Apache Tomcat (v7.0) using Java EE Servlet API (v3.x) and Java Mail (v1.4.2). Text and metadata extraction, indexing and retrieval is performed by Apache Lucene (v4.7) and Apache Tika (v1.8). Charting and visualization is supported using the D3‑based reusable chart library (v0.4.10). Oracle's Java Application Bundler and Launch4J are used for packaging on Mac and Windows platforms respectively. Other Java libraries from Apache (Lang, commons, CLI, IO, logging, etc.) are also used. JSON formatting is performed with the libraries org.json and Gson .   ePADD has implemented its own natural language processing (NLP) toolkit which is used for named entity extraction, disambiguation and other tasks. This toolkit supplants the Apache OpenNLP used in earlier beta versions of the ePADD software. We continue to use Muse as an internal library within ePADD . However, the Apache OpenNLP proved insufficient for our needs (at least for name recognition), and after various rounds of customization, we built our own named entity recognizer. This toolkit uses external datasets such as Wikipedia/ DBpedia , Freebase, Geonames , OCLC FAST and LC Subject Headings/LC Name Authority File.   The project is developed with IDEs like IntelliJ Idea and Eclipse, built with Apache Maven, Ant, and custom shell scripts, and tracked using Git for source control and issue tracking. The ePADD software client is browser‑based and compatible with Chrome and Firefox. It is optimized for Windows 7 and OSX 10.9/10.10 machines, using Java 7 or 8.

6. Correspondents: Resolving multiple accounts into single entry

7. Actions: do not transfer – restrict - reviewed

8. Processing Module

9. Disambiguation of names

10. Discovery & Delivery (Access)

11. Query generator

12. Upload of CSV files of email addresses for matching with existing archive Search by Date and Date Range 1.1 release - August 2015 New features

13. Future Roadmap Enhance Natural Language Processing Capability Enhance the Processing Module Features Enhance the Discovery/ Delivery Module Features Recommend and Test Preservation Strategy Collaboration with other Platforms & Services Explore Sustainability Model Add Restriction Management/ Annotation Functions Enhance the Error Handling Capability

14. https:/ library.stanford.edu/projects/ epadd https://epadd.nimeyo.com/ @ e_padd [email protected] Glynn Edwards [email protected] Peter Chan [email protected] Josh Schneider [email protected] http:// epadd.stanford.edu/epadd/collections