System components

Checker, or Store Manager interface: A management interface with the data store that can update the store with new records and purge old or invalid ones. The Store Manager will be an interface between the Validator and the data store. Fresh data will be passed to the Checker in the form of RDF objects for storage. Stale or invalid data messages will passed to the Checker to purge records.
Indexer: A component that extracts metadata from source documents in a standard format that can be passed through to the data store. One or more indexer types will process input from the Validator component. If any errors occur, these will be passed to the Checker to purge records.
Spider: A component that traverses Web hyperlinks to obtain source documents to pass to the Validator for further processing. The Spider encapsulates the all the functions necessary to generate structured input for the Validator and pushes the indexing process. It may also pass stale or invalid data messages to the Store Manager interface to purge the data store.
Query Engine: A component that provides an interface between the public face of the system and the back-end data store. The system will ultimately accept queries using a range of mechanisms, so the Query Engine will serve as an adapter to shape queries into a standard format and pass these to the Query Processor. Defining a standard Query object, will also enable query results to be cached.

This document was last modified by Philip Shaw on 2004-10-28 02:58:17
Copyright MKDoc Ltd. and others.
The Free Documentation License http://www.gnu.org/copyleft/fdl.html

Sign up

System components