Importance

Loading Importance Indicators...

Abstract

A system receives an information stream comprising the textual information whose semantic content is to be determined, divides the information stream into a series of elements and classifies each element into one of a plurality of predetermined classifications. The system includes a token generator and a token classifier. The token generator receives the textual information stream, parses the stream to identifies the respective elements, identifies for each element one of a plurality of element types, and generates a token identifying the element type for each element. At least some of the tokens also include a pointer pointing to the actual information associated with the element. The token classifier receives the tokens and classifies them in order. In that operation, the token classifier classifies each token in relation to the token's type, classifications for previously-classified tokens and the types of successive tokens, thereby to determine the semantic content of the information associated with the tokens. After the tokens are classified, the information associated therewith can be loaded into a database system according to their classifications, and conventional database tools used to obtain information therefrom.

Loading the Abstract Image...

First Claim