90 likes | 102 Views
Learn about the five phases involved in accessing knowledge in free text, including organizing, tagging, parsing, building, and stitching together information. Explore how these phases transform words into objects and create a structured framework for understanding text. Discover how search structures are created and matched to the built structure, allowing for efficient information retrieval.
E N D
Five Phases • Organising, Connecting, Tagging • Parsing • Building • Stitching Together • Searching
Organising, Tagging The structure of the particular knowledge – the clauses of contracts, the threads of emails – is used to guide the reading process. The words are turned into objects, with transformations already occurring during dictionary lookup. The dictionary is changing as the text is read and new definitions are introduced.
Parsing The word objects are built into a chain, and the chain worked on to form a pyramid. Operations move elements of the chain around, cut pieces out and rearrange them. The real properties of the objects are used, as well as their grammatical properties.
Building The pyramidal parsed structure is converted into a net of relations among objects within the sentence and global objects – company names, etc., with states and times. This relation building occurs in parallel with the parsing, and informs it.
Shells Some elements of discourse are more complex than a single relation can describe – several relations are combined into a process. Here is a process for filing a report under FERC regulation section 203. References are made to it through noun phrases – “a 203 filing”.
Switching It On If the discourse is true, a logical state flows down into the structure just built, switching it “on”. The logical state flows into all the relations – the directly stated ones, and the ones that were implicit in noun phrases and prepositional chains, and that are now explicit in structure.
Stitching Together The separate sentences are stitched together into a discourse, and anaphora are resolved. Implied subjects, references to “it did it easily”, more information about something previously mentioned
Searching A search structure is created using free text, and it is then matched to the structure built from the text. These aren’t two different structures – the query structure is anchored in the built structure. Synonym definitions are broadened, so “talk to” and “tell” are synonymous, whereas they are built separately.