PSY274H5 Lecture Notes - Bigram, Information Extraction, Dual-Tone Multi-Frequency Signaling
Document Summary
1. comprehension: extracting info from language: generation: process of conveying information using language. Automated systems that perform language-related tasks like phone-operated systems. How language comprehension and generation occurs in humans. Statistical methods: uses large corpora of data to compute statistical properties such as word-occurrence and sequence formation. A bigram statistic captures the probability of a word with certain properties following another word with other properties. It can identify speech labels like nouns and verbs. They are used for semantic disambiguation and structural disambiguation. Structural/pattern-based method: they define structural properties of language like formal grammars. They use lexical, syntactic and semantic information that match sentence fragments. They provide structural models that help with detailed analysis of linguistic phenomena. But they can t always rely on automatic training and hence, they have to look at hand constructed rules. Reasoning-based approach: encode knowledge and reasoning processes and use these to interpret language. Interpretation of language highly depends on the context in which language appears.
