Some highlights in the history of modeling language Socrates 470-349BC (structure of arguments) Bool (formal description of logic) [Shannon & Weaver 49] (information theory) [Turing 50] (describe processes) [Chomsky 57] Syntactic Structures [Katz & Fodor 63] The Structure of a Semantic Theory [Chomsky 65] Aspects of the Theory of Syntax [Zwicky et al. 65] (the MITRE TGG based parser) [Weisenbaum 66] ELIZA MT Winograd and many others [Winograd 72] Understanding Natural Language [Woods 73] LUNAR [Schank 75] Conceptual Information Processing [MARGIE] [Hendrix 77] LIFER . . .
She is a light house keeper. (you need to hear this example)
Some concepts
The book's version of the history of linguistics
1.3 The Computational Paradigm Stored Processes Assigned Knowledge Structures Phonological Rules Phonological Sounds Morphological rules Dictionary (items) Morphological Phonemes Grammar rules Lexical Morphemes Dictionary (definitions) Syntactic (parsing) Words Semantic rules Semantic Syntactic structures Deductive rules Reasoning Representation structures Inferential rules Figure 1-5. A stratified model of language comprehension.
NORMAL SAMPLE PARSER input text parser parse tree semantic deep (or other) interpreting structure [semantic net]
Chapter 2: Linguistic Background: An Outline of English Active Sentence Passive Sentence Jack saw the ball. The ball was seen by Jack. I will find the clue. The clue will be found by me. Jack hit me. I was hit by Jack. Figure 2.9 Active sentences with corresponding passive sentences
Sentence with Indirect Object Equivalent Form Jack gave Sue a book. Jack gave a book to Sue. Jack found me a book. Jack found a book for me. Figure 2.10 Indirect object forms
Syntactic Processing Tense Structure Example present progressive be in present + He is walking. present participle past progressive be in past + He was walking. present participle future progressive will + be in infinitive He will be walking. + present participle past perfect have in present + He has been walking. progressive be in past participle + present participle future perfect will + have in present He will have been walking. progressive + be as past participle + present participle pluperfect have in past + He had been walking. progressive be in past participle + present participle Figure 2.7 The progressive aspect
First Second Third singular I am you are he is I walk you walk she walks plural we are you are they are we walk you walk they walk Figure 2.8 Person/number forms of verbs
Chapter 2: Linguistic Background: An Outline of English Person Number First Second Third he (masculine) singular I you she (feminine) it (neuter) plural we you they Figure 2.1 Pronoun system (as subject)
Person Number First Second Third his singular my your her its plural our your their Figure 2.2 Pronoun system (possessives)
Person Number First Second Third him singular me you her it plural us you them Figure 2.3 Pronoun system (as object)
Chapter 2: Linguistic Background: An Outline of English Mood Example declarative (or assertion) The cat is sleeping. yes/no question Is the cat sleeping? wh- question What is sleeping? or Which cat is sleeping? imperative (or command) Shoot the cat! Figure 2.4 Basic moods of sentences Form Examples Example Uses infinitive hit, cry, Hit the ball! go, be I want to go. simple present hit, cries, The dog cries every day. go, am I am thirsty. simple past hit, cried, I was thirsty. went, was I went to the store. present participle hitting, crying, I'm going to the store. going, being Being the last in line aggravates me. past participle hit, cried, I've been there before. gone, been The cake was gone. Figure 2.5 The five verb forms
Tense Structure of Verb Group Example simple present simple present He walks to the store. simple past simple past He walked to the store. simple future will + infinitive He will walk to the store. past perfect have in present He has walked to the store. (or present/past) + past participle future perfect will + have in I will have walked to the store. infinitive + past participle pluperfect have in past + I had walked to the store. (or past/past) past participle Figure 2.6 The basic tenses
The TGG system assumes (?) that simple syntactic changes (or paraphrasing) does not change the meaning. These simple paraphrases may make important changes to a systemic grammarian. For my birthday my husband embroidered this jacket. My husband embroidered this jacket for my birthday. This jacket was embroidered by my husband for my birthday. This jacket, my husband embroidered for my birthday. This jacket is what my husband embroidered for my birthday. What my husband embroidered for my birthday was this jacket. What my husband did for my birthday was embroider this jacket. It was my husband that embroidered this jacket for my birthday. It was this jacket that my husband embroidered for my birthday. It was for my birthday that my husband embroidered this jacket. Notice the changes in theme.
Brace p339 Fillmore's case system A agent C counting agent O object R result I instrument S source G goal E experience "open" can be used in forms may (1) The door opened. (O) (2) John opened the door. (AD) (3) The wind opened the door. (IO) (4) John opened the door with a chisel. (AOI) The case forms for "open" is [O(A)(I)] [where () means optimal]
Building systems that work MT Bar - Hillel [64] The pen is in the box. The baby is in the pen. Winograd [72] SHRDLU systemic grammar semantic grammar Woods [73] LUNAR ["What is the average concentration of aluminum in high alkali rocks?"] Schank [75] MARGIE Hendrix [77] LIFER up-scaling (problems of size) Hendrix [75] Partitioned Networks Grosz [ ] Focus layers in parsing vs. heterogenous control building larger representations Schank Scripts Bobrow [77] GUS - Frames
FIGURE 1 EXAMPLE INTERACTIONS WITH LIFER 1 - What is the salary of Eric Johnson? PARSED! (ID 327-36-8172 SALARY 19250) 2 - Position and date hired? Trying Ellipsis: WHAT IS THE POSITION AND DATE HIRED OF ERIC JOHNSON (ID 327-36-8172 POSITION Assoc-Prof DATE-HIRED 8/1/70) 3 - Of Robert Morgan Trying Ellipsis: WHAT IS THE POSITION AND DATE HIRED OF ROBERT MORGAN (ID 437-26-1190 POSITION Assis-Prof DATE-HIRED 6/1/73) 4 - Employee 282-93-5307 Trying Ellipsis: WHAT IS THE POSITION AND DATE HIRED OF EMPLOYEE 282-93-5307 (ID 282-93-5307 POSITION Secretary DATE-HIRED 3/13/69) 5 - Of professors in the computer science department Trying Ellipsis: WHAT IS THE POSITION AND DATAE HIRED OF PROFESSORS IN THE COMPUTER SCIENCE DEPT (ID 131-20-8462 POSITION Prof DATE-HIRED 8/1/55) (ID 416-16-2749 POSITION Prof DATE-HIRED 8/1/74) (ID 179-80-1360 POSITION Prof DATE-HIRED 1/1/63) (ID 257-58-3058 POSITION Prof DATE-HIRED 15/7/71) (ID 207-49-9271 POSITION Prof DATE-HIRED 8/1/69) 6 - What is the average salary and age for math department secretaries AVERAGE <== spelling PARSED! SALARY 5 items accepted Average is 7631.4999 AGE 4 items accepted [Note: the birth date of one Average is 28.1471 secretary was the value N/A for not available] 7 - Maximum Trying Ellipsis: WHAT IS THE MAXIMUM SALARY AND AGE FOR MATH DEPARTMENT SECRETARIES SALARY 10730 AGE 32 8 - What assistant Professors in computer science were hired after 1975 Trying Ellipsis: ELLIPSIS HAS FAILED THE PARSER DOES NOT EXPECT THE WORD "COMPSCI" TO FOLLOW "WHAT ASSISTANT PROFESSOR IN". Options for next word or meta symbol are: [DEPARTMENT-NAME] [DEPARTMENT] 9 - What is a [DEPARTMENT-NAME] PARSED! [DEPARTMENT-NAME] may be any member of the set {ANTHRO, ANTHROPOLOGY ART BS BUSINESS ... CS ... ZOO
some regularities in English adjacency [det] [noun] [det] [adj] [adj] [noun] [noun] [verb] [verb] [det] [adj] [adj] linear pattern S {[det]} [adj]*[noun][verb]{[det]}[adj]*[noun]} but there are patterns within the pattern We would like to name these patterns as we named the categories for the words (DET, ADJ ...). S NP V {NP} NP {DET} ADJ* N NOTE that this naming of concepts within concepts allows us to build structures similar to the head modifier structures. SENTENCE: The glorious sun will shine in the winter. ((The (glorious sun))((will shine)(in (the winter)))) |------------| |----------| |----| np2 vp2 np2 |------------------| |----------| np np |---------------| pp |----------------------------------------------------| s