B P?ð[ñ%ã@s.dZddlmZddlZddlmZddlmZmZm Z m Z ddl m Z ddl mZddlmZe d ¡Ze d ¡Ze d ¡Ze d ej¡Ze d ej¡Ze dej¡Ze d¡ZGdd„deƒZe Gdd„deƒƒZdd„Zdd„Zdd„Zdd„Z dd„Z!d'dd„Z"d(d!d"„Z#ed#ƒd$d%„ƒZ$e#d&ƒZ%dS))z CCG Lexicons é)Úunicode_literalsN)Ú defaultdict)ÚPrimitiveCategoryÚ DirectionÚCCGVarÚFunctionalCategory)Úpython_2_unicode_compatible)Ú deprecated)Ú Expressionz([A-Za-z]+)(\[[A-Za-z,]+\])?z"([A-Za-z]+(?:\[[A-Za-z,]+\])?)(.*)z([\\/])([.,]?)([.,]?)(.*)z([\S_]+)\s*(::|[-=]+>)\s*(.+)z([^{}]*[^ {}])\s*(\{[^}]+\})?z \{([^}]+)\}z([^#]*)(?:#.*)?c@s:eZdZdZd dd„Zdd„Zdd„Zd d „Zd d „ZdS)ÚTokenzÄ Class representing a token. token => category {semantics} e.g. eat => S\var[pl]/var {\x y.eat(x,y)} * `token` (string) * `categ` (string) * `semantics` (Expression) NcCs||_||_||_dS)N)Z_tokenÚ_categÚ _semantics)ÚselfÚtokenÚcategÚ semantics©rú/lib/python3.7/site-packages/nltk/ccg/lexicon.pyÚ__init__=szToken.__init__cCs|jS)N)r )rrrrrBsz Token.categcCs|jS)N)r )rrrrrEszToken.semanticscCs2d}|jdk r dt|jƒd}dt|jƒ|S)NÚz {Ú})r Ústrr )rÚ semantics_strrrrÚ__str__Hs z Token.__str__cCs*t|tƒsdSt|j|jf| ¡| ¡ƒS)Néÿÿÿÿ)Ú isinstancer Zcmpr r rr)rÚotherrrrÚ__cmp__Ns z Token.__cmp__)N) Ú__name__Ú __module__Ú __qualname__Ú__doc__rrrrrrrrrr 1s   r c@s0eZdZdZdd„Zdd„Zdd„Zdd „Zd S) Ú CCGLexiconzâ Class representing a lexicon for CCG grammars. * `primitives`: The list of primitive categories for the lexicon * `families`: Families of categories * `entries`: A mapping of words to possible categories cCs t|ƒ|_||_||_||_dS)N)rÚ_startZ _primitivesZ _familiesÚ_entries)rÚstartÚ primitivesÚfamiliesÚentriesrrrr^s zCCGLexicon.__init__cCs |j|S)z@ Returns all the possible categories for a word )r$)rZwordrrrÚ categoriesdszCCGLexicon.categoriescCs|jS)z; Return the target category for the parser )r#)rrrrr%jszCCGLexicon.startcCsnd}d}x`t|jƒD]R}|s$|d}||d}d}x0|j|D]"}|sR|d}nd}|d|}q@WqW|S)zK String representation of the lexicon. Used for debugging. rTÚ z => z | Fz%s)Úsortedr$)rÚstringÚfirstÚidentÚcatrrrrps  zCCGLexicon.__str__N)rrr r!rr)r%rrrrrr"Ts r"cCs’|dd…}d}xN|dkr^| d¡s^| d¡rDt|ƒ\}}||}q||d}|dd…}qW| d¡r~|d|dd…fStd|dƒ‚dS) zb Separate the contents matching the first set of brackets from the rest of the input. éNú(rú)rzUnmatched bracket in string 'ú')Ú startswithÚ matchBracketsÚAssertionError)r,ÚrestZinsideÚpartrrrr5Šs      r5cCs | d¡rt|ƒSt |¡ ¡S)zb Separate the string for the next portion of the category from the rest of the string r1)r4r5Ú NEXTPRIM_REÚmatchÚgroups)r,rrrÚ nextCategoryžs r<cCst|d|dd…ƒS)z' Parse an application operator rr0N)r)ÚapprrrÚparseApplication¨sr>cCs|r|dd… d¡SgS)z7 Parse the subscripts for a primitive category r0rú,)Úsplit)ZsubscrrrrÚparseSubscripts¯srAcCs¦|ddkr.|ddkr.|dkr&tƒ}||fS|d}||krp||\}}|dkrX|}n| ||fg¡}||fS||kr’t|dƒ}t||ƒ|fStd|dƒ‚dS)zƒ Parse a primitive category If the primitive is the special category 'var', replace it with the correct `CCGVar`. rÚvarr0NzString 'z-' is neither a family nor primitive category.)rZ substituterArr6)Zchunksr&r'rBÚcatstrr/ZcvarZsubscrsrrrÚparsePrimitiveCategory¸s"    rDc Csät|ƒ\}}| d¡r2t|dd…|||ƒ\}}ntt |¡ ¡|||ƒ\}}xŒ|dkrÚt |¡ ¡}t|dd…ƒ}|d}t|ƒ\}}| d¡r°t|dd…|||ƒ\} }ntt |¡ ¡|||ƒ\} }t || |ƒ}qPW||fS)z{ Parse a string representing a category, and returns a tuple with (possibly) the CCG variable for the category r1r0rrré) r<r4ÚaugParseCategoryrDÚPRIM_REr:r;ÚAPP_REr>r) Úliner&r'rBZ cat_stringr7Zresr=Ú directionÚargrrrrFÖs      rFFcCs(t ¡g}i}ttƒ}xü| ¡D]ð}t |¡ ¡d ¡}|dkrFq"|  d¡rv|dd„|dd… ¡  d¡Dƒ}q"t  |¡ ¡\}}}t  |¡ ¡\} } t | ||ƒ\} } |d krÂ| | f||<q"d} |d krü| dkrät|d ƒ‚nt t | ¡ ¡d¡} || t|| | ƒ¡q"Wt|d|||ƒS) z@ Convert string representation into a lexicon for CCGs. rrz:-cSsg|] }| ¡‘qSr)Ústrip)Ú.0Zprimrrrú szfromstring..éNr?z::Tz@ must contain semantics because include_semantics is set to True)rZreset_idrÚlistÚ splitlinesÚ COMMENTS_REr:r;rLr4r@ÚLEX_REÚRHS_RErFr6r Ú fromstringÚ SEMANTICS_REÚappendr r")Úlex_strZinclude_semanticsr&r'r(rIr.ÚsepZrhsrCrr/rBrrrrrU÷s4 $ rUzUse fromstring() instead.cCst|ƒS)N)rU)rXrrrÚ parseLexicon(srZa¡ # Rather minimal lexicon based on the openccg `tinytiny' grammar. # Only incorporates a subset of the morphological subcategories, however. :- S,NP,N # Primitive categories Det :: NP/N # Determiners Pro :: NP IntransVsg :: S\NP[sg] # Tensed intransitive verbs (singular) IntransVpl :: S\NP[pl] # Plural TransVsg :: S\NP[sg]/NP # Tensed transitive verbs (singular) TransVpl :: S\NP[pl]/NP # Plural the => NP[sg]/N[sg] the => NP[pl]/N[pl] I => Pro me => Pro we => Pro us => Pro book => N[sg] books => N[pl] peach => N[sg] peaches => N[pl] policeman => N[sg] policemen => N[pl] boy => N[sg] boys => N[pl] sleep => IntransVsg sleep => IntransVpl eat => IntransVpl eat => TransVpl eats => IntransVsg eats => TransVsg see => TransVpl sees => TransVsg )N)F)&r!Z __future__rÚreÚ collectionsrZ nltk.ccg.apirrrrZ nltk.compatrZnltk.internalsr Znltk.sem.logicr ÚcompilerGr9rHÚUNICODErSrTrVrRÚobjectr r"r5r<r>rArDrFrUrZZopenccg_tinytinyrrrrÚ s6         # 5   ! 1*