`]c@ sddlmZmZmZddlZddlmZddlmZddl Z ddl m Z ddl m Z mZmZmZddlmZmZmZmZmZddlmZdd lmZdd lmZid d 6d d 6dd6dd6dd6d d6ZdddgZedefdYZede fdYZ!defdYZ"defdYZ#d e!fd!YZ$d"e"fd#YZ%dd$Z&e'd%kre&ndS(&i(tprint_functiontdivisiontunicode_literalsN(tchain(t string_types(tCounter(t UnigramTaggert BigramTaggert TrigramTaggert RegexpTagger(t ExpressiontVariabletVariableExpressiontLambdaExpressiontAbstractVariableExpression(tpython_2_unicode_compatible(tdrt(t linearlogicuex_quantuauanu univ_quantueveryudef_artutheuno_quantunoudefaultunmoduvmodupunctt GlueFormulacB szeZd dZdZdZdZdZd dZdZ dZ dZ d Z d Z d ZRS( cC s|st}nt|tr6tj||_n4t|trQ||_ntd||jft|trtj j ||_ n7t|tjr||_ ntd||jf||_ dS(Nu1Meaning term neither string or expression: %s, %su.Glue term neither string or expression: %s, %s( tsett isinstanceRR t fromstringtmeaningt RuntimeErrort __class__RtLinearLogicParsertparsetgluetindices(tselfRRR((s,lib/python2.7/site-packages/nltk/sem/glue.pyt__init__+s"   cC s|j|j@r,tjd||fn|j|jB}y"tj|j|j|j}Wn9tjk rtjd|j|jfnX|j}|rxI|jjjjdddD]"}|j t d||}qWn|jj |}|j |||S(u self = (\x.(walk x), (subj -o f)) arg = (john , subj) returns ((walk john), f) u0'%s' applied to '%s'. Indices are not disjoint.u'%s' applied to '%s'Niuv%s( RRtLinearLogicApplicationExceptiontApplicationExpressionRtsimplifyRt antecedentt dependenciestmake_LambdaExpressionR tapplytoR(Rtargtreturn_indicest return_gluetarg_meaning_abstractedtdeptreturn_meaning((s,lib/python2.7/site-packages/nltk/sem/glue.pyR%Es$# cC s t|S(N(R (Rtname((s,lib/python2.7/site-packages/nltk/sem/glue.pytmake_VariableExpressionfscC s t||S(N(R (Rtvariabletterm((s,lib/python2.7/site-packages/nltk/sem/glue.pyR$iscC sdt|tstt|jts-t|j|j|jj|jtj |j |j S(N( RRtAssertionErrorRRRR$R.Rt ImpExpressionR(Rtother((s,lib/python2.7/site-packages/nltk/sem/glue.pytlambda_abstractls cC sb|st}n|jjj||j\}}||j|j|t|jggS(u)From Iddo Lev's PhD Dissertation p108-109(RRR!t compile_posRRRtget(Rtcountert compiled_gluet new_forms((s,lib/python2.7/site-packages/nltk/sem/glue.pytcompilets  cC s(|j|jj|jj|jS(N(RRR!RR(R((s,lib/python2.7/site-packages/nltk/sem/glue.pyR!scC s4|j|jko3|j|jko3|j|jkS(N(RRR(RR2((s,lib/python2.7/site-packages/nltk/sem/glue.pyt__eq__scC s ||k S(N((RR2((s,lib/python2.7/site-packages/nltk/sem/glue.pyt__ne__scC st|t|kS(N(tstr(RR2((s,lib/python2.7/site-packages/nltk/sem/glue.pyt__lt__scC sft|jtstd|j|jf}|jrb|ddjd|jDd7}n|S(Nu%s : %su : {u, cs s|]}t|VqdS(N(R<(t.0tindex((s,lib/python2.7/site-packages/nltk/sem/glue.pys su}(RRRR0RRtjoin(Rtaccum((s,lib/python2.7/site-packages/nltk/sem/glue.pyt__str__s  +cC sd|S(Nu%s((R((s,lib/python2.7/site-packages/nltk/sem/glue.pyt__repr__sN(t__name__t __module__tNoneRR%R-R$R3R9R!R:R;R=RBRC(((s,lib/python2.7/site-packages/nltk/sem/glue.pyR)s  !        tGlueDictcB seZddZedZdZddedZdZ dZ dZ dZ dZ d Zd Zd Zd Zd ZdZRS(cC s ||_||_|jdS(N(tfilenamet file_encodingt read_file(RRHtencoding((s,lib/python2.7/site-packages/nltk/sem/glue.pyRs  cC s]|r|jny(tjj|jddd|j}WnYtk r}y,tjjd|jddd|j}Wqtk r|qXnX|j}x|D]}|j}t |sqn|ddkrqn|j dd}g}d}d} d} d} t |d kr0xt |d D]\} } | d kru|dkrh| d } n|d 7}q7| d kr|d 8}|dkr)|d | | !}|d | d | !}|j ||gq)q7| d kr|d kr)| } q)q7| dkr7|dkr%td |nPq7q7Wnt |dkr|djdd }|djd}||krt} qtd|d||!j d D} nyS|djd }|djd }|d| j}|d|d |!}Wn|dj}d}nX||kr=i||tr((s,lib/python2.7/site-packages/nltk/sem/glue.pys s(tcleartnltktdatatloadRHRIt LookupErrort splitlinesRMtlentsplitRFt enumeratetappendRR?t frozensettextend(Rt empty_firsttcontentstetlinestlinetpartst glue_formulast paren_countt tuple_startt tuple_commat relationshipstitct meaning_termt glue_termt rel_starttrel_endtstart_inheritancetend_inheritancetsemt supertypetrelsR((s,lib/python2.7/site-packages/nltk/sem/glue.pyRJs   #                      *      cC sd}x|D]}d|}x||D]}d}x|||D]}|dkrf||d7}n|dt|d7}|d|7}|r|t|||kr|d|7}n|d7}|d7}qCWq(Wq W|S( Nuu%siu: u iu : %su (RU(RRAtpoststr_postrelsetRftgf((s,lib/python2.7/site-packages/nltk/sem/glue.pyRBs     c C s|dkr_|jd}tt|dj}|j|d}|j||t|S|j|||}xJt|djD]2} |j| } |j|j|| ||qW|S(Niudeps( RFtnodestlistRtvaluestto_glueformula_listRtlookupRZ( RtdepgraphtnodeR6tverbosettoptdepListtroott glueformulastdep_idxR*((s,lib/python2.7/site-packages/nltk/sem/glue.pyRx+s   cC s|j|}d}x(|D] }||kr||}PqqW|dkrPgS|j|||j|||}t|std|d|d|dfn|j||d|||S(NuKThere is no GlueDict entry for sem type of '%s' with tag '%s', and rel '%s'uwordutagurel(t get_semtypesRFtadd_missing_dependenciest_lookup_semtype_optionRUtKeyErrort#get_glueformulas_from_semtype_entry(RR{RzR6t semtype_namestsemtypeR,Ry((s,lib/python2.7/site-packages/nltk/sem/glue.pyRy<s      "cC s|dj}|dkr||j|d}|jd||}|d}|dj|g|d|j|dndS(Nurelumainuheadusubjudepsuaddress(tlowerRut lookup_uniquet setdefaultRX(RR{Rztreltheadnodetsubjtrelation((s,lib/python2.7/site-packages/nltk/sem/glue.pyRVs  c stfdt|djD}y||}Wntk rt}xNt|tdgD]3}t|t|krm||krm|}qmqmW|sd|krd}qdSn||}nX|S(Nc3 sC|]9}j|djtkrj|djVqdS(urelN(RuRtOPTIONAL_RELATIONSHIPS(R>R*(Rz(s,lib/python2.7/site-packages/nltk/sem/glue.pys csudeps(RYRRwRRRFRU(RRR{RzReRyt best_matcht relset_option((Rzs,lib/python2.7/site-packages/nltk/sem/glue.pyRas"        cC sz|dj}|dj}|dkrQ|tkrCt|gStdgSn%|d krk|d|gS|dgSdS( uj Based on the node, return a list of plausible semtypes in order of plausibility. ureluworduspecudefaultunmoduvmodutagN(unmoduvmod(Rt SPEC_SEMTYPES(RR{Rtword((s,lib/python2.7/site-packages/nltk/sem/glue.pyRs    c C sg}|j}x|D]\}} ||j||| } t|sX|| _nd|t|df| _|j| j|||j| _|j| qW|S(Nu%s%si(tget_GlueFormula_factorytget_meaning_formulaRURtinitialize_labelsRR5RX( RRyRR{RzR6RtglueFormulaFactoryRRRt((s,lib/python2.7/site-packages/nltk/sem/glue.pyRs   $cC s"|jdd}|jd|S(u :param generic: A meaning formula string containing the parameter "" :param word: The actual word to be replace "" u.uu(treplace(RtgenericR((s,lib/python2.7/site-packages/nltk/sem/glue.pyRscC st|tjr`|j|jj|||}|djrPtj|Stj|Sn:tj |j |j ||||j |j |||SdS(Ni( RRtAtomicExpressiontfind_label_nameR,RtisupperR tConstantExpressionR1RR"t consequent(RtexprR{Rzt unique_indexR,((s,lib/python2.7/site-packages/nltk/sem/glue.pyRs! c C sy}|jd}|| }||d}|dkrW|j||j|d||S|j||j|||||SWntk r|j|}|dkr|S|dkrd|S|dkrd |S|dkr|j|j|dS|d krd |j|fS|d kr@|j|jd ||S|dkrh|j|jd||S|j|j|||SnXdS(Nu.iusuperuheadufuvu%svuru%sruvaru%s%suauconjaubuconjb(R?RRuRt ValueErrort get_labeltupper( RR,R{RzRtdott before_dott after_dottlbl((s,lib/python2.7/site-packages/nltk/sem/glue.pyRs:           cC s|d}dddddddd d d d d ddddddddddddddg|d}t|d}|dkr|t|S|SdS( u Pick an alphabetic character as identifier for an entity in the model. :param value: where to index into the list of characters :type value: int uaddressufuguhuiujukulumunuoupuqurusutuuuvuwuxuyuzuaubucudueiiiN(tintR<(RR{tvaluetlettertnum((s,lib/python2.7/site-packages/nltk/sem/glue.pyRs@   cC sgt|djD]6}|j|dj|jkr|j|^q}t|dkrtd|d|fn7t|dkrtd|d|fn|dSdS( u\ Lookup 'key'. There should be exactly one item in the associated relation. udepsureliu#'%s' doesn't contain a feature '%s'uwordiu&'%s' should only have one feature '%s'N(RRwRuRRUR(RRR{RzR*tdeps((s,lib/python2.7/site-packages/nltk/sem/glue.pyRs6cC stS(N(R(R((s,lib/python2.7/site-packages/nltk/sem/glue.pyRsN(RDRERFRtTrueRJRBtFalseRxRyRRRRRRRRRR(((s,lib/python2.7/site-packages/nltk/sem/glue.pyRGs  u      $ + tGluecB szeZd ed edZd dZdZdZdZdZ dZ dZ dZ d Z d ZRS( cC sh||_||_||_ddlm}||_|rI||_ntjj ddd|_dS(Ni(tProver9ugrammarsusample_grammarsu glue.semtype( R|tremove_duplicatest depparserRPRtprovert semtype_filetostpathR@(RRRRR|R((s,lib/python2.7/site-packages/nltk/sem/glue.pyR s      cC sK|r|jj|n.|jjtjjtjjddddS(Nugrammarsusample_grammarsuglue_train.conll( Rttrainttrain_from_fileRPRQtfindRRR@(Rt depgraphs((s,lib/python2.7/site-packages/nltk/sem/glue.pyttrain_depparser2s   cC s:g}x-|j|D]}|j|j|qW|S(N(tparse_to_compiledRZt get_readings(Rtsentencetreadingstagenda((s,lib/python2.7/site-packages/nltk/sem/glue.pytparse_to_meaning<scC sg}t|}t}t}x9|r_|j}|jj}t|tjrax|D]}yt|jtjr|jj } n tj } |j j || xV||D]J} |j | j @sy|j|j| Wqtjk rqXqqWWqatjk rqaXqaWy||j j|Wq\tk r]|g||j |s!tjjddd}ntj|||||dS(Nugrammarsusample_grammarsudrt_glue.semtype(RRR@RR(RRRRR|((s,lib/python2.7/site-packages/nltk/sem/glue.pyRs cC s t|jS(N(RR(R((s,lib/python2.7/site-packages/nltk/sem/glue.pyRsN(RDRERFRRR(((s,lib/python2.7/site-packages/nltk/sem/glue.pyRsc C sddlm}ddddddg}td tddd d!d"d#d$d%g}|d|}td|dt}xt|D]u\}}||ks|dkrtd||fx-|j|jD]}t|j qWtdqqWdS(&Ni(RuDavid sees MaryuDavid eats a sandwichuevery man chases a doguevery man believes a dog sleepsuJohn gives David a sandwichuJohn chases himselfu"============== DEMO ==============u^(David|Mary|John)$uNNPuN^(sees|eats|chases|believes|gives|sleeps|chases|persuades|tries|seems|leaves)$uVBu!^(go|order|vanish|find|approach)$u^(a)$uex_quantu ^(every)$u univ_quantu.^(sandwich|man|dog|pizza|unicorn|cat|senator)$uNNu^(big|gray|former)$uJJu^(him|himself)$uPRPRRR|u[[[Example %s]]] %su(u^(David|Mary|John)$uNNP(uN^(sees|eats|chases|believes|gives|sleeps|chases|persuades|tries|seems|leaves)$uVB(u!^(go|order|vanish|find|approach)$uVB(u^(a)$uex_quant(u ^(every)$u univ_quant(u.^(sandwich|man|dog|pizza|unicorn|cat|senator)$uNN(u^(big|gray|former)$uJJ(u^(him|himself)$uPRP( RRRR RRRWRRVR!( t show_exampleRtexamplesRRRRfRR((s,lib/python2.7/site-packages/nltk/sem/glue.pytdemos4  u__main__((t __future__RRRRt itertoolsRtsixRRPtnltk.internalsRtnltk.tagRRRR tnltk.sem.logicR R R R Rt nltk.compatRtnltk.semRRRRtobjectRRRGRRRRRRD(((s,lib/python2.7/site-packages/nltk/sem/glue.pyts<  "( s" 2