ó áp7]c@sêdZddlmZddlZddlmZmZddlj Z ddl m Z ddl mZmZmZdZdZd Zd Zd Zd Zd Zd„Zd„Zd„Zd„Zdefd„ƒYZdefd„ƒYZdefd„ƒYZdefd„ƒYZ de fd„ƒYZ!de fd„ƒYZ"de fd„ƒYZ#d „Z$e%d!kræd"Z&d#Z'ej(e'dƒj)e'dƒZ*ej+j,e'dƒZ*ej-d$d%dgƒZ.ej-d&d&d&gƒZ.e.Z/ej0e*e/ƒd'ej+j,e'ƒZ1ej0ej2j3e*ƒe1ƒZ4e5ed7ee&e*ƒƒe*j6d(ƒZ7e5e*j6d(ƒƒed8ee*fd)d*ƒZ8e5e8ee8e7ƒƒe5ed9ee*fd)d*ƒƒe5ed:ee1e*fd)d*ƒd%ej0e*j9e*ƒƒe5e j:e.ed+e1e*fƒd(d%ej0e*j9e*ƒƒe* d%e1ej0e*d$d%dgƒdd…dfZ<ed;ee1e*fd)d*ƒZ=e jd<ee&e1e*fƒZ>e5ee=e<ƒƒe5ee>e<ƒƒe j?j@jAd,eBƒZCe jDeCjEd-eBƒeC_Ee jFeCjGeCjEƒZHd$d.d/d0gZIeHjJZJeHjKZKeHjLZMe5d1eKeIƒƒe5d2e jeIeJe&ƒƒe5d3e jeIeJƒƒe5d1eMeIƒƒe5d2e jeIeKe&ƒƒe5d3e jeIeKƒƒe jeIeJƒZNe5d3eNƒe5eeMeIƒeNƒƒe j?jOjAd,eBƒZCeCjEZEe jDeEd-eBƒZEe jPeCjGeEƒjQd4d5d6d(ƒZRe j?jSjAd,eBƒZTeUeTjGƒZ'e jDeTjEjVeWƒj)e'dƒd-eBƒZXe jYeTjGeXƒZZeZjQd4d5d6d(ƒZ[ndS(=sßTesting numerical differentiation Still some problems, with API (args tuple versus *args) finite difference Hessian has some problems that I didn't look at yet Should Hessian also work per observation, if fun returns 2d iÿÿÿÿ(tprint_functionN(tassert_almost_equaltassert_allclose(tnumdiff(t approx_fprimetapprox_fprime_cstapprox_hess_csiiiiii icCstj||ƒjƒS(N(tnptabstmax(txty((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pytmaxabsscCstj||ƒjdƒS(Ni(Rtdottsum(tbetaR ((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pytfunscCstj||ƒ}||dS(Ni(RR (RR R txb((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pytfun1scCst|||ƒjdƒS(Ni(RR(RR R ((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pytfun2$stCheckGradLoglikeMixincBseZd„Zd„ZRS(cCsŒx…|jD]z}|jj|ƒ}tj|jƒ|jjƒ}t||ddƒtj|jƒ|jjƒ}t||ddƒq WdS(Ntdecimalii ( tparamstmodtscoreRRtraveltloglikeRR(tselft test_paramstsctscfdtsccs((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyt test_score+scCsxÿ|jD]ô}|jj|ƒ}tj||jjƒ}t||dtƒt||ddƒtj||jjdt ƒ}t ||ddƒtj||jjdt ƒ}t||ddƒtj|j ƒ|jjƒ}t ||ddƒtj |j ƒ|jjƒ}t ||ddƒ|jj|ƒ}tj||jjdd t ƒ\}}t||dd ƒt||dd ƒtj||jjd d t ƒ\}}t||dd ƒt||dd ƒtj||jjd ƒ}t||ddƒq WdS(NRitcenteredtrtolg•Ö&è .>ig‚vIhÂ%<=gíµ ÷Æ°>t return_gradig-Cëâ6?igñh㈵øä>(RRthessianRRRRtDEC8RtTrueRtFalseRRRt approx_hess1t approx_hess2t approx_hess3(RRthethefdthescsthecstgradtgradcs((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyt test_hess6s8  (t__name__t __module__R R1(((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyR*s tTestGradMNLogitcBs eZed„ƒZd„ZRS(cCstjjjdtƒ}|j}tj|dtƒ}tj|j|ƒ|_ |j j ddƒ}|j j dƒg|_ dS(Nt as_pandastprependtdispitF( tsmtdatasetstanes96tloadR'texogt add_constanttMNLogittendogRtfitRR(tclstdataR=tres((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyt setup_class]s  cCsQxJ|jD]?}|jj|ƒ}tj||jjƒ}t||dtƒt||ddƒtj||jjdt ƒ}t||ddƒtj||jjddt ƒ}t||ddƒtj||jjƒ}t||dtƒtj ||jj ƒ}t||ddƒtj ||jj dƒ}t||dd ƒq WdS( NRiR!ig•Ö&è .>iig-Cëâ6?i(RRR$RRRRR%RR&R'RRR*(RRR+R,R-R.((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyR1ms"  (R2R3t classmethodRER1(((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyR4\st TestGradLogitcBseZed„ƒZRS(cCsstjjjdtƒ}tj|jdtƒ|_tj|j|jƒ|_ t j ddddgƒg|_ dS(NR5R6igÐ?gffffffö?iùÿÿÿ( R9R:tspectorR<R'R>R=tLogitR@RRtarrayR(RBRC((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyREs(R2R3RFRE(((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRGŒstCheckDerivativeMixincBsSeZed„ƒZed„ƒZd„Zd„Zd„Zd„Zd„Z RS(cCsæd}tjjdƒtjj|dƒ}tjdddgƒ}tjdddgƒ}|}tj||ƒdtjj|ƒ}tjtjj|ƒ|ƒ}||_||_ tjdddgƒ|g|_ |j ƒdS(NiÈiÝiiigð?gš™™™™™¹?( RtrandomtseedtrandnRJR tlinalgtpinvR R Rtinit(RBtnobsR txkRR txkols((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRE›s&  !cCsdS(N((RB((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRQ®sc Csx–|jD]‹}|j|ƒ}|jƒ}d}tj||d|d|jƒ}|tj||d| d|jƒ7}|d:}t||dtƒq WdS(Ngíµ ÷Æ°>tepsilontargsg@R(RtgradtrueRRRRVRtDEC6(RRtgtrueRRUtgfd((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyttest_grad_fun1_fd²s    c Csmxf|jD][}|j|ƒ}|jƒ}tj||ddd|jdtƒ}t||dtƒq WdS(NRUg:Œ0âŽyE>RVR!R( RRWRRRRVR&RtDEC5(RRRYRRZ((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyttest_grad_fun1_fdc¿s  cCsaxZ|jD]O}|j|ƒ}|jƒ}tj||d|jƒ}t||dtƒq WdS(NRVR(RRWRRRRVRtDEC13(RRRYRtgcs((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyttest_grad_fun1_csÊs  cCsÌxÅ|jD]º}|j|ƒ}|dk r |jƒ}tj||d|jƒ}t||dtƒtj ||d|jƒ}t||dtƒtj ||d|jƒ}t||dtƒq q WdS(NRVR( RthesstruetNoneRRR(RVRtDEC3R)R*(RRthetrueRR,((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyttest_hess_fun1_fdÓs     cCspxi|jD]^}|j|ƒ}|dk r |jƒ}tj||d|jƒ}t||dtƒq q WdS(NRVR( RRaRbRRRRVRRX(RRRdRR.((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyttest_hess_fun1_csés   ( R2R3RFRERQR[R]R`ReRf(((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRKšs tTestDerivativeFuncBs2eZed„ƒZd„Zd„Zd„ZRS(cCsktt|ƒjƒtjtjj|jƒ|jƒ}tj dddgƒ|g|_ |jf|_ dS(Ngð?( tsuperRgRERR RORPR R RJRRV(RBRT((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyREôs$!cCstS(N(R(R((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRûscCs|jjdƒS(Ni(R R(RR((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRWýscCs tjdƒS(Ni(ii(Rtzeros(RR((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRaÿs(R2R3RFRERRWRa(((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRgós  tTestDerivativeFun2cBs2eZed„ƒZd„Zd„Zd„ZRS(cCsqtt|ƒjƒtjtjj|jƒ|jƒ}tj dddgƒ|g|_ |j|jf|_ dS(Ngð?( RhRjRERR RORPR R RJRRV(RBRT((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyREs$!cCstS(N(R(R((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyR scCsI|j|j}}| d|tj||ƒdd…dfjdƒS(Nii(R R RR RbR(RRR R ((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRWscCs |j}dtj|j|ƒS(Ni(R RR tT(RRR ((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRas (R2R3RFRERRWRa(((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRjs  tTestDerivativeFun1cBs2eZed„ƒZd„Zd„Zd„ZRS(cCsqtt|ƒjƒtjtjj|jƒ|jƒ}tj dddgƒ|g|_ |j|jf|_ dS(Ngð?( RhRlRERR RORPR R RJRRV(RBRT((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyREs$!cCstS(N(R(R((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRscCs@|j|j}}| d|tj||ƒdd…dfS(Ni(R R RR Rb(RRR R ((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRW!scCsDdS|j|j}}| d|tj||ƒdd…dfS(Ni(RbR R RR (RRR R ((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRa$s(R2R3RFRERRWRa(((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyRls  cCsd„}tjddgddggƒ}tttjddgƒ|ƒ|ƒtttjddgƒ|ƒ|ƒtttjdd gƒ|ƒ|ƒdS( NcSsd|S(Ni((R ((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pytf+siiigð?g@yyð?y@(RRJRR(Rmtdesired((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyt test_dtypes*s  %%t__main__gíµ ÷Æ°>iÈiigð?gš™™™™™¹?ithg#B’ ¡œÇ;gü©ñÒMbP?R5R6gÐ?gffffffö?iùÿÿÿR9tfdtcstmethodtnewtonR7(iii(iii(iii(iii(iii(iii(\t__doc__t __future__RtnumpyRt numpy.testingRRtstatsmodels.apitapiR9tstatsmodels.toolsRtstatsmodels.tools.numdiffRRRRctDEC4R\RXR%R^tDEC14R RRRtobjectRR4RGRKRgRjRlRoR2RURRtarangetreshapeR RLRNRJRSRR R RORPRTtprintRRWR0Rkt approx_hessRbtgttgtgdR:RHR<R'RCR>R=RIR@RRRRR$thessthesscsR;R?RAtres1trandhietdataptlentviewtfloattexogptPoissontmodptresp(((sClib/python2.7/site-packages/statsmodels/tools/tests/test_numdiff.pyts”     20Y &9=8     '$