ó ‡ˆ\c@sìdZddlZddlZddlmZmZddlmZddlmZddlm Z ddlm Z ddl m Z dd l mZdd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlmZddlmZddlm Z ddl!m"Z"m#Z#ej$ƒZ%e%j&dd…dd…fe%j'Z(Z)ej*j+dƒej*j+dƒd„ƒƒZ,ej*j+dƒej*j+dƒd„ƒƒZ-ej*j+dƒej*j+dƒd„ƒƒZ.ej*j+dƒej*j+dƒej*j+dƒd„ƒƒƒZ/ej*j+dƒd„ƒZ0ej*j+dƒej*j+dƒej*j+dƒd„ƒƒƒZ1ej*j+dƒej*j+dƒej*j+dƒd „ƒƒƒZ2ej*j+dƒej*j+dƒej*j+dƒd!„ƒƒƒZ3d"„Z4ej*j+dƒej*j+dƒej*j+dƒd#„ƒƒƒZ5ej*j+dƒej*j+dƒej*j+dƒd$„ƒƒƒZ6ej*j+dƒej*j+dƒej*j+dƒd%„ƒƒƒZ7d&„Z8ej*j+dƒej*j+dƒej*j+dƒd'„ƒƒƒZ9ej*j+dƒej*j+dƒej*j+dƒd(„ƒƒƒZ:ej*j+dƒej*j+dƒej*j+dƒd)„ƒƒƒZ;ej*j+dƒej*j+dƒej*j+dƒd*„ƒƒƒZ<dS(+s Testing for the VotingClassifieriÿÿÿÿN(tassert_almost_equaltassert_array_equal(tassert_array_almost_equal(t assert_equal(tassert_raise_message(tassert_warns_message(tNotFittedError(tLogisticRegression(t GaussianNB(tRandomForestClassifier(tVotingClassifier(t GridSearchCV(tdatasets(tcross_val_score(tmake_multilabel_classification(tSVC(tOneVsRestClassifier(tKNeighborsClassifier(t BaseEstimatortClassifierMixiniis&ignore: Default solver will be changeds ignore: Default multi_class willcCs{tdgƒ}d}tt||jttƒtddƒ}tdd|fgddƒ}d}tt||jttƒtdd|fgd dd gƒ}d }tt||jttƒtdd|fd|fgd dd gƒ}d }tt||jttƒtdd |fgƒ}d}tt||jttƒtdd|fgƒ}d}tt||jttƒdS(Nt estimatorss[Invalid `estimators` attribute, `estimators` should be a list of (string, estimator) tuplest random_stateitlrtvotingterrors5Voting must be 'soft' or 'hard'; got (voting='error')tweightsisLNumber of classifiers and weights must be equal; got 2 weights, 1 estimatorss+Names provided are not unique: ['lr', 'lr']tlr__s1Estimator names must not contain __: got ['lr__']sCEstimator names conflict with constructor arguments: ['estimators'](R RtAttributeErrortfittXtyRt ValueError(teclftmsgtclf((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_estimator_inits($cCsMtddtƒfdtƒfgddƒ}d}tt||jtƒdS(NRtlr1tlr2Rthards1predict_proba is not available when voting='hard'(R RRRt predict_probaR(R R!((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_predictproba_hardvoting@s  cCsMtddtƒfdtƒfgddƒ}d}tt||jtƒdS(NRR$R%RtsoftsqThis VotingClassifier instance is not fitted yet. Call 'fit' with appropriate arguments before using this method.(R RRRR'R(R R!((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_notfittedJs  s(ignore:The default value of n_estimatorscCs’tddƒ}tddƒ}tƒ}tdd|fd|fd|fgddƒ}t|ttd d d d ƒ}t|jƒd ddƒdS(s7Check classification by majority label on dataset iris.Ri{RRtrftgnbRR&tcvitscoringtaccuracygffffffî?tdecimaliN( RR RR R RRRtmean(tclf1tclf2tclf3R tscores((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_majority_label_irisUs ! cCsÇtddddddƒ}tddƒ}tdd|fd |fgd d ƒ}t|jttƒjtƒd d ƒt|jttƒjtƒd dƒt|jttƒjtƒd dƒdS(sECheck voting classifier selects smaller class label in tie situation.Ri{t multi_classtovrtsolvert liblinearRRR+RR&iIiiN(RR R RRRRtpredict(R2R3R ((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_tie_situationds  &&c Cs¡tddƒ}tddƒ}tƒ}tdd|fd|fd|fgddd d d d gƒ}t|ttd dddƒ}t|jƒddd ƒdS(s>Check classification by average probabilities on dataset iris.Ri{RRR+R,RR)Riii R-iR.R/gÃõ(\Âí?R0N( RR RR R RRRR1(R2R3R4R R5((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_weights_irisqs !c CsOtddƒ}tddƒ}tƒ}tjddgddgddgd d gd d gd dggƒ}tjddddddgƒ}tt|j||ƒj|ƒƒtddddddgƒƒtt|j||ƒj|ƒƒtddddddgƒƒtt|j||ƒj|ƒƒtddddddgƒƒt dd|fd|fd|fgddddddgƒ}tt|j||ƒj|ƒƒtddddddgƒƒt dd|fd|fd|fgddddddgƒ}tt|j||ƒj|ƒƒtddddddgƒƒdS(s6Manually check predicted class labels for toy dataset.Ri{gš™™™™™ñ¿gø¿g333333ó¿gffffffö¿g333333 Àgš™™™™™Àgš™™™™™ñ?g333333ó?gÍÌÌÌÌÌ@gffffffö?gÍÌÌÌÌÌ@gffffff@iiRRR+R,RR&RR)N( RR RtnptarrayRtallRR;R (R2R3R4RRR ((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_predict_on_toy_problems.     !@@@!@!c Csõtddƒ}tddƒ}tƒ}tjddgddgddgd d ggƒ}tjd d d d gƒ}tjd dgddgddgddggƒ}tjddgddgddgddggƒ}tjddgddgddgddggƒ}d |dd|dd|ddd }d |d d |d d |d d d } d |d d |d d |d d d } d |d!d |d!d |d!d d } td"d#|fd$|fd%|fgd&d'd(d d d gƒ} | j||ƒj|ƒ} t|| ddd)d ƒt| | d d d)d ƒt| | d d d)d ƒt| | d!d d)d ƒt j t d*d+ƒNtd"d#|fd$|fd%|fgd&d,ƒ} | j||ƒj|ƒWd-QXd-S(.s1Calculate predicted probabilities on toy dataset.Ri{gš™™™™™ñ¿gø¿g333333ó¿gffffffö¿g333333 Àgš™™™™™Àgš™™™™™ñ?g333333ó?iig…7sa"ã?gö=ñ»Ù?g½¤Rhpâ?gℶZ/Û?glç^Ô¬;à?g(1BW¦ˆß?gµU(V6ÁÙ?g&ÕëÔdã?gš™™™™™é?gš™™™™™É?g333333Ó?gffffffæ?gá5ùwÇóï?g9=” qX?gè_óï?g$ö/ÐAY?ggð?iiiRRR+R,RR)RR0tmatchs1predict_proba is not available when voting='hard'R&N( RR RR>R?R RR'RtpytesttraisesR(R2R3R4RRtclf1_restclf2_restclf3_restt00tt11tt21tt31R teclf_res((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyt!test_predict_proba_on_toy_problem¤sJ 3      ....! ! c Cs‡tdddddtddƒ\}}ttdd ƒƒ}td d |fgd d ƒ}y|j||ƒWntk r‚dSXdS(s7Check if error is raised for multilabel classification.t n_classesitn_labelsitallow_unlabeledRi{tkerneltlinearRR8RR&N(RtFalseRRR RtNotImplementedError(RRR"R ((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_multilabel×s cCsËtddƒ}tddƒ}tƒ}tdd|fd|fd|fgddƒ}id d gd 6dd gd6d d d gd d d ggd6}td|d|ddƒ}|jtjtjƒdS(sCheck GridSearch support.RiRRR+R,RR)gð?gY@tlr__CR&gà?Rt estimatort param_gridR-iN( RR RR R Rtiristdatattarget(R2R3R4R tparamstgrid((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_gridsearchæs !  "cCs;tddƒ}tddƒ}tƒ}tjddgddgddgd d ggƒ}tjd d d d gƒ}td d|fd|fd|fgdddd ƒj||ƒ}td d|fd|fd|fgdddd ƒj||ƒ}t|j|ƒ|j|ƒƒt |j |ƒ|j |ƒƒdS(s:Check parallel backend of VotingClassifier on toy dataset.Ri{gš™™™™™ñ¿gø¿g333333ó¿gffffffö¿g333333 Àgš™™™™™Àgš™™™™™ñ?g333333ó?iiRRR+R,RR)tn_jobsN( RR RR>R?R RRR;RR'(R2R3R4RRteclf1teclf2((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_parallel_fitús 3!!c Cstddƒ}tddƒ}tdddtddƒ}tdd|fd|fd |fgd d ƒjttd tj t tƒfƒƒ}tdd|fd|fd |fgd d ƒjttƒ}t |j tƒ|j tƒƒt |jtƒ|jtƒƒtjjdƒjd t tƒfƒ}tdd|fgd d ƒ}|jtt|ƒ|jtt|ƒt |j tƒ|j tƒƒt |jtƒ|jtƒƒtƒ}tdd|fd |fd|fgd d ƒ}d}tt||jtt|ƒdS(s1Tests sample_weight parameter of VotingClassifierRi{tgammatscalet probabilityRRR+tsvcRR)t sample_weighttsizetknns;Underlying estimator 'knn' does not support sample weights.N(RR RtTrueR RRRR>tonestlenRR;RR'trandomt RandomStatetuniformRRR( R2R3R4R`RaRgteclf3tclf4R!((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_sample_weights.!-!' ! cCsldttfd„ƒY}|ƒ}tdd|fgddƒ}|jttdtjttƒfƒƒdS( s:Check that VotingClassifier passes sample_weight as kwargstMockClassifiercBseZdZd„ZRS(sAMock Classifier to check that sample_weight is received as kwargsc_sd|kst‚dS(NRg(tAssertionError(tselfRRtargsRg((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyR6s(t__name__t __module__t__doc__R(((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyRs4sRtmockRR)RgN( RRR RRRR>RkRl(RsR"R ((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_sample_weight_kwargs2s cCs¢tddddƒ}tddddƒ}tƒ}td|fd|fgdd d d d gƒ}d|jksxt‚|jj|jd d ks›t‚|jj|jdksºt‚|j t t ƒd|j ksßt‚|j j|j d ksþt‚|j j|j dkst‚td|fd|fgdd d d d gƒ}|jd|ƒj t t ƒt|dƒ st‚t|jt ƒ|jt ƒƒt|jt ƒ|jt ƒƒt|jd d jƒ|jƒƒt|jd d jƒ|jƒƒ|jddƒ|jddƒ|jd d jƒddksLt‚|jd d jƒddksst‚t|jƒd|jƒdjƒdƒdS(s+set_params should be able to set estimatorsRi{tCgð?t max_depthRR+RR)RiiitnbRVg$@t nb__max_depthiN(RR tNoneRR tnamed_estimatorsRtRRRRRtnamed_estimators_t estimators_t set_paramsthasattrRR;RR'Rt get_params(R2R3R4R`Ra((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_set_params@s4 !#!$$''c CsÕtddƒ}tddƒ}tƒ}tdd|fd|fd|fgddd d d d gƒjttƒ}tdd|fd|fd|fgddd d d d gƒ}|jddƒjttƒt |j tƒ|j tƒƒt |j ƒddks t ‚t|jƒd ks&t ‚td„|jDƒƒsEt ‚|jƒddksat ‚|jddƒjttƒ|jddƒjttƒt |j tƒ|j tƒƒt|jtƒ|jtƒƒd}tt||jddddddƒjttƒtjd gd ggƒ}tjd d gƒ}tdd|fd|fgddd d d gdtƒj||ƒ}tdd|fd|fgddd d d gdtƒ}|jddƒj||ƒt|j|ƒtjddgddggddgddgggƒƒt|j|ƒtjddgddgggƒƒ|jddƒ|jddƒt |j|ƒtjd d gd d ggƒƒt |j|ƒtjd gd ggƒƒdS(sDVotingClassifier set_params should be able to set estimators as NoneRi{RRR+R~RR&Riigà?icss$|]}t|ttfƒVqdS(N(t isinstanceRR(t.0test((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pys zsR)sEAll estimators are None. At least one is required to be a classifier!tflatten_transformgffffffæ?g333333Ó?gð?gN(RR RR RRRR„R€RR;tdictRRtRlRƒR@R†RR'RRR>R?RSt transform(R2R3R4R`RaR!tX1ty1((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_set_estimator_noneesT $ . 1cCsÊtddƒ}tddƒ}tdd|fd|fgdddgd d ƒ}tdd|fd|fgdtjd ƒd d ƒ}|jttƒ|jttƒt|j tƒ|j tƒƒdS( NRi{RRR+RiiRR)(ii( RR R R>R?RRRRR'(R2R3R`Ra((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_estimator_weights_formatžs   c Csøtddƒ}tddƒ}tƒ}tjddgddgddgd d ggƒ}tjd d d d gƒ}td d|fd|fd|fgddƒj||ƒ}td d|fd|fd|fgdddtƒj||ƒ}td d|fd|fd|fgdddtƒj||ƒ}d}t t ||j |ƒ} t | j dƒt |j |ƒj dƒt |j |ƒj dƒt| jdd ƒjdƒ|j |ƒƒt|j |ƒjdd ƒjdƒ|j |ƒƒdS(s:Check transform method of VotingClassifier on toy dataset.Ri{gš™™™™™ñ¿gø¿g333333ó¿gffffffö¿g333333 Àgš™™™™™Àgš™™™™™ñ?g333333ó?iiRRR+R,RR)R‹sŠ'flatten_transform' default value will be changed to True in 0.21. To silence this warning you may explicitly set flatten_transform=False.iiiiN(iii(ii(iii(ii(ii(RR RR>R?R RRjRSRtDeprecationWarningRRtshapeRtswapaxestreshape( R2R3R4RRR`RaRptwarn_msgtres((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyttest_transform²s6 3!!! !(=RyRCtnumpyR>tsklearn.utils.testingRRRRRRtsklearn.exceptionsRtsklearn.linear_modelRtsklearn.naive_bayesRtsklearn.ensembleR R tsklearn.model_selectionR tsklearnR R tsklearn.datasetsRt sklearn.svmRtsklearn.multiclassRtsklearn.neighborsRt sklearn.baseRRt load_irisRYRZR[RRtmarktfilterwarningsR#R(R*R6R<R=RARMRUR^RbRrR{R‡RR‘R˜(((sLlib/python2.7/site-packages/sklearn/ensemble/tests/test_voting_classifier.pyts€   )   !  !!!!1 !!! !#!7!