B Y>9 @sdZddlmZddlZddlZddlmZddl m Z ddl m Z ddl mZmZmZmZmZmZmZmZmZdd lmZmZmZGd d d e ZGd d d eZGdddeZGdddeZGdddeZGdddeZ GdddeZ!GdddeZ"GdddeZ#GdddeZ$GdddeZ%Gd d!d!eZ&Gd"d#d#eZ'Gd$d%d%e'Z(Gd&d'd'e'Z)d+d(d)Z*eeeee e!e"e#e$d* Z+dS),a Statistical methods used to define or modify position of glyphs. References: Wilkinson L. The Grammer of Graphics, sections 7, 7.1 Method Types: - Bin: Partitions a space before statistical calculation - Summary: Produces a single value comprising a statistical summary - Region: Produces two values bounding an interval. - Smooth: Produces values representing smoothed versions of the input data. - Link: Produces edges from pairs of nodes in a graph. )absolute_importN) string_types)ColumnDataSource)HasProps) BoolDateDatetimeEitherFloatInstanceIntListString)Column ColumnLabel EitherColumnc seZdZdZeddZeeddZe e e e e e e e ee ee edddZe ddZfd d Zd d Zdd dZdddZddZddZZS)StatzRepresents a statistical operation to summarize a column of data. Can be computed from either a ColumnLabel with a ColumnDataSource, *or*, a discrete column of data. zfA column to use for the stat calculation. Required when providing a ColumnDataSource as input.)helpzFOne option for providing the data source for stat calculation.Nz Second option for providing values for stat calculation is by passing the actual column of data.)defaultrz{The value calculated for the stat. Some stats could use multiple properties to provide the calculation if required.c sN|dd}|dk r0t|tjr(t|}||d<tt|jf||dS)Nsource) pop isinstancepd DataFramersuperr__init___refresh)self propertiesr) __class__-lib/python3.7/site-packages/bkcharts/stats.pyr/s  z Stat.__init__cCs |dk r||dS)z;Lazy update of properties, used for initial transform init.N)get_dataupdate calculate)rr!r!r"r9s z Stat._refreshcCsNt|tjrt|}t|tr4||_|dk r:||_n||_||dS)z8Set data properties and update all dependent properties.N) rrrrrcolumnvaluesr$r%)rdatar&r!r!r"set_data?s  z Stat.set_datacCs|jdk rB|jdk s|dk rB|dk r*|}n|j}t|jj|S|jdkrh|jdk rht|jjS|jdk rx|jSdSdS)zAReturns the available columnlabel/source values or column values.N)rr&rZSeriesr(r'to_dfindex)rr&colr!r!r"r#Ns z Stat.get_datacCs tddS)zFReturn transformed value from column label/source or column-like data.z;You must implement the calculate method for each stat type.N)NotImplementedError)rr!r!r"r%^szStat.calculatecCsdS)zDPerform any initial work before the actual calculation is performed.Nr!)rr!r!r"r$csz Stat.update)N)N)__name__ __module__ __qualname____doc__rr&r rrrrr r rrrrr'valuerrr)r#r%r$ __classcell__r!r!)r r"rs    rc@seZdZddZdS)SumcCs||_dS)N)r#sumr2)rr!r!r"r%isz Sum.calculateN)r.r/r0r%r!r!r!r"r4hsr4c@seZdZddZdS)MeancCs||_dS)N)r#meanr2)rr!r!r"r%nszMean.calculateN)r.r/r0r%r!r!r!r"r6msr6c@seZdZddZdS)CountcCs||_dS)N)r#countr2)rr!r!r"r%sszCount.calculateN)r.r/r0r%r!r!r!r"r8rsr8c@seZdZddZdS) CountDistinctcCs||_dS)N)r#nuniquer2)rr!r!r"r%xszCountDistinct.calculateN)r.r/r0r%r!r!r!r"r:wsr:c@seZdZddZdS)MediancCs||_dS)N)r#medianr2)rr!r!r"r%}szMedian.calculateN)r.r/r0r%r!r!r!r"r<|sr<c@seZdZddZdS) StdDeviationcCs||_dS)N)r#stdr2)rr!r!r"r%szStdDeviation.calculateN)r.r/r0r%r!r!r!r"r>sr>c@seZdZddZdS)MincCs||_dS)N)r#minr2)rr!r!r"r%sz Min.calculateN)r.r/r0r%r!r!r!r"r@sr@c@seZdZddZdS)MaxcCs||_dS)N)r#maxr2)rr!r!r"r%sz Max.calculateN)r.r/r0r%r!r!r!r"rBsrBc@s"eZdZdZeddZddZdS)QuantilezProduces the cutpoint that divides the input data by the interval. Quartiles are a special case of quartiles that divide a dataset into four equal-size groups. (https://en.wikipedia.org/wiki/Quantile) g?)rcCs||j|_dS)N)r#quantileintervalr2)rr!r!r"r%szQuantile.calculateN)r.r/r0r1r rFr%r!r!r!r"rDs rDcseZdZdZeeeeZeeeeZ eeeeZ eZ eZ eeeeZ eeedZeZdfdd ZeddZdd Zd d Zd d ZZS)BinzARepresents a single bin of data values and attributes of the bin.)rNc  st|trt|}nt|tr&|g}n t|g}||d<||}t|\}}ddt||D}t|dkr|d}|d}|d}nt|}t|}t|}||d<||d<||d<||d <tt |j f|dS) NlabelcSsg|]\}}||dqS)g@r!).0startstopr!r!r" sz Bin.__init__..rrrJrKcenterr') rtuplelistrstrprocess_boundsziplenrrGr) r bin_labelr'rrZboundsZstartsZstopscenters)r r!r"rs*        z Bin.__init__cCs6|d}dd|D}dd|D}|d|dfS)z.Produce a consistent display of a bin of data.,cSs0g|](}|ddddddddqS)[]())replace)rIvalr!r!r"rLsz&Bin.binstr_to_list..cSsg|] }t|qSr!)float)rIr2r!r!r"rLsrr)split)binsZ value_chunks bin_valuesr!r!r"binstr_to_lists zBin.binstr_to_listcs,t|trfdd|DS|gSdS)Ncsg|]}|qSr!)rb)rIZdim)rr!r"rLsz&Bin.process_bounds..)rrOrb)rrTr!)rr"rQs zBin.process_boundscCs|j|jdS)N)statr)r')rr!r!r"r$sz Bin.updatecCs|jj|_dS)N)rcr2)rr!r!r"r%sz Bin.calculate)NN)r.r/r0r1r rr rHr rJrKZ start_labelZ stop_labelrMr rr8rcwidthr staticmethodrbrQr$r%r3r!r!)r r"rGs rGcsxeZdZdZeeeeedddZedddZ e ddZ e ddZ ee Zdfd d Zd d Zd dZddZZS)BinStatszA set of statistical calculations for binning values. Bin counts using: https://en.wikipedia.org/wiki/Freedman%E2%80%93Diaconis_rule Na  If bins is an int, it defines the number of equal-width bins in the given range. If bins is a sequence, it defines the bin edges, including the rightmost edge, allowing for non-uniform bin widths. (default: None, use Freedman-Diaconis rule) )rrz#Use Freedman-Diaconis rule if None.g?)rFg?c s*||d<|pd|d<tt|jf|dS)Nr'r&)rrfr)rr'r&r)r r!r"rs zBinStats.__init__cCs8|}|j||j||jdkr4||dS)N)r#q1r)q3r` calc_num_bins)rr'r!r!r"r$s    zBinStats.updatecCst|jj|jj}|dkr(t|j|_nd|t|d|_tt | | |j|_ |j dkrpd|_ dS)zCalculate optimal number of bins using IQR. From: http://stats.stackexchange.com/questions/114490/optimal-bin-width-for-two-dimensional-histogram rgUUUUUUտrN) rhr2rgnpZsqrtsize bin_widthrSintZceilrCrAr`)rr'Ziqrr!r!r"ris" zBinStats.calc_num_binscCsdS)Nr!)rr!r!r"r%szBinStats.calculate)NN)r.r/r0r1r r r r r`rnrDrgrhrlabelsrr$rir%r3r!r!)r r"rfs   rfcseZdZdZeeddZeeeddZ ee e ddZ e Ze ZeddZed dZeZdfd d ZddZddZZS) BinnedStatzc Base class for shared functionality accross bins and aggregates dimensions for plotting. zW A mapping between each dimension and associated binning calculations. )rz A list of the `Bin` instances that were produced as result of the inputs. Iterating over `Bins` will iterate over this list. Each `Bin` can be inspected for metadata about the bin and the values associated with it. zQ The statistical operation to be used on the values in each bin. )rrT)rFNr9c sTt|trt|}|pd|d<||d<||d<||d<||_tt|jf|dS)NZvalsr&rcr'r)rrPstats_binsrrqr)rr'r&r`rcrr)r r!r"r.s   zBinnedStat.__init__cCsLi}|jdk r$|j|d<|j|d<n|jdk r8|j|d<|j|d<tf|S)Nrr&r'r`)rr&r'rsrf)rZ stat_kwargsr!r!r" _get_stat<s      zBinnedStat._get_statcCs||_|jdS)N)rtbin_statr$)rr!r!r"r$Js zBinnedStat.update)NNNr9N)r.r/r0r1r rfrur rGr`rr8rcr bin_columncenters_columnrZ aggregaterar rnrrtr$r3r!r!)r r"rqs    rqc@s2eZdZdZddZddZddZd d d Zd S) BinszBins and aggregates dimensions for plotting. Takes the inputs and produces a list of bins that can be iterated over and inspected for their metadata. The bins provide easy access to consistent labeling, bounds, and values. c Csd}|j||_g}|j}|jj}|jdkr8td|jdkr|dkrdt t |dpdd}t |d||d||d}t j||dddd\}}t |d|dd|_|jdk r|jj||jd |j}nt |j|j|j|i}x6||jD]&\} } |t| | |j|jd q W||_|} | t} x |jD]} | j| || jk<qVW|jd |_ |jdk r|jj| |j d n | ||j <dS) N_binrjz/Histogram data must have at least two elements.rrg{Gz?T)ZretbinsZinclude_lowestZ precision)name)rTr'rcZ_center)!r&rvrur#r`rm ValueErrorndimr?absr^rlZlinspacerZcutroundrnraddtolistr*rr'groupbyappendrGrccopyZastyperPrMrHrw) rbin_strZ bin_modelsr(r`Zmarginbinned bin_boundsZdfrzgrouprUbinr!r!r"r%Ws:   "      zBins.calculatecCs |j|S)N)r`)ritemr!r!r" __getitem__szBins.__getitem__cCs||j|jS)N)r)rr*)rr(r!r!r"applys z Bins.applyTcCs*|jdk r&tt|jdd|d|_dS)NcSs|jS)N)rM)xr!r!r"szBins.sort..)keyreverse)r`rOsorted)rZ ascendingr!r!r"sorts z Bins.sortN)T)r.r/r0r1r%rrrr!r!r!r"rxOs .rxc@s$eZdZdZedddZddZdS) HistogramzBins and aggregates dimensions for plotting. Takes the inputs and produces a list of bins that can be iterated over and inspected for their metadata. The bins provide easy access to consistent labeling, bounds, and values. Faf Whether to normalize the histogram. If True, the result is the value of the probability *density* function at the bin, normalized such that the *integral* over the range is 1. If False, the result will contain the number of samples in each bin. For more info check ``numpy.histogram`` function documentation. (default: False) )rc Csd}|j||_|j}|jj}tjt||j|d\}}t |d|dd|_ g|_xt |D]v\}}||d||}|dkrd||||df} nd||||df} |j t | ||gt|dqhWdS) Nry)densityr`rjrrz[%f, %f]z(%f, %f])rTr'rcrd)r&rvrur#r`rlZ histogramZarrayrr~rn enumeraterrGrB) rrr(r`rribrdZlblr!r!r"r%s  zHistogram.calculateN)r.r/r0r1rrr%r!r!r!r"rs rcKs.t|tr|}d}nd}tf|||d|S)z8Specify binning or bins to be used for column or values.N)r'r&r`)rrPrx)r(r'r&r`rpkwargsr!r!r"r`s  r`) r5r7r9r;r=ZstddevrArCrE)NNNN),r1Z __future__rZnumpyrlZpandasrZsixrZbokeh.models.sourcesrZbokeh.core.has_propsrZbokeh.core.propertiesrrrr r r r r rrrrrrr4r6r8r:r<r>r@rBrDrGrfrqrxrr`rrr!r!r!r" sB    ,N A5=C,