ó ¦–Õ\c@`s§ddlmZmZmZddlmZddlmZmZddl m Z ddl m Z dd l mZdd lmZdZdd „Zddd „ZdS(i(tabsolute_importtdivisiontprint_function(t LooseVersioni(t_get_pyarrow_dtypest_meta_from_dtypesi(t DataFramei(ttokenize(tget_fs_token_paths(timport_requiredtread_orcc C`sŠtddƒ}ddl}|j|dƒ(}|j|ƒ}|j||ƒ}WdQX|jtdƒkrv|jƒS|jdtƒSdS(s5Pull out specific data from specific part of ORC files pyarrow.orcsPlease install pyarrow >= 0.9.0iNtrbs0.11.0tdate_as_object( R tpyarrowtopentORCFilet read_stripet __version__Rt to_pandastFalse( tfstpathtstripetcolumnstorctpatftottable((s4lib/python2.7/site-packages/dask/dataframe/io/orc.pyt_read_orc_stripes  cC`stddƒ}ddl}t|jƒdkr?tdƒ‚n|pHi}t|ddd |ƒ\}}}d}g} x~|D]v}|j|dƒ\} |j| ƒ} |dkrÁ| j }n|| j krßt d ƒ‚n| j | j ƒWdQXqWt |d dƒ}|dk rUt|ƒt|ƒ} | rat d | t|ƒfƒ‚qan t|ƒ}t||ggƒ} d t|||ƒ}i}d}x]t|| ƒD]L\}}x=t|ƒD]/}t||||f|||f<|d7}qÁWq¨Wt||| dgt|ƒdƒS(s…Read dataframe from ORC file(s) Parameters ---------- path: str or list(str) Location of file(s), which can be a full URL with protocol specifier, and may include glob character if a single string. columns: None or list(str) Columns to load. If None, loads all. storage_options: None or dict Further parameters to pass to the bytes backend. Returns ------- Dask.DataFrame (even if there is only one column) Examples -------- >>> df = dd.read_orc('https://github.com/apache/orc/raw/' ... 'master/examples/demo-11-zlib.orc') # doctest: +SKIP s pyarrow.orcsPlease install pyarrow >= 0.9.0iNs0.10.0sõDue to a bug in pyarrow 0.10.0, the ORC reader is unavailable. Please either downgrade pyarrow to 0.9.0, or use the pyarrow master branch (in which this issue is fixed). For more information see: https://issues.apache.org/jira/browse/ARROW-3009tmodeR tstorage_optionss,Incompatible schemas while parsing ORC filest categoriess)Requested columns (%s) not in schema (%s)s read-orc-i(R R RRt RuntimeErrorRtNoneRRtschemat ValueErrortappendtnstripesRtsettlistRRtziptrangeRRtlen(RRRRRRtfs_tokentpathsR#tnstripes_per_fileRRtextmetatnametdsktNtnR((s4lib/python2.7/site-packages/dask/dataframe/io/orc.pyR sB       N(R (t __future__RRRtdistutils.versionRtutilsRRtcoreRtbaseRt bytes.coreRR t__all__R"RR (((s4lib/python2.7/site-packages/dask/dataframe/io/orc.pyts