B T\ @s0ddlmZddlZddlZddZddZdS))absolute_importNc Cs|jdk od|jk}|rFt|jdd}dd|dgD}ni}i}xFtt|D]6}||}|j|kr~||j}n |j }|||j<q\W|rx|D] } d|| <qW|S)z4Convert a pyarrow.Schema object to pandas dtype dictNspandasutf8c Ss&i|]}|d|d|ddqS)Z numpy_typeZ field_namenameN)get).0cr6lib/python3.7/site-packages/dask/dataframe/io/utils.py sz'_get_pyarrow_dtypes..columnscategory) ZmetadatajsonloadsdecoderrangelenrtypeZto_pandas_dtype) ZschemaZ categoriesZhas_pandas_metadataZpandas_metadataZpandas_metadata_dtypesZdtypesiZfieldZ numpy_dtypecatrrr _get_pyarrow_dtypess"     rcCstjdd|D|d}|t|}|s0|St|ts@|g}||}t|dkrj|ddkrjd|j_t|dkr|d|j _n||j _ |S)aNGet the final metadata for the dask.dataframe Parameters ---------- to_read_columns : list All the columns to end up with, including index names file_dtypes : dict Mapping from column name to dtype for every element of ``to_read_columns`` index_cols : list Subset of ``to_read_columns`` that should move to the index column_index_names : list The values for df.columns.name for a MultiIndex in the columns, or df.index.name for a regular Index in the columns Returns ------- meta : DataFrame cSs i|]\}}tjg|d|qS))Zdtype)pdZSeries)rrdrrr r ;sz%_meta_from_dtypes..)r rZ__index_level_0__N) rZ DataFrameitemslist isinstanceZ set_indexrindexrr names)Zto_read_columnsZ file_dtypesZ index_colsZcolumn_index_namesmetaZdfrrr _meta_from_dtypes%s      r)Z __future__rZpandasrr rrrrrr s