]Lc @s`dZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z dZ dZ dZ dZdjeeddd d d d d geddZdjeeedZdddddddddg Zieddded6eddddd6ZdZdd d Zd!Zd"Zeeeeed#Zd$efd%YZ d&Z!d'e"fd(YZ#e#Z$d)e"fd*YZ%d+e"fd,YZ&ed-Z'ed.Z(d/Z)d0Z*d1Z+ed2Z,d3Z-d4Z.ed5Z/e0d6kr\e,ndS(7s grin searches text files. iNs1.2.1iitiii i i i ii itblacktredtgreentyellowtbluetmagentatcyantwhitetdefaulttfgtboldtfilenametbgt searchtermsiicCs|jtt}t|S(s Determine if a string is classified as binary rather than text. Parameters ---------- bytes : str Returns ------- is_binary : bool (t translatetALLBYTESt TEXTCHARStbool(tbytestnontext((s#lib/python2.7/site-packages/grin.pytis_binary_string,s cCsdg}d}|j}xtr|jd|d}|dkry|dt|kro|jt|n||fS|j|d||jkr||jkr|d7}qqWdS(s Compute the list of offsets in DataBlock 'block' which correspond to the beginnings of new lines. Returns: (offset list, count of lines in "current block") is iiN(tdatatTruetfindtlentappendtstarttend(tblockt line_offsetst line_counttst next_newline((s#lib/python2.7/site-packages/grin.pytget_line_offsets:s     c Csg}|tkr/|jtj|dn|tkrX|jtj|dn|rn|jdn|r|jdn|r|jdnddjtt|d}d }|||S( s Wraps a string with ANSI color escape sequences corresponding to the style parameters given. All of the color and style parameters are optional. Parameters ---------- s : str fg : str Foreground color of the text. One of (black, red, green, yellow, blue, magenta, cyan, white, default) bg : str Background color of the text. Color choices are the same as for fg. bold : bool Whether or not to display the text in bold. underline : bool Whether or not to underline the text. reverse : bool Whether or not to show the text in reverse video. Returns ------- A string with embedded color escape sequences. ii(iiis;tms(t COLOR_TABLERtindextjointmaptstr( R R R R t underlinetreversetstyle_fragmentst style_startt style_end((s#lib/python2.7/site-packages/grin.pytcolorizeTs   tOptionscBseZdZdZRS(s Simple options. cOs tj|||||_dS(N(tdictt__init__t__dict__(tselftargstkwds((s#lib/python2.7/site-packages/grin.pyR2s(t__name__t __module__t__doc__R2(((s#lib/python2.7/site-packages/grin.pyR0scCsgtdddddtdtdtdtdtd td td td td tdtdd}|S(s# Populate the default options. tbefore_contextit after_contexttshow_line_numberst show_matcht show_filenamet show_emacstskip_hidden_dirstskip_hidden_filestskip_backup_filest skip_dirst skip_extstskip_symlink_dirstskip_symlink_filest binary_bytesi(R0RtFalsetset(topt((s#lib/python2.7/site-packages/grin.pytdefault_optionss    t DataBlockcBs&eZdZddddedZRS(s; This class holds a block of data read from a file, along with some preceding and trailing context. Attributes ---------- data : byte string start : int Offset into 'data' where the "current block" begins; everything prior to this is 'before' context bytes end : int Offset into 'data' where the "current block" ends; everything after this is 'after' context bytes before_count : int Number of lines contained in data[:start] is_last : bool True if this is the final block in the file RicCs1||_||_||_||_||_dS(N(RRRt before_counttis_last(R4RRRRMRN((s#lib/python2.7/site-packages/grin.pyR2s     (R7R8R9RHR2(((s#lib/python2.7/site-packages/grin.pyRLstGrepTextcBsVeZdZddZdZdZdZdZddZ e dZ RS( s Grep a single file for a regex by iterating over the lines in a file. Attributes ---------- regex : compiled regex options : Options or similar cCsP||_tj|j|jtjB|_|dkrCt}n||_ dS(N( tregextretcompiletpatterntflagst MULTILINEtregex_mtNoneRKtoptions(R4RPRX((s#lib/python2.7/site-packages/grin.pyR2s  "  c Cs$|d kr6t}|j|}t||k}nCt||jd}tt|}|j|}||k}|d kr|rtd|dddt|dddt}|St }n|j dkrd} d} nr|j d} d} xRt |j j D]>} |jjdd| } | } | d7} | dkr Pq q W| d7} |j| |j !} |j|j ||rd n |j}|rd }n:gt |j jD]} |j^q}d j|}td| ||dt| dt| t|d| d|}|S( si Read a block of data from the file, along with some surrounding context. Parameters ---------- prev : DataBlock, or None The result of the previous application of read_block_with_context(), or None if this is the first block. fp : filelike object The source of block data. fp_size : int or None Size of the file in bytes, or None if the size could not be determined. Returns ------- A DataBlock representing the "current" block along with context. iRRRRMRNis RN(RWtREAD_BLOCKSIZEtreadRtmaxttelltminRLRtEMPTY_DATABLOCKRtrangeRXR:RtrfindtreadlineR;R'(R4tprevtfptfp_sizettarget_io_sizet block_maint is_last_blockt remainingtresultt before_startRMtitofst before_linest curr_blockt after_linestafter_lines_list((s#lib/python2.7/site-packages/grin.pytread_block_with_contextsX            +  c CsPg}d}t|tjr'd}nWy=tj|j}tj|j r]|j }nd}Wnt k r}d}nX|j d||}x|j |jkr<|j|||j\}}||7}|jrPn|j |||} | j | jkr3|dkr&t|\} }n||7}n| }qW|j|} | S(sp Do a full grep. Parameters ---------- fp : filelike object An open filelike object. Returns ------- A list of 4-tuples (lineno, type (POST/PRE/MATCH), line, spans). For each tuple of type MATCH, **spans** is a list of (start,end) positions of substrings that matched the pattern. iN(t isinstancetgziptGzipFileRWtostfstattfilenotstattS_ISREGtst_modetst_sizetAttributeErrorRqRRt do_grep_blockRMRNR"tuniquify_context( R4RctcontextRRdtstatusRtblock_line_countt block_contextt next_blockt_tunique_context((s#lib/python2.7/site-packages/grin.pytdo_grep#s4           csjjjjg}dd}fd}x[jjjjj!D]7}dkrt \}n|||7}qkW||fS(sj Grep a single block of file content. Parameters ---------- block : DataBlock A chunk of file data. line_num_offset: int The number of lines preceding block.data. Returns ------- Tuple of the form (line_count, list of (lineno, type (POST/PRE/MATCH), line, spans). 'line_count' is either the number of lines in the block, or None if the line_count was not computed. For each 4-tuple of type MATCH, **spans** is a list of (start,end) positions of substrings that matched the pattern. c s_tj|jjd}t|}ttd|d}j||d!}gjj|D]}|j^q}gt|||D]2}|t j||d!df^q}gt|d||dD]2}|t j||d!df^q} |t ||fg} || | S(Ni( tbisectRR]RRRPtfinditertspanR_tPRERWtPOSTtMATCH( tmatchtmatch_line_numRMt after_countt match_lineR$tspansRkt before_ctxt after_ctxt match_ctx(taftertbeforeRtline_num_offsetRR4(s#lib/python2.7/site-packages/grin.pytbuild_match_contextps#!+IQN( RXR:R;RWRVRRRRR"(R4RRRRRR((RRRRRR4s#lib/python2.7/site-packages/grin.pyR}Vs  ) cCs|jg}xtj|dD]i}x`|dD];\}}}}|tkr7|j||||fPq7q7W|j||||fq&W|S(s@ Remove duplicate lines from the list of context lines. cSs|dS(Ni((tikl((s#lib/python2.7/site-packages/grin.pytsi(tsortt itertoolstgroupbyRR(R4RRtgroupRktkindtlinetmatches((s#lib/python2.7/site-packages/grin.pyR~s  c Cs4t|dkrdSg}|jjsBd|}|j|n|jjr|dk r|jj rd|}|jjrt|t j di}n|j|n|jjrd}n|jj rd}nd}xC|D];\}}}}|jjr|t krd t krt d } |} d} xw|D]l\} } | | | !}| | 7} | | 7} t|| }|| ||| }| t|t|7} q6Wnt d |d d id t6dt6dt 6|d|d|}||}|j||jds|jdqqWdj|}|S(s2 Return a string showing the results. Parameters ---------- context_lines : list of tuples of (int, PRE/MATCH/POST, str, spans) The lines of matches and context. filename : str, optional The name of the file being grepped, if one exists. If not provided, the filename may not be printed out. Returns ------- text : str This will end in a newline character if there is any text. Otherwise, it might be an empty string without a newline. iRs%s s%s: R s!%(filename)s:%(lineno)s: %(line)ss%(lineno)5s %(sep)s %(line)ss%(line)sRtlinenoitsept-t+t:Rs N(RRXR=RR>RWR?t use_colorR/t COLOR_STYLEtgetR<RR1RRtendswithR'(R4t context_linesR tlinesRttemplateRkRRtstylet orig_linet total_offsetRRt old_substringtcolor_substringtnsttext((s#lib/python2.7/site-packages/grin.pytreportsN  %      $    !    cCss|dkrtj}d}n||d}z|j|}Wd|dkr\|jnX|j||}|S(s Grep a single file that actually exists on the file system. Parameters ---------- filename : str The file to open. opener : callable A function to call which creates a file-like object. It should accept a filename and a mode argument like the builtin open() function which is the default. Returns ------- report : str The grep results as text. RstrN(tsyststdinRtcloseR(R4R topenertfRR((s#lib/python2.7/site-packages/grin.pyt grep_a_files    N( R7R8R9RWR2RqRR}R~RtopenR(((s#lib/python2.7/site-packages/grin.pyROs T 3 4  @tFileRecognizerc BsteZdZeeeeeeeddZdZdZdZ dZ dZ dZ d Z RS( s Configurable way to determine what kind of file something is. Attributes ---------- skip_hidden_dirs : bool Whether to skip recursing into hidden directories, i.e. those starting with a "." character. skip_hidden_files : bool Whether to skip hidden files. skip_backup_files : bool Whether to skip backup files. skip_dirs : container of str A list of directory names to skip. For example, one might want to skip directories named "CVS". skip_exts : container of str A list of file extensions to skip. For example, some file names like ".so" are known to be binary and one may want to always skip them. skip_symlink_dirs : bool Whether to skip symlinked directories. skip_symlink_files : bool Whether to skip symlinked files. binary_bytes : int The number of bytes to check at the beginning and end of a file for binary characters. ic Cs||_||_||_||_t|_t|_xQ|D]I} tj j d| d| kr||jj | qC|jj | qCW||_ ||_||_dS(Nsfoo.bari(R@RARBRCRItskip_exts_simpletlisttskip_exts_endswithRutpathtsplitexttaddRRERFRG( R4R@RARBRCRDRERFRGtext((s#lib/python2.7/site-packages/grin.pyR2s          cCs,t|d}|j|}|j|S(s Determine if a given file is binary or not. Parameters ---------- filename : str Returns ------- is_binary : bool trb(Rt_is_binary_fileR(R4R Rt is_binary((s#lib/python2.7/site-packages/grin.pyR1s  cCs7y|j|j}Wntk r,}tSXt|S(s Determine if a given filelike object has binary data or not. Parameters ---------- f : filelike object Returns ------- is_binary : bool (RZRGt ExceptionRR(R4RRte((s#lib/python2.7/site-packages/grin.pyRAs cCst}t|d}|jd}|j|tkrtj|}z2y|j| }Wntk ryt}nXWd|jXn|S(s' Determine if a given file is a gzip-compressed text file or not. If the uncompressed file is binary and not text, then this will return False. Parameters ---------- filename : str Returns ------- is_gzipped_text : bool RiN(RHRRZRt GZIP_MAGICRsRtIOError(R4R tis_gzipped_textRtmarkerRc((s#lib/python2.7/site-packages/grin.pyRTs   cCskyRtj|j}tj|r1|j|Stj|rM|j|SdSWntk rfdSXdS(s Determine what kind of thing a filename represents. It will also determine what a directory walker should do with the file: 'text' : It should should be grepped for the pattern and the matching lines displayed. 'binary' : The file is binary and should be either ignored or grepped without displaying the matching lines depending on the configuration. 'gzip' : The file is gzip-compressed and should be grepped while uncompressing. 'directory' : The filename refers to a readable and executable directory that should be recursed into if we are configured to do so. 'link' : The filename refers to a symlink that should be skipped. 'unreadable' : The filename cannot be read (and also, in the case of directories, is not executable either). 'skip' : The filename, whether a directory or a file, should be skipped for any other reason. Parameters ---------- filename : str Returns ------- kind : str tskipt unreadableN(RuRxRzRytrecognize_filetS_ISDIRtrecognize_directorytOSError(R4R Rz((s#lib/python2.7/site-packages/grin.pyt recognizess$   cCsttjj|d}|jr>|jdr>|dkr>dS|jr]tjj|r]dS||jkrpdSdS(s0 Determine what to do with a directory. it.s..Rtlinkt directory(Rs..(RuRtsplitR@t startswithREtislinkRC(R4R tbasename((s#lib/python2.7/site-packages/grin.pyRs cCs.tjj|d}|jr2|jdr2dS|jrN|jdrNdS|jrmtjj|rmdStjj |}tjj |d}||j ks|jdrdSx$|j D]}|j|rdSqWy1|j |r |j|rdSd Snd SWnttfk r)d SXd S( s+ Determine what to do with a file. iRRt~Ris.~RstbinaryRRN(RuRRRARRBRRFRtnormcaseRRRRRRR(R4R Rt filename_ncR((s#lib/python2.7/site-packages/grin.pyRs,ccs|j|}|dkr*||fVdS|dkrytj|}Wntk r]dSXxWt|D]F}tjj||}x(|j|D]\}}||fVqWqkWndS(s Walk the tree from a given start path yielding all of the files (not directories) and their kinds underneath it depth first. Paths which are recognized as 'skip', 'link', or 'unreadable' will simply be passed over without comment. Parameters ---------- startpath : str Yields ------ filename : str kind : str RRRsNR(RRRs(RRutlistdirRtsortedRR'twalk(R4t startpathRt basenamesRRtfntk((s#lib/python2.7/site-packages/grin.pyRs    (R7R8R9RHRIRR2RRRRRRR(((s#lib/python2.7/site-packages/grin.pyRs     2 c Cs|d}kr0tjdddddtj}n|jdddd d d td d |jd ddddddtjdgd d|jdddddtd d|jdddddtd d|jdddtd d|jd d!dd"d d#|jd$d%dd&dd'dt d d(|jd)d*dd+dd'd d,|jd-d.dd&dd/dt d d0|jd1dd+dd/d d2|jd3dd&dd4d d5|jd6d7dd+dd8d d9|jd:d;dd&dd8dt d d<|jd=dd&dt j d>kd d?|jd@dd+ddAd dB|jdCdd&d dD|jdEdFddGdd+d dH|jdIddGdd&dt d dJ|jdKdLddMdd+d dN|jdOddMdd&dt d dP|jdQdRddSdd+d dT|jdUddSdt dd&d dV|jdWdXddYd dZ|jd[d\dd]dd^dd_d d`|jdadbddcd dd|jdedfddgdd^dd_d dh|jdidd+ddjdt d dk|jdldd&ddjd dm|jdndodpdqd dr|jdsdtdd&d du|jdvdd&d dw|jdxd dy|jdzd{d"d d||S(~s% Create the command-line parser. t descriptions,Search text files for a given regex pattern.tepilogs2Bug reports to .tformatter_classs-vs --versiontactiontversionsgrin %sthelps&show program's version number and exits-is --ignore-caset append_consttdesttre_flagstconstR signore case in the regexs-As--after-contextittypesLthe number of lines of context to show after the match [default=%(default)r]s-Bs--before-contextsMthe number of lines of context to show before the match [default=%(default)r]s-Cs --contextsBthe number of lines of context to show on either side of the matchs-Is --includet*s=only search in files matching this glob [default=%(default)r]s-ns --line-numbert store_trueR<sshow the line numbers [default]s-Ns--no-line-numbert store_falsesdo not show the line numberss-Hs--with-filenameR>s0show the filenames of files that match [default]s--without-filenames-do not show the filenames of files that matchs--emacsR?sDprint the filename with every match for easier parsing by e.g. Emacss-ls--files-with-matchesR=s8show only the filenames and not the texts of the matchess-Ls--files-without-matchess#show the matches with the filenamess --no-colortwin32s:do not use colorized output [default if piping the output]s --use-colortno_colors:use colorized output [default if outputting to a terminal]s --force-colors[always use colorized output even when piping to something that may not be able to handle its-ss--no-skip-hidden-filesRAsdo not skip .hidden filess--skip-hidden-filessdo skip .hidden files [default]s-bs--no-skip-backup-filesRBs8do not skip backup~ files [deprecated; edit --skip-exts]s--skip-backup-filess>do skip backup~ files [default] [deprecated; edit --skip-exts]s-Ss--no-skip-hidden-dirsR@sdo not skip .hidden directoriess--skip-hidden-dirss%do skip .hidden directories [default]s-ds --skip-dirss CVS,RCS,.svn,.hg,.bzr,build,distsEcomma-separated list of directory names to skip [default=%(default)r]s-Ds--no-skip-dirsRCt store_constRsdo not skip any directoriess-es --skip-extssk.pyc,.pyo,.so,.o,.a,.tgz,.tar.gz,.rar,.zip,~,#,.bak,.png,.jpg,.gif,.bmp,.tif,.tiff,.pyd,.dll,.exe,.obj,.libsEcomma-separated list of file extensions to skip [default=%(default)r]s-Es--no-skip-extsRDsdo not skip any file extensionss --no-followtfollow_symlinkss9do not follow symlinks to directories and files [default]s--follows(follow symlinks to directories and filess-fs--files-from-filetmetavartFILEs;read files to search from a file, one per line; - for stdins-0s--null-separateds>filenames specified in --files-from-file are separated by NULss --sys-paths"search the directories on sys.pathRPs$the regular expression to search fortfilestnargssthe files to searchN( RWtargparsetArgumentParsertRawDescriptionHelpFormattert add_argumentt __version__RQtItintRRHRtplatform(tparser((s#lib/python2.7/site-packages/grin.pytget_grin_arg_parsers      !       c Csh|dHkr'tjdddd}n|jdddddd td d |jd d ddddd d|jddddddtd d|jddddddd d|jddddddtd d|jddddddd d|jd dddtddd d!|jd"d#dd$d d%|jd&d'dd(dd)d*d+d d,|jd-d.dd/d d0|jd1d2dd3dd)d*d+d d4|jd5dddd6dtd d7|jd8dddd6d d9|jd:d;ddd d<|jd=d>d?dd@gd dA|jdBddd dC|jdDddEd>dFd dG|S(IsI Create the command-line parser for the find-like companion program. Rs7Find text and binary files using similar rules as grin.Rs2Bug reports to .s-vs --versionRRsgrin %sRs&show program's version number and exits-ss--no-skip-hidden-filesRRARsdo not skip .hidden filess--skip-hidden-filesRR sdo skip .hidden filess-bs--no-skip-backup-filesRBs8do not skip backup~ files [deprecated; edit --skip-exts]s--skip-backup-filess>do skip backup~ files [default] [deprecated; edit --skip-exts]s-Ss--no-skip-hidden-dirsR@sdo not skip .hidden directoriess--skip-hidden-dirssdo skip .hidden directoriess-ds --skip-dirss CVS,RCS,.svn,.hg,.bzr,build,distsEcomma-separated list of directory names to skip [default=%(default)r]s-Ds--no-skip-dirsRCRRRsdo not skip any directoriess-es --skip-extssk.pyc,.pyo,.so,.o,.a,.tgz,.tar.gz,.rar,.zip,~,#,.bak,.png,.jpg,.gif,.bmp,.tif,.tiff,.pyd,.dll,.exe,.obj,.libsEcomma-separated list of file extensions to skip [default=%(default)r]s-Es--no-skip-extsRDsdo not skip any file extensionss --no-followRs9do not follow symlinks to directories and files [default]s--follows(follow symlinks to directories and filess-0s--null-separateds%print the filenames separated by NULss--dirsRRRsthe directories to start froms --sys-paths"search the directories on sys.pathtglobRt?sythe glob pattern to match; you may need to quote this to prevent the shell from trying to expand it [default=%(default)r]N(RWRRRRRRH(R((s#lib/python2.7/site-packages/grin.pytget_grind_arg_parserOsd          cCsltd|jd|jd|jdt|jjddt|jjdd|j d|j }|S( sA Get the file recognizer object from the configured options. RARBR@RCt,RDRFRE( RRARBR@RIRCRRDR(R5tfr((s#lib/python2.7/site-packages/grin.pytget_recognizers     c csg}|jdk r|jdkr6tj}t}nCtjj|jrct|j}t }nt dd|jzk|j r|j g|j jdD]}|j^qn&|j g|D]}|j^qWd|r|jnXn|j |j|jr*|j tjntjdkr]tddg}td g}nt}td d g}g|D]*}||kr|j|kr|^q}t|d krd g}nt|}x|D]}|dkr|d fVqn|j|} | dkrMtjtjj||jrM|| fVq| dkrx[|j|D]G\} } | dkritjtjj| |jri| | fVqiqiWqqWdS(s9 Generate the filenames to grep. Parameters ---------- args : Namespace The commandline arguments object. Yields ------ filename : str kind : either 'text' or 'gzip' What kind of file it is. Raises ------ IOError if a requested file cannot be found. RisNo such file: %rsNRsNUL:tNULRs /dev/nulliRRRsR(RRs(RRs(tfiles_from_fileRWRRRHRuRtexistsRRRtnull_separatedtextendRZRtstripRRtsys_pathRRItupperRR RtfnmatchRtincludeR( R5Rt files_filet should_closetxt upper_badtraw_badRR RR R((s#lib/python2.7/site-packages/grin.pyt get_filenamessL    8*  7     - -cCs7d}x|jD]}||O}qWtj|j|S(s3 Get the compiled regex object to search with. i(RRQRRRP(R5RTtflag((s#lib/python2.7/site-packages/grin.pyt get_regexsc CsyI|dkrLtjtjdd}tjdg|tjd}nt}|j|d}|j dk r|j |_ |j |_ n|j p|j otjjotjjddk|_t|}t||}tdtdtj}xCt|D]5\}}|j|d ||} tjj| qWWnStk rhtdn7tk r} d t| krtdnnXdS( Nt GRIN_ARGSRiitTERMtdumbRRsRs Broken pipe(RWtshlexRRutgetenvRtargvRt parse_argsRR:R;t force_colorRtstdouttisattytenvironRRRROR1RRsRRtwritetKeyboardInterruptt SystemExitRR)( R%tenv_argsRR5RPtgtopenersR RRR((s#lib/python2.7/site-packages/grin.pyt grin_mains0 "    cCs |GHdS(N((R ((s#lib/python2.7/site-packages/grin.pyt print_linescCs$tjj|tjjddS(Ns(RR(R+(R ((s#lib/python2.7/site-packages/grin.pyt print_nullsc Cshy|dkrLtjtjdd}tjdg|tjd}nt}|j|d}|j rzt }nt }|j r|j jtjnt|}x_|j D]T}xK|j|D]:\}}tjtjj||jr||qqWqWWnStk r-tdn7tk rc} dt| kr]tdnnXdS(Nt GRIND_ARGSRiis Broken pipe(RWR#RRuR$RR%R R&RR3R2RtdirsRRR RRRRR,R-RR)( R%R.RR5toutputR tdirR RR((s#lib/python2.7/site-packages/grin.pyt grind_mains, "     ! t__main__(1R9RRRsRRuRQR#RxRRRRRRR'R(tchrR_RRR%R1RRRRYRR"RWRHR/R0RKtobjectRLR^RORRR R RRR1R2R3R8R7(((s#lib/python2.7/site-packages/grin.pytsX          :   ,  C ` ;  O