B 18\ @svdZddlZddlZddlZddlmZddlmZdZddZ dd Z d d Z ej fd d Z edkrre e eZdejkrededee endejkrFdZedZeejZeedTZdZxHeD]@Zedre eeddZqer edrdZqeeqWWdQRXWdQRXeeeeen,eekrZedne eeededS)z Utility for parsing HTML5 entity definitions available from: http://dev.w3.org/html5/spec/entities.json Written by Ezio Melotti and Iuliia Proskurnia. N)urlopen)html5z*http://dev.w3.org/html5/spec/entities.jsonc Cs,t|}|d}WdQRXt|S)zADownload the json file from the url and returns a decoded object.zutf-8N)rreaddecodejsonloads)urlfdatar b/oak/stanford/groups/akundaje/marinovg/programs/Python-3.7.3/Tools/scripts/parse_html5_entities.pyget_jsons r cCs0i}x&|D]\}}|d||d<qW|S)z3Create the html5 dict from the decoded json object. characters&)itemslstrip)entities new_html5namevaluer r r create_dictsrcCs||}|rLtdt|x$t|D]}td|||q0W||}|rtdt|x$t|D]}td|||q|Wt}x@||@D],}||||kr||||||fqW|rtdt|x t|D]}tdj|qWdS)z8Compare the old and new dicts and print the differences.z{} entitie(s) have been added:z {!r}: {!r}z {} entitie(s) have been removed:z!{} entitie(s) have been modified:z {!r}: {!r} -> {!r}N)keysprintformatlensortedsetadd)oldnewaddedrZremovedchangeditemr r r compare_dicts s$r#cCs\t|}t|tjd}td|dx$|D]}td||||dq,Wtd|ddS)z8Write the items of the dictionary in the specified file.)keyz html5 = {)filez {!r}: {!a},}N)rrstrlowerrr)rr%rrr r r write_items5s   r)__main__z--createzQ# map the HTML5 named character references to the equivalent Unicode character(s)z)# Generated by {}. Do not edit manually.z--patchzLib/html/entities.pyz.tempwFz html5 = {)r%Tr&z"The current dictionary is updated.zwRun "./python {0} --patch" to update Lib/html/entities.html or "./python {0} --create" to see the generated dictionary.)__doc__ossysrurllib.requestr html.entitiesrZ entities_urlr rr#stdoutr)__name__rargvrr__file__fnameZ temp_fnameopenf1f2skipline startswithwriteremoverenamer r r r  sL           "