`j ddlZddlZddlZddlZddlmZddlmZmZm Z m Z ddl Z ddl Z ddl Z ddlmZmZddlmZddlmZdd lmZmZmZmZmZej6d ej6d d ed deddd d eddddfde j8dedeedefdZd#dedeededdfdZ dede eddfdZ!d e eefd!edeefd"Z"y)$N)Path)IteratorOptionalSequenceUnion)Printermsg)Language) load_model)NAMEArgOptapp debug_cliprofileT)hidden.zTrained pipeline to load)helpz&Location of input file. '-' for stdin.)rexists allow_dash'z --n-textsz-nz+Maximum number of texts to use if availablectxmodelinputsn_textsc|jjjtk(rt j dt |||y)a\ Profile which functions take the most time in a spaCy pipeline. Input should be formatted as one JSON object per line with a key "text". It can either be provided as a JSONL file, or be read from sys.sytdin. If no input file is specified, the IMDB dataset is loaded via Thinc. DOCS: https://spacy.io/api/cli#debug-profile zThe profile command is now available via the 'debug profile' subcommand. You can run python -m spacy debug --help for an overview of the other available debugging commands.)rrN)parentcommandnamerr warnr)rrrrs [/home/spazio/kingdom_calls/work5/transenv/lib/python3.12/site-packages/spacy/cli/profile.py profile_clir#s<2 zz$&  B  E&'2returncL|/t|t}ttj||}|f ddl}tjd5j|d\}}|Dcgc]\}}| }}}dddtjd|dtjd |d 5t|}dddtjd |d tjd tt!dt#j$d} tj&d| j)j+dj-y#t $rtjddYJwxYwcc}}w#1swYxYw#1swYxYw)NrzwThis command, when run without an input file, requires the ml_datasets library to be installed: pip install ml_datasetsr exitsz'Loading IMDB dataset via ml_datasets...) train_limit dev_limitzLoaded IMDB dataset and using z exampleszLoading pipeline 'z'...zLoaded pipeline ''zparse_texts(nlp, texts)z Profile.profz Profile statstime) _read_inputsr list itertoolsislice ml_datasets ImportErrorfailloadingimdbinfor goodcProfilerunctxglobalslocalspstatsStatsdivider strip_dirs sort_stats print_stats) rrrtextsr1 imdb_train_textnlpss r"rr4sm VS)Y%%eW56 ~  [[B C 5',,A,NMJ)34gdAT4E4 5 1')DE )%5 6  HH q )* OO-wy&(NS ^$AKK LLNf%113%  HH*    5 5 5  s;E F * F6F 3 F FFF  FF#rFrBc^|jtj|ddD]}y)N)disable) batch_size)pipetqdm)rFrBdocs r" parse_textsrOPs,xx %62xF   r$locr c#K|dk(r,|jdtj}d|D}nrt|}|j r|j s|j d|d|jd|jd|j}|D] }tj|}|d }|"yw) N-zReading input from sys.stdinc3>K|]}|jdyw)utf8N)encode).0lines r" z_read_inputs..Ys7V$7szNot a valid input data filer r'zUsing data from rE) r6sysstdinrris_filer3partsopensrsly json_loads)rPr file_ input_pathrWdatarEs r"r-r-Us cz/0 77#Y   "**<*<*> CHH2Cq A#J$4$4R$8#9:;!%F| sC C )Nr)#r8r/r<rZpathlibrtypingrrrrr_rMtyperwasabirr languager utilr _utilrrrrrrContextstrintr#rrOr-r$r"ros7 66 119 Yt$S9:  5   {D'T3 3 3 TN 33%3@43444PT48 X hsm  eD#I&W#r$