How to track progress with nlp.pipe function of spacy?

Question

I'm coding with Python and Spacy. I want to track the progress of the execution of nlp.pipe(sentences) because it lasts a lot. How to do that?

nlp = spacy.load('en_core_web_sm')
sentences = [...]
docs = nlp.pipe(sentences, n_process=8)

Answer 1

Use tqdm.

from tqdm import tqdm

nlp = spacy.load('en_core_web_sm')
sentences = [...]
for doc in tqdm(nlp.pipe(sentences, n_process=8)):
    ... do stuff ...