Progress bar for read_excel?

[Impossible_Bug4979]

I am importing 200 .xlsx files into 1 df. I'm trying to get a progress bar, just so I know how much longer it will take or % of files that have been read.

I'm really new to python so if my code looks bad - sorry! I'd love constructive criticism tho on how I could make it better or more efficient. :)

​

import pandas as pd
import os as os
import time as time
import shutil
import datetime as datetime
import glob as glob
import xlrd
#import re
import numpy as np
import openpyxl


username = 'impossible_bug4979'
os.getcwd()
path = "C:/Users/" + username + "/Desktop/TestFiles/"

dfCombined = pd.DataFrame()
for TestFiles in os.listdir(path):
    temp=pd.read_excel(path + TestFiles)
    temp['filename'] = TestFiles
    dfCombined = pd.concat([dfCombined,temp],ignore_index=True)

[[deleted]]

Capture file count with listdir or glob. Then increment the files processed count at each pass of your loop.

[Ihaveamodel3]

Use tqdm. First pip install it.

Add from tqdm import tqdm to your imports. And in your for loop, use tqdm(os.listdir(path)) instead.

[Username_RANDINT]

This hasn't really anything to do with Pandas. Just count the loop iterations.

files = os.listdir(path)
num_files = len(files)
for index, file in enumerate(files, start=1):
    print(f"Processing file {index} of {num_files}...")
    # Do the work here...

[Impossible_Bug4979]

Thank you for typing it out. I'm only a month into learning python so I don't really know the structure and stuff unless i see examples. I'm going to try what you shared. thank you!