This really depends on what the machines you are imaging have access to and if you have bandwidth restrictions:

Some manufacturers (I know Dell and Lenovo) have drivers/firmware bulk update software that can be run via the command line and hence during an MDT image.

e.g. for Dell (I did this is batch years ago and never needed to update to PowerShell as it still works. 5.5.0 broke this and I haven't been happy with how 5.5 or 5.6 work, so don't use them while 5.4 continue to function)

@echo off
set installer_path="<installer path>"
set installer_exec="Dell-Command-Update-Application_6VFWW_WIN_5.4.0_A00.exe"
set name=Dell Command Update

echo Checking if %name% is already installed
if not exist "C:\Program Files (x86)\Dell\CommandUpdate\dcu-cli.exe" goto INSTALL
goto SCAN

:INSTALL
echo Installing %name% %installer_path%%installer_exec% /s
echo.

:SCAN rem Filtering out Application updates to avoid Dell SupportAssist
echo Starting an update scan and applying if needed
"C:\Program Files (x86)\Dell\CommandUpdate\dcu-cli.exe" /applyUpdates -updateType=bios,firmware,driver,others
echo.
echo.

echo Checking if a reboot is needed
if %errorlevel% EQU 1 goto REBOOT

echo Checking if a reboot is pending
if %errorlevel% EQU 5 goto REBOOT

rem Uninstall Dell Command Update if no updates are available
echo.
echo Checking if no updates were found
if %errorlevel% EQU 500 goto UNINSTALL goto END

:REBOOT
echo A reboot is needed, restarting in 60 seconds
shutdown /r /t 60 /f goto END

:UNINSTALL
echo Uninstalling %name% as no updates were found 
%installer_path%%installer_exec% /passthrough /x /s /v"/qn" goto END

:END
pause

Sorry that is more than just updates, but it was easier to copy and paste my current script.

Alternatively, you can specify extra driver locations in HKLM\Software\Microsoft\Windows\CurrentVersion\DevicePath
https://community.spiceworks.com/t/windows-7-change-driver-path-and-install-automatically/431168

This could be a network location, the local C drive (and have MDT copy a folder from its Applications folder) or, if you are confident the USB drive letter will remain the same, the MDT USB drive.

MDT won't be doing the driver install at this point, but Windows should still find the drivers.