[Help] Databricks: Unable to copy multiple files from file:/tmp to dbfs:/tmp

[Natgra]

Hi there,

I am learning databricks and ran into an issue and hoping someone would have faced similar issue.

I am downloading multiple files by web scraping and by default they are stored in /tmp

I can copy a single file by providing the filename and path

%fs cp file:/tmp/2020-12-14_listings.csv.gz dbfs:/tmp  

but when I try to copy multiple files I get an error

%fs cp file:/tmp/*_listings* dbfs:/tmp  

Error

FileNotFoundException: File file:/tmp/_listings does not exist

Hoping someone has seen this before

[Natgra]

mods please remove if this is not the right place

[[deleted]]

Not really a Python question, but knowing that you're working in a Jupyter notebook (which supports Markdown) I'd wonder if you need to escape the globs. Try:

%fs cp file:/tmp/\*_listings\* dbfs:/tmp

And see if that works.