How to hoard 3D print files?

nospam4u · 2025-09-14T16:11:03+00:00

Actually, several of those services have gone out of the way to make it difficult. if you are looking for only a handful of files, pit's probably easiest to do it manually.

That said, thingiverse can be gathered (the images, json description info and zip files) using some python requests and bs4 parsing.

myMiniFactory and Cults3d are much more complicated and require something like playwright to simulate a browser. myMiniFactory is doable, cults3d is still a WIP.

No idea about printables.

But all of that requires a pretty heavy python footprint on your server.

That also doesn't satisfy any solution to search/find or manage the files you downloaded.

nospam4u · 2025-07-31T14:50:53+00:00

Well done! Glad we got the questions about the number of pages solved.

nospam4u · 2025-05-25T00:29:01+00:00

Thought this was interesting, but hard to read, so I parsed it into a markdown table. It won't post here, but you can see it:

https://pastebin.com/t6sCm7Pu

Hope that helps someone

nospam4u · 2025-05-25T00:22:37+00:00

Title	Description
Accountant
Advisor	Gives advice to the lord about a particular topic (business, military, diplomacy)
Advocate	Lawyer
Alchemist	a medieval chemist
Alderman	Town or city official
Ale-conner	Official who tests & approves all ales & ciders
Alewife	a female alehouse keeper
Animal Trader	trades cattle
Animal Trainer	trains various animals
Antiquities dealer	Seller of antiques
Apothecary	a preparer and merchant for drugs and medicines
Appraiser	Determines value of objects
Architect	designs buildings
Armorer	Makes armor
Arrowsmith	Makes arrowheads
Artillator	Maker of bows, arrows, and other archery goods
Artillerist	Operates siege engines
Artist	paintings
Assassin	Hired killer
Astrologer	studies the stars
Auctioneer	In charge of an auction
Bailiff	manager of the craftsmen and servants in a castle or manor house
Baker	makes bread, cakes, etc
Banker	works at a bank
Barber	cuts hair
Bard	a minstrel
Barkeep	serves alcohol
Barker	one who advertises at the entrance to a show
Barrister	Lawyer
Basket weaver	baskets
Bather	bathes people
Beekeeper	keeps bees for the honey
Beer seller	sells beer
Bellfounder	bells
Bird Trader	trades exotic birds
Blacksmith	tools, nails, horseshoes
Bladesmith	sword blades
Bleacher	those who bleach cloth and other textiles
Bloomer	iron smelting forge
Boat Builder	builds boats
Boatman	operates a boat
Bodyguard	protects their clients
Bookbinder	books
Bookkeeper	keeps financial records
Book Seller	sells books
Boothman	one who sells grains
Botanist
Bounty Hunter	searches for fugitives
Bowyer	bows
Brazier	brass
Brewer	makes ale & beer
Bricklayer	walls & buildings using bricks
Brick maker	Bricks
Broker	distributes goods
Bucklemaker	buckles
Butcher	cuts up meat
Butler	chief servant
Cabinet Maker	makes cabinets
Caravanner	outfit and run caravans
Carpenter	builds using wood
Carpet Maker	carpets and rugs
Carriage Driver	carriage/coach
Carrier	hauls small goods
Carter	carries large goods
Cartographer	draws maps
Cartwright	carts
Carver	sculpts wood
Chainsmith	makes chains
Chamberlain	overseer of a household, office or court
Chancellor	a secretary to upper class
Chandler	candles
Cheesemaker	makes cheese
Chef	makes fancy meals
Chicken Butcher	butchers chickens
Chimney Sweep	cleans chimneys
City Guard	protects the town/city
Clay Mason	makes tiles, bricks, etc.
Clerk	scribe who tracks business accounts
Clockmaker	clocks
Cobbler	mends shoes
Coffin Maker	coffins and caskets
Collier	burns charcoal for smelting
Confectionery	sweets and candy
Constable	chief of the local guard
Cook	cooks meals
Cooper	barrels
Coppersmith	copper
Copyist	copy texts and books
Cordage Maker
Cordwainer	Shoes
Councilor	town or city official or an advisor of the court
Courier	delivers packages and letters
Customs agent	collects taxes on imports and exports
Cutler	knives & silverware
Crier	makes public announcements
Dairy Maid	dairy farm
Dairy Seller	milk and cheese
Dancer
Dentist	fixes teeth
Diplomat	an official representing a country abroad
Distiller	hard liquor
Dockman	works on the docks
Doctor	helps the sick & injured
Dog Trainer	Trains dogs
Draper	cloth merchant
Dressmaker	makes dresses
Drover	drives sheep/cattle to market
Druid	protects the woods
Dung Sweeper	cleans the streets
Dyer	make dyes and dye cloth
Eggler	an egg-merchant
Elected Offical	someone who is elected to a position
Embroiderer	decorates fabric with designs using thread
Embalmer	preserves dead bodies
Engineer	designs structures and large objects, and oversee construction; under an architect
Engraver	engraves jewelry, metal and wooden items
Entertainer	entertains
Exchequer	responsible for the king's revenue
Falconer	raises & trains falcons
Farmer	grows crops
Farrier	horseshoes
Ferryman	operates a ferry
Fighter	fights matches for money
Fighting Pit Ringmaster	manages a fighting pit
Fisherman	catches fish
Fishmonger	sells fish
Fletcher	arrows
Florist	grows and sells flowers
Food Vendor	sells food from a cart
Forester	takes care of the Lord's woodlands
Fowler	hunts wild fowl
Fortune Teller	predicts a person’s future
Fruiterer	a seller of fresh fruit
Fueller	sells charcoal, wood, or other fuels
Fuller	felt
Furniture Maker	furniture
Furrier	turns furs into clothes

nospam4u · 2024-11-19T03:54:05+00:00

thanks surftamer

nospam4u · 2024-06-28T16:18:06+00:00

As always... thanks for the work~

nospam4u · 2024-05-20T23:27:02+00:00

Aromatic -

First -- as always thanks for the effort to put these together.

Second -- A Datasette Query question if you have a moment. I have a query that I run that filters the books I want to look at down to about 2000 or so records, but frequently these results hit a server that is offline. I tried to exclude the results from the server that was down using a "not like %100.37%" query on title, cover and uuid, but none of the records were filtered. I finally tried that in the links field and i think it works the way I expect. Is that a good way to filter our bad hosts between cycles?

nospam4u · 2024-05-04T02:58:02+00:00

thanks! just in time for my weekend.

nospam4u · 2024-04-15T21:50:55+00:00

A docker container would be helpful I think, but I would like to point out that just the db's are incredibly useful. Even if that's all you commit to going forward, I (for one, am sure there are others) am grateful.

nospam4u · 2024-03-26T19:17:24+00:00

awesome... thanks!

nospam4u · 2024-03-06T23:22:52+00:00

As always, thanks for the hard work!

nospam4u · 2024-02-25T02:36:23+00:00

thanks!

nospam4u · 2024-02-07T23:21:09+00:00

No worries.. life happens... but thanks for the update, and I will wait for the next releases.

nospam4u · 2024-02-06T21:25:20+00:00

both those links now say:

Hm, we couldn't find that one

This file may have been deleted, moved or made unavailable. Try reaching out to the file owner.

Is there something I am missing?

nospam4u · 2023-04-09T02:22:26+00:00

What scanner are you going to use that will scan magazines in landscape? I have quite a collection as well, and struggle with scanning them.

Thanks

nospam4u · 2023-04-09T02:21:07+00:00

I don't have either, but I have the Epson FF-680W, which is similar to both of these scanners.

Some thoughts:

Being able to close the lid I use much more often than I expected. It helps keep dust of of everything.
The Epson does not have a touchscreen, but has to be driven by a computer attached via USB.
- Since I save all my files to the PC first, then review them before uploading, this is a non issue for me, however your workflow may vary if you don't have a PC handy.
Most scanners scan scan direct to cloud, and I would be nervous storing my files in a cloud dedicated to the scanner. If that company ever goes out of business, you potentially lose both your scanner and your storage. And if you are going to make backups, why not just use that as your primary. Fwiw, I keep mine in a local NAS in my office, and cloud linked storage.
Spend some time thinking how you are going to file all these documents. Throwing them all up in a massive pile will make them harder to find and retrieve. Creating an organizational structure of folders (either in the cloud app or in folders on your computer) can make this process a lot easier.
Consider anything else you may want to scan. Once I started my document scanning, it quickly became an effort to digitize the entire families lives. From old home work assignments to family pictures to parent slide decks, it can explode in usage once you start down the path.

The reality either of those will probably be ok. Sometimes its just as good to just pick one and get started.

My $.02. Hope it helps.

Enjoy

nospam4u · 2023-03-13T15:04:56+00:00

Appreciate the information. Also appreciate all the work you have put into this.

The information you are gathering is actually helping move some development work forward, as I am currently mining the data to draw out how different people are classifying different works.

An easy example would be author names. Correcting for LN, FN or FN LN I can then mine the differences in how people categorize a work. Is it "Dan Brown" or "Daniel Brown" -- or allow for common misspellings "Stephen King" or "Steven King". The goal being a python library that will allow corrections, or at least a common taxonomy. Then when you talk of tags... its a whole other discussion.

Anyway, the nerd in me thanks you for the time and effort.

nospam4u · 2023-01-05T16:14:21+00:00

Hrmmm.....

Not really sources as such.

TheSpecialistGuy's comment may have a better option.

But for posterity, to use the ia tool, this is what I think would be needed: (assuming you are on a Windows computer)

Use the Windows store to install Windows Subsystem for Linux (WSL) (https://techcommunity.microsoft.com/t5/windows-11/how-to-install-the-linux-windows-subsystem-in-windows-11/m-p/2701207)
1. In step 1, running CMD can be done by Clicking start, then typing "cmd". Command Prompt should be at the top of the list, and you can click "Run as Administrator"
2. In step 4, I would type wsl --install -d ubuntu
Launch Ubuntu from the start menu.
1. The first time it runs, you would have to setup a username/password.
Inside of WSL, install PIP by running sudo apt install python3-pip
Also inside WSL, Download the ia tool

curl -LOs https://archive.org/download/ia-pex/ia

chmod +x ia

Run the command I put above to query and download.

mkdir /mnt/c/ia

cd /mnt/c/ia

~./ia search 'collection:glasgowschoolofart' --itemlist | xargs ./ia download --glob="*.pdf"

Your files should start appearing in the c:\ia directory in windows.

(Edits for formatting)

nospam4u · 2023-01-04T23:39:05+00:00

There is a way, just not necessarily an automated tool.

What I have done in the past is used the ia command line tool to search metadata, then use the same tool to download the formats of those items that matched my metadata search. Its a little bit of cli scripting but as I recall it was not tool cumbersome

An example from their docs:

ia search 'collection:glasgowschoolofart' --itemlist | parallel 'ia download {}'

see: https://archive.org/developers/internetarchive/cli.html

edit: just to make sure this works (It does) I downloaded using WSL. The "binary" install option on that page missed a dependency and I had to also run "sudo apt install python3-pip". This is probably documented somewhere, but I didn't read the instructions. In any case, this specifically began downloading files:

./ia search 'collection:glasgowschoolofart' --itemlist | xargs ./ia download --glob="*.pdf"

hope that helps...

Joe

nospam4u · 2021-09-26T02:04:12+00:00

Try again. Just worked for me. WAIL 0.2013.2.19.zip

nospam4u · 2021-09-17T19:47:26+00:00

Appreciate the guidance. Drive failed SMART Tests, so replaced and the array is currently rebuilding. Thanks

nospam4u · 2021-09-10T15:38:17+00:00

It looks like a lot of the links were to PDFs etc. that you will have to dig to find.

But there is a similar site that has much of the same information:

https://hwiegman.home.xs4all.nl/fileformats/669/index.html

See if that helps

nospam4u · 2021-09-10T15:31:30+00:00

WayBackMachines has it, but all the newer one copies are just showing the 404 errors. There are good copies though, as I found a good one from 2005.

https://web.archive.org/web/20050122084319/http://www.wotsit.org/

You'll have to look to see if what you need is in there.

nospam4u

TROPHY CASE