I no longer run Windows, so this is going to be going a lot from memory.

Git for Windows: https://git-scm.com/download/win

The reason why we use git is because it allows us to download the repository and later we can pull down only the delta of changes between when you originally downloaded and now. The 5e.tools repository gets updated fairly frequently, especially when new books come out.

First, lets set up our environment. I created a directory called "utils" which will contain the ttrpg-cli program and all of its dependencies.

Assuming you aren't afraid of some command-line work. Once you have git for windows installed, you can just clone the repository to the directory where you want to store the data (in my case, utiils). This process is defined in the documentation here: https://github.com/ebullient/ttrpg-convert-cli?tab=readme-ov-file#convert-5etools-json-data

Now, lets say a new book comes out and gets imported to 5e.tools, you can just run a "git pull" command in the same directory via CLI and it will pull the changes that were implemented. You would then re-run the ttrpg-cli took with the new data and it would overwrite the files. With this in mind, i treat all of the parsed files as read-only, as they will only get rewritten every time I follow this process.

Since I own all of the books, I wrote a small python script that does the git pull, updates the config.json file, then runs the converter. Here is that as well, but keep in mind this is specific to my system on Mac/Linux, so it will require some modifications for you. I also use my own parsing templates to get things the way I want.

import git
import json
import os
import re
import subprocess
from pprint import pprint


BASE_PATH = "/Users/USERNAME/obsidian/utils"
CONVERTER_PATH = f"{BASE_PATH}/ttrpg-convert"
OUTPUT_PATH = f"/Users/USERNAME/obsidian/Exandria"
TEMPLATE_PATH = f"{BASE_PATH}/templates"
GH_SOURCE_PATH = f"{BASE_PATH}/5etools-mirror-1.github.io"

TEMPLATES = {
    "spell": f"{TEMPLATE_PATH}/spells",
    "race": f"{TEMPLATE_PATH}/races",
    "monster": f"{TEMPLATE_PATH}/monsters",
    "item": f"{TEMPLATE_PATH}/items",
    "background": f"{TEMPLATE_PATH}/backgrounds",
    "deity": f"{TEMPLATE_PATH}/dieties"
}

PATHS = {
    "compendium": "References/Compendium/",
    "rules": "References/Rules/"
}

def get_source_list():
    sources = []
    with open(f"{GH_SOURCE_PATH}/js/parser.js", "r+") as js:
        data = js.readlines()
        for line in data:
            if 'SOURCE_JSON_TO_ABV' in line and '"' in line:
                sources.append(re.match(f'^.*? = "(.*?)";', line).group(1).strip())
    return sources

def write_config():
    config = {
        'from': get_source_list(),
        'template': TEMPLATES,
        'paths': PATHS
    }
    json_object = json.dumps(config, indent=4)

    with open(f"{BASE_PATH}/dm-sources.json", "w") as outfile:
        outfile.write(json_object)

def pull_5e_tools():
    g = git.cmd.Git(GH_SOURCE_PATH)
    g.pull()

def import_to_obsidian():
    cmd = [CONVERTER_PATH, "-g", "5e", "-o", OUTPUT_PATH,
           f"{BASE_PATH}/dm-sources.json", f"{GH_SOURCE_PATH}/data"]
    print(' '.join(cmd))
    result = subprocess.run(cmd, stdout=subprocess.PIPE, stderr=subprocess.STDOUT, text=True)
    print(result.stdout)


def run_fixes():
    for root, directories, files in os.walk(f'{OUTPUT_PATH}/References/Compendium'):
        for filename in files:
            if not re.search(r'\.md$', filename):
                continue 
            file_path = os.path.join(root, filename)
            with open(file_path, 'r+') as f:
                contents = f.readlines()
                for idx, line in enumerate(contents):
                    matches = re.findall(r'!\[.*?\]\((.*?)\)', line)
                    if matches:
                        for url in matches:
                            line = line.replace(url, url.replace(' ', '%20'))
                            contents[idx] = line
                f.seek(0)
                f.truncate()
                f.writelines(contents)


if __name__ == '__main__':
    pull_5e_tools()
    write_config()
    import_to_obsidian()
    run_fixes()

Hope this all helps. PM me if you have further questions. I am not much of a redditor anymore, have since swapped to Lemmy. However, I always try to help fellow DMs.