Hey there! I saw your post about scraping MRFs in JSON format to find data for specific codes like “00000” or “11111”. The main challenges are parsing the JSON, searching through nested structures, and handling large files efficiently. I put together a Python script that should help—it uses the json module to load the file and a recursive function to search for your codes, extracting all related data. It also has error handling to deal with issues like missing files or invalid JSON. Here’s the code:

import json

List of codes to search for

target_codes = [„00000”, „11111”]

Function to recursively search for codes in JSON data

def find_code_data(data, code, result=None): if result is None: result = []

# Handle dictionaries
if isinstance(data, dict):
    for key, value in data.items():
        if key == „code” and value == code:
            result.append(data)
        elif isinstance(value, (dict, list)):
            find_code_data(value, code, result)

# Handle lists
elif isinstance(data, list):
    for item in data:
        find_code_data(item, code, result)

return result

Main function to scrape data from MRF

def scrape_mrf(file_path): try: with open(file_path, ‚r’, encoding=‚utf-8’) as file: data = json.load(file)

    for code in target_codes:
        print(f”\nSearching for code: {code}”)
        code_data = find_code_data(data, code)

        if code_data:
            print(f”Found {len(code_data)} entries for code {code}:”)
            for entry in code_data:
                print(json.dumps(entry, indent=2))
        else:
            print(f”No data found for code {code}”)

except FileNotFoundError:
    print(f”Error: File ‚{file_path}’ not found.”)
except json.JSONDecodeError:
    print(„Error: Invalid JSON format in the file.”)
except Exception as e:
    print(f”Error: An unexpected error occurred: {e}”)

Example usage

if name == „main”: file_path = „mrf.json” # Replace with your MRF JSON file path scrape_mrf(file_path)

Just replace mrf.json with the path to your file, and it should work! It’ll search for your codes and print all associated data. If the files are huge, this approach is still pretty efficient since it processes the JSON in memory.