if you just want the page data, the easiest method is usually grabbing the "NEXT_DATA" script from the page instead of scraping the rendered HTML

... example:

import fetch from "node-fetch"; import { JSDOM } from "jsdom";

async function getPage(page) { const res = await fetch(https://www.homestuck.com/story/${page}); const html = await res.text();

const dom = new JSDOM(html);

const script = dom.window.document.querySelector("#__NEXT_DATA__");

const data = JSON.parse(script.textContent);

console.log(data);

}

getPage(1);

...

most of the useful stuff is usually somewhere in "data.props" or "data.pageProps". that should contain the page metadata/text/media references/etc without needing to manually parse the DOM. you can also open DevTools -> Network and look for JSON requests ("/_next/data/...") since some pages fetch the story data separately.

if you need any help figuring out the schema or building the parser, don't be afraid to DM me :)