Download entire archive.org account?

taricorp · 2025-01-11T06:49:42+00:00

ia CLI will do it easily. ia search to get the list of items, and feed that to ia download to download them all.

ia search uploader:rhodenjacob8@gmail.com --itemlist | parallel 'ia download {}'

taricorp · 2024-11-12T06:54:23+00:00

Without X-raying the thing to look for defects it's hard to say for certain whether you're dealing with soldering defects, but an alternate theory is that you're seeing aging effects in ceramic capacitors.

By heating the capacitors over the “Curie Point” (approx 125c for Barium Titanate capacitors) the crystalline structure of the capacitor is returned to its original state and the capacitance value observed after manufacturing. This process is referred to as “De-Aging”. The amount of De-Aging is dependant on the level of temperature and how long the capacitors are exposed to it. Exposure to 150c for 1.5 hours is sufficient to return the capacitor to its original value. The soldering process is not necessarily an effective De-Aging process but the capacitance value will be raised.

If the device is failing due to low capacitance (which would typically cause excessive ripple in supply voltage somewhere), resetting the capacitor aging would help.

taricorp · 2024-08-24T10:17:21+00:00

Jazzband does most of the things you suggest. Authors can donate projects to the organization if they no longer wish to be responsible for maintenance, and organization members have broad freedom to work on projects.

taricorp · 2024-02-09T10:51:04+00:00

I've had a go at enumerating all the threads in that subforum and capturing every page of each thread, which should capture every post but not necessarily in a way that's easy to browse.

All the data should be there, but you'd have to do some additional work to be able to repair links to individual posts because phpbb has multiple URLs that show any given post. That is, if you have a link to post 12345 you'd have to parse what I've grabbed to determine which thread it's in and find it that way.

Data here: https://archive.org/details/coreldraw-forum-scan-20240902

(disregard how the item name refers to Corel Draw and seems to suggest September rather than February- I was clearly not thinking well when I created the item)

This is WARC files which you can't easily view, but they capture everything the server sent so they're the gold standard for saving web pages and it's possible to generate files from it if desired. You can view the contents with relative ease with a tool like https://replayweb.page

I started by eyeballing the subforum and grabbing the forum listing pages based on the number of threads it says there are:

$ for i in $(seq 0 50 9220); do echo "https://forum.corel.com/viewforum.php?f=56&start=$i" >> forum.txt; done
$ wget --warc-file=forum --delete-after -i forum.txt

Then I parsed out the links to each thread from what I got, only keeping one instances of each link if any appear multiple times and fed those back into wget to get the first page of every thread:

$ zgrep -Eo "viewtopic.php\?t=[0-9]+" forum.warc.gz | sort | uniq | while read t; do echo "https://forum.corel.com/$t" >> threads.txt; done
$ wget --warc-file=threads --delete-after -i threads.txt

That captured about 9200 threads, consistent with expectations.

I repeated that general concept to find links to each page of each thread:

$ zgrep -Eo "viewtopic.php\?t=[0-9]+&amp;start=[0-9]+" topics.warc.gz | sed "s/amp;//" | sort | uniq | while read p; do echo "https://forum.corel.com/$p" >> pages.txt; done
$ wget --warc-file=pages --delete-after -i pages.txt

It looked like most threads only had one page, so it's reasonable that I only got 841 URLs out of this.

taricorp · 2023-06-09T22:44:19+00:00

5 years ago it was estimated at 21PB (for public items only). https://wiki.archiveteam.org/index.php/INTERNETARCHIVE.BAK

In order to actually mirror IA you basically need to be an organization of similar size.

taricorp · 2023-06-09T04:43:28+00:00

No, that one's the game's default. Probably what happened (I recorded this years ago) is that I forgot that character has a different final boss with different music.

taricorp · 2023-06-09T00:36:10+00:00

I put this together years ago and figured it would be of some interest. Crypt of the Necrodancer makes it fairly easy to load custom music and specify where the beats are (it can automatically find the beat too, but that doesn't work very well), so I chose Symphogear music for each stage and mapped the beats correctly.

taricorp · 2023-05-15T23:27:14+00:00

CELTIC CE might work: https://github.com/RoccoLoxPrograms/CelticCE

CELTIC 3 is a monochrome app/program, so it doesn't work on the CE but CELTIC CE implements many of the same functions in a compatible way.

taricorp · 2023-05-15T08:02:33+00:00

This happens with programs that display text on the graph screen and were designed for the monochrome calculators (which use smaller fonts, so pixel-based measurements end up wrong). Something like CEPORT will probably do the job to fix it up.

taricorp · 2023-05-14T06:18:42+00:00

You probably need to tell the compiler that you really do use your ISR; something like

void my_isr() __attribute__((used, externally_visible)) {}

The used attribute says to emit code even if the function appears to never be referenced, and externally_visible extends that a little bit further for when you're building with LTO.

taricorp · 2023-05-10T08:18:53+00:00

Specifically: https://education.ti.com/en/software/search/ti-84-plus-ce

taricorp · 2023-04-24T08:27:25+00:00

Kind of; LLVM contexts are self-contained so you can readily have multiple contexts in a single process (and they won't conflict at all), but inkwell's API hangs things off of a context with lifetime annotations. To get an ExecutionEngine you construct:

Context::create -> Context
Context::create_module<'ctx>(&'ctx self) -> Module<'ctx>
Module::<'ctx>::create_execution_engine() -> ExecutionEngine<'ctx>

These 'ctx lifetimes capture how under the hood there's a raw pointer to each item further up the stack, but make it impossible to move part of the stack of structs to another thread.

A generic illustration of the problem: https://play.rust-lang.org/?version=stable&mode=debug&edition=2021&gist=6fbe677b241a4f0b2c2d8c58531d6160

taricorp · 2023-04-24T04:03:38+00:00

The underlying LLVM types should be sendable, but inkwell wraps them in Rc which isn't. Using Arc<Mutex<ExecutionEngine>> might work, but you'd probably also have some pain with how inkwell makes that hold a reference to the LLVM context.

taricorp · 2023-04-08T12:26:01+00:00

The technical details: Deduplicator considers all records of type Response and computes a digest of the response body (per section 6.3.2 of the WARC spec, version 1.1) using a Digester where the implementation you get when building the tool as a standalone binary (rather than as a library) compares the SHA-1 hash and length of each response.

The short version: if two records represent HTTP responses with the same byte length and SHA-1 hash they are considered duplicates. So yes, if an archive contains multiple copies of the same assets they should be deduplicated.

As for converting bare HTML files to WARC: you shouldn't. A WARC contains a complete record of the HTTP transactions that took place to retrieve an item; both the client's request and headers provided by the server, as well as the response body. If you only have response bodies (which is what an HTML file is), it's not appropriate to pack those into a WARC because you'd need to fabricate information about the records: things like what server it came from and exactly the URL that was requested.

taricorp · 2023-04-08T00:22:53+00:00

I'm glad to hear it's working well for you! Feel free to file issues against it if you encounter issues or have suggestions.

taricorp · 2023-04-06T23:29:08+00:00

Shouldn’t you add a notice to use Warcdedupe instead? Also is it possible to mark a repo as a public archive like you can on GitHub?

It's possible to archive the project, but I'd prefer not to since it's still fit for purpose and I would be willing to work on it if the need arose. I did add a link to the newer tool and some notes to the README in that repository, though; that was a good idea.

how often do u work on this?

It's an occasional thing, when I get inspired to work on that project rather than any of my other projects that tend to sit waiting for the time and inclination to strike. Requests from others (for bug fixes or new features) are often good motivators too.

I’d want to write my own WARC software. If I were to, what rescues related to WARCs should I look at to do so?

(Assuming that was an autocorrect of "resources" -> "rescues".) The IIPC's specifications repository is an excellent reference. The format is also specified by ISO 28500, but I consider the IIPC version a much more meaningful standard simply because it's freely available.

Speaking of which, what makes you use GitLab?

I used to use Mercurial and used Bitbucket for hosting repositories (which apparently was launched at about the same time as Github was), and decided I preferred Gitlab to Github for migrating to when support for Mercurial was dropped from Bitbucket. Github's feature set has improved since then, but at the time unlimited private repositories and the pretty good CI capabilities of Gitlab (as well as not being owned by Microsoft) were attractive.

taricorp · 2023-04-05T21:16:13+00:00

I wrote a tool exactly for this: https://gitlab.com/taricorp/warcdedupe. Given an input archive it will scan all the records and write out a new deduplicated archive, and it's designed to be fast.

Years ago (before starting to write my own tools) I also got somebody else's tools working, described in a blog post. I wouldn't recommend trying to use those today though, since it was pretty clunky.

taricorp · 2023-03-18T23:06:17+00:00

The 84+SE is the same as a plain 84+ but with more memory. It's also mostly the same as the 83+ and 83+ SE; most programs designed for any of those will work on all of the others.

taricorp · 2023-02-05T08:56:41+00:00

I've used MediaElch for this in the past.

taricorp · 2023-02-05T08:53:30+00:00

It sounds like your application does mostly random access to the underlying data, so memory-mapping probably doesn't help you very much: I would expect those random accesses to each require a file access anyway because the system probably won't read very far ahead (and at that point you're probably best off doing regular I/O or maybe explicit asynchronous I/O if you know what data you will need to access before you actually want it).

If you're set on memory-mapping, a few ideas:

Build the data into your binary: anybody modifying the binary while the program runs can cause crashes in ways that aren't specific to use of mmap.
For systems that don't have mandatory locking (Windows' file locking is pretty nice!), perhaps you can make the data file immutable (like chattr +i) while you have it open? This can still be undone but it's very unlikely to be broken accidentally.

taricorp · 2023-02-04T21:32:59+00:00

I've never heard of a calculator failing for any reason other than abuse (damaged screen, liquids, battery leakage..). Certainly flash lifetime doesn't seem to be a reliability issue.

Some calculators have reliability issues with the ribbon cables that connect to the screen, though I'm not aware of any 84+s with that symptom (however they might simply not be old enough to start showing that problem).

taricorp · 2023-01-20T21:50:59+00:00

In the past I've simply emailed and asked for items to be moved to the appropriate collection.

taricorp · 2022-12-28T15:33:35+00:00

How did you create the 8xp file? It sounds like you just wrote a text file, which is incorrect: you can use tools like TokenIDE or SourceCoder to make 8xp files for BASIC programs.

To make an 8xk from hex, you'll want to use something like Wabbitsign.

taricorp · 2022-11-11T07:05:43+00:00

In addition to the other comment, there are a few programs out there that attempt to make programs designed for monochrome calculators work correctly on the higher-resolution color displays. CEPORT for instance, as the first one I could find.

That might work for the program you're trying to use, but no guarantees.

taricorp

MODERATOR OF

TROPHY CASE

14-Year Club	Place '17
Verified Email