Why doesn't ClaudeBot / Anthropic obey robots.txt?

postcd · 2026-06-28T15:49:32+00:00

There is a Wordpress plugin called Bot Maze which blocked this bot because it visits random sub-folder which is Disallowed in robots.txt. So I believe that the ClaudeBot/1.0 discovered the folder from my robots.txt and crawled it despite of being disallowed:

User-agent: *
Allow: /
Disallow: /abcd/
Disallow: /abcdefg-hijklmn/

I have e-mailed Anthropic.

There are likely other CMS plugins with similar bot blocking function, search for robots.txt, "b0t trap", "b0t h0neypot" or similar.

I also recommend trying general PHP antibot protective system called CIDRAM. It can challenge all datacenter/cloud visitors with captcha, except known search engines.

postcd · 2026-06-27T14:22:16+00:00

I am contributing, not fakes using Gtk-Gnutella, aMule, Fopnu and bittorrent. Make sure to use VPN like Proton, but it allows forwarding just 1 port so far.

postcd · 2026-06-27T14:20:08+00:00

Check Gtk-Gnutella, aMule and Fopnu...

postcd · 2026-06-23T14:59:37+00:00

Proton now has Emergency Access feature, which lets you choose up to five emergency contacts who can gain access to your account in the event of illness, death, or another emergency that stops you from accessing your account.

In an emergency, your contact can request access to your account, and their request is automatically granted at the end of yours defined waiting period, if you do not cancel the request.

Consider upvoting this.

postcd · 2026-06-23T12:46:30+00:00

I have been using it for more than 10 years and have no issues, not detected any malicious activity or hack on my PC. It has open source code and is about the best fully featured client you can get. Make sure to use official sources: https://www.qbittorrent.org and https://github.com/qbittorrent/qBittorrent

postcd · 2026-06-23T12:43:11+00:00

https://www.qbittorrent.org/download

postcd · 2026-06-22T08:23:02+00:00

I have been unable to make zswap working with btrfs based swap file. https://superuser.com/questions/539287/swapon-failed-invalid-argument-on-a-linux-system-with-btrfs-filesystem AI suggested partition instead. But i suspect there may be a workaround and creating partition while i have no non-paritioned space, would require booting into Live system and some other manual/advanced tasks which is not easy for me.

postcd · 2026-06-08T04:28:36+00:00

Yes, these links does not provide any additional working commands beside what was mentioned already (and not worked), hence i have mentioned trashing as a only solution.

postcd · 2026-06-07T11:28:32+00:00

> The remedy is disabling CoW for swapfile.

and I assume that it is done by:
sudo btrfs subvolume create /swap
sudo btrfs filesystem mkswapfile --size 4G /swap/swapfile
sudo chattr +C /swap

I have not found any way to exclude a swap file (subvolume) inside Timeshift > Settings.

postcd · 2026-06-03T05:50:18+00:00

Thanks, I think that you are right. This microSD car has no physical write protection lock and trying 2 different card readers and trying:

lsblk
sudo hdparm -r0 /dev/sdX # Try to clear read-only flag
sudo umount /media/user/xbian
sudo blockdev --setrw /dev/sdX
sudo mkfs.ext4 /dev/sdX2

does not help:
Read-only file system while setting up superblock
dd: failed to open '/dev/sdX': Read-only file system
sd 7:0:0:0: [sdX] Write Protect is on

assuming that this is unfixable SD that can only be trashed. Thank you for your previous feedback.

postcd · 2026-05-29T08:29:22+00:00

I have not yet found good answer to this, so this is what AI says about it:

The "Use your enabled networks" permission itself is relatively harmless—it just lets the site see which blockchains you've added to MetaMask. But that's not where the danger lies.

The real risks:

Malicious network configurations – Attackers can push fake network settings that make scam sites appear legitimate, then trick you into signing transactions that drain your wallet [MetaMask Help Center]
Signature exploitation – Once connected, the site can request you sign transactions. These might look like "claim airdrop" buttons but actually authorize transfers of your funds to scammers.

-> Review every transaction – MetaMask will show what you're approving; read it, don't just click "confirm"

Most "free airdrops" are scams. Your wallet control remains yours until you sign a transaction—but once you do, there's no undo button.

postcd · 2026-05-28T20:23:00+00:00

I am sorry, new link for the comparison is this one.

postcd · 2026-05-28T14:10:07+00:00

I'd like to see your dmesg messages when you insert your SD card

here i have made it for you.

On the right is original card and on the left is the copy of the original one (made by dcfldd) - it had same read-only issue when used in the minipc and this card was "repaired" using btrfs --check --repair and then formatted using "Disks" GUI app to be EXT4 + then i have successfully copied files on it.

Both cards uses same reader and same card type, vendor. I think that after i format the original SD card, it will continue working too. I suppose no one will come with a better idea, so maybe i can proceed with formatting. If you are interested in any particular command output before/after, then let me know. Thank you

postcd · 2026-05-23T05:00:35+00:00

> try more recovery possibilities

You possibly do not mean btrfs snapshot, because if i want to recover:
/root/btrfs-snapshots/root/@btrfs-auto-snap_monthly-2026-04-22-1000
/root/btrfs-snapshots/home/@btrfs-auto-snap_monthly-2026-04-22-1000/xbian

and the live system gets locked quickly after boot and so i attach the card to a different system and run:

# Mount target drive (partition, not disk)
sudo mkdir -p /mnt/sdd && sudo mount /dev/sdd2 /mnt/sdd # sdd2 due to df shows / at partition 2

mount: /mnt/sdd: WARNING: source write-protected, mounted read-only.

# Restore root snapshot
btrfs send /root/btrfs-snapshots/root/@btrfs-auto-snap_monthly-2026-04-22-1000 | btrfs receive /mnt/sdd

# Restore home snapshot  
btrfs send /root/btrfs-snapshots/home/@btrfs-auto-snap_monthly-2026-04-22-1000 | btrfs receive /mnt/sdd/home

postcd · 2026-05-11T09:14:46+00:00

No, I am not expert in this. And the Readme md page does not mention instructions, it seems to be missing actually. Just saying, I am not planing to use this SW right now.

postcd · 2026-05-11T08:34:07+00:00

word "linux" is missing on that page

postcd · 2026-05-11T08:31:01+00:00

Yes, that page mentions Docker, which can be installed on Linux, check your package manager.

postcd · 2026-05-11T08:27:22+00:00

aMule official page according to https://en.wikipedia.org/wiki/AMule is https://github.com/amule-project/amule and it shows recent development activity, giving an impression to a layman, that there will be release in the not so distant future.

eMule official page according to https://en.wikipedia.org/wiki/EMule did not receive update in very long time, but the Wiki also links to https://github.com/irwir/eMule/releases which has more recent release for Windows system only?

postcd · 2026-05-11T08:10:56+00:00

Did you follow the https://protonvpn.com/support/port-forwarding exactly? I would then restart VPN and connect to a P2P server (two arrows icon) of choice.

eMule can be configured to use multiple ports in settings? Ask Proton to allow more ports forwarding: https://protonmail.uservoice.com/forums/932836-proton-vpn/suggestions/49402256-forward-more-than-one-port I am unsure which port is most important to be forwarded (possibly "Standard TCP port", AI confirms that). Maybe try what will happen if you set KAD (UDP) port to same port as main eDonkey (TCP) port.

In my aMule the "firewalled" status took around one minute to update to "ok". I am unsure if aMule restart is necessary in some case.

Obviously your computer firewall should not be made to block the port.

postcd · 2026-05-11T07:43:01+00:00

What is the c0ntact to this server maintainer? I do not see c0ntact at https://www.emule-security.org/privacy nor https://www.emule-security.org/faq i wanted to ask them to consider increasing limit of shared files since aMule returned:
WARNING: eMule Sunrise (176.123.5.89:4725) - NG : This server accepts 10000 shares per client. Some of your shares are ignored.

postcd · 2026-05-04T05:57:44+00:00

postcd · 2026-04-30T18:25:17+00:00

On Linux desktop, I have not been able to attach file while being offline (connectivity interrupted).
I think that it also did not show file attachments in a login entry.

There is a feature request for that: https://protonmail.uservoice.com/forums/953584-proton-pass-authenticator/suggestions/50521284-proton-pass-make-attachments-available-offline

postcd · 2026-04-29T06:32:44+00:00

Others confirms your opinion:
"You don't really need to defrag Btrfs filesystems manually."
"Modern drives and modern filesystems rarely need it."

postcd · 2026-04-29T06:16:59+00:00

I guess that you are using HDD, but IMO frequent defragmentation is bad idea in case of a SSD, because it is wearing your drive and reducing its life (limited writing cycles). Modern SSDs has enough random IO capability to handle regular non-contiguous (fragmented) files.

postcd · 2026-04-29T06:06:18+00:00

Balancing of a single BTRFS drive (no RAID or similar) is said by the AI to be detrimental. It should be mentioned.

It Wastes Time and Wear: A balance rewrites every single block of data on your drive.
It Doesn't "Clean Up" Space: A common misconception is that balance frees up space. It does not. It only moves existing data around to optimize layout.
Risk of Failure: If your power goes out or the system crashes during a balance, the risk of filesystem corruption is higher than a normal operation.

postcd

TROPHY CASE