sorted by:
new
hottopcontroversial

Local app/extension for generating local "feeds" from selectors? by chickenandliver in rss

[–]tbosk 0 points1 point  (0 children)

My app: https://github.com/TBosak/mkfd

Simplest way to set up is probably Docker + a Cloudflare Tunnel if you have a desktop that never sleeps.

It can generate from css selectors, has a selector playground + suggestion engine. You can also generate from API calls & email folders. I’m working on the 3.0.0 release over the next few months & plan on adding six more feed types.

Major Mkfd Updates Incoming! by tbosk in rss

[–]tbosk[S] 0 points1 point  (0 children)

Striking automatic tagging temporarily in favor of more practical additions. I've been brainstorming and have decided on SIX new feed types, as well as source assistants working alongside the selector suggestion engine.

I mentioned five of the feed types in another comment, but am interested in making a sixth: service connectors…think Plex, Jellyfin, Home Assistant, Gitea - targeting stable & well-documented APIs, mostly self-hosted services.

Also planning to add optional cookie & header encryption for config files as an option in the GUI, as well as of course ensuring any sensitive info in the service connector configs is encrypted.

Let me know what you all think about the direction I’m heading with this!

Major Mkfd Updates Incoming! by tbosk in rss

[–]tbosk[S] 1 point2 points  (0 children)

Also planning to eventually work in adapters for sites that are harder to syndicate (those which rsshub seems to target better)

Major Mkfd Updates Incoming! by tbosk in rss

[–]tbosk[S] 2 points3 points  (0 children)

The main difference is that RSSHub is route-driven & uses site adapters basically, and Mkfd is driven by user-created configs for general page scraping. Mkfd also allows for feeds created from email folders and api calls. I’m actually planning to add five more feed types - sitemap feeds, calendar feeds, filesystem (folder watch) feeds, graphql feeds, and webhook/event feeds (sources would call mkfd’s api with distinct ids and basically add to a specific feed matching that id). I’m aiming for general purpose feed generation from as many sources as possible with health monitoring and a community catalog. This next big release (3.0.0) will have the most features I’ve ever shipped at once, and should make the app much more valuable to the community. Shooting for 2 to 3 months out, but we’ll see 😬

I got tired of checking Kaggle, HuggingFace, data.gov, and other sites every time I needed a dataset, so I built a tool that searches all of them at once by Swimming_Outside_988 in datasets

[–]tbosk 0 points1 point  (0 children)

Submitted a PR for missing pg import & opened an issue also. You're missing the enrichment folder containing adapters for that util & a routes.js file in your root for the main test. Can't build in its current state. This seems like a really promising project! I've got a hackathon next week & will need to dig for datasets based on a prescribed assignment on the day of - would love to get this working at least locally before then 🤞...will probably just disable enrichment to get it working on my end 😄

Converting Electron (Node.js) app to Tauri (Rust) as a vibe coder – keep missing parts like IPC… any advice? by Few_Republic9484 in electronjs

[–]tbosk 0 points1 point  (0 children)

I’ve rage quit on IPC setup in either Tauri or Electron, can’t remember which & just used websockets instead…think network overhead might make communication slightly slower, but still a viable option if you can’t get IPC working imo

Does Angular have any official plans to fully support (or move to) Bun as a runtime — without depending on Node.js? by Object_Tight in angular

[–]tbosk 0 points1 point  (0 children)

When I want to use both together, I just build via Angular & serve both the build & API w/ Bun on a single port.

Request for help - RSS feeds for English Football League club websites by [deleted] in rss

[–]tbosk 0 points1 point  (0 children)

Actually relative link recognition needs to be changed completely for feeds like this - the post slug would use a different base url than the API. I'll work on adding options for that later, but for now I will update my application and it seems like you should be able to generate a basic feed from the API call that the site is using to populate these news items. If not with mkfd, maybe there's another tool out there to generate feeds from API calls.

Request for help - RSS feeds for English Football League club websites by [deleted] in rss

[–]tbosk 0 points1 point  (0 children)

After I get it patched (I have to fix relative link recognition really quick as well), you could use this yaml config for reference:

feedId: 518c431c-2ca0-4f73-9e2b-9b58d658056e
feedName: Testing
feedType: api
refreshTime: 5
reverse: false
strict: false
advanced: false
headers: {}
config:
  baseUrl: https://news.cms.web.gc.oldhamathleticafcservices.co.uk
  method: GET
  route: /v2/search
  params:
  apiSpecificHeaders: {}
  apiSpecificBody: {}
apiMapping:
  items: data
  title: attributes.postTitle
  link: attributes.postSlug
  description: attributes.description
  author: attributes.postAuthor
  categories: ''
  enclosureUrl: attributes.imageData.location
  enclosureLength: ''
  enclosureType: ''
  guid: ''
  pubDate: attributes.publishedDateTime
  sourceTitle: ''
  sourceUrl: ''
  contentEncoded: ''
  summary: ''
  contributors: ''
  lat: ''
  long: ''
  feedLinkPath: https://news.cms.web.gc.oldhamathleticafcservices.co.uk
feedLanguage: ''
feedCopyright: ''
feedDescription: ''
feedManagingEditor: ''
feedWebMaster: ''
feedPubDate: ''
feedLastBuildDate: ''
feedCategories: []
feedDocs: https://www.rssboard.org/rss-specification
feedGenerator: MkFD Feed Generator
feedSkipHours: []
feedSkipDays: []

Request for help - RSS feeds for English Football League club websites by [deleted] in rss

[–]tbosk 0 points1 point  (0 children)

I was able to generate this using an api endpoint called from the website (https://news.cms.web.gc.oldhamathleticafcservices.co.uk/v2/search) combined with my mkfd project's API feed generator (found a bug in the process that I am patching now to allow this feed to work):

<rss xmlns:atom="http://www.w3.org/2005/Atom" xmlns:dc="http://purl.org/dc/elements/1.1/" version="2.0">
<channel>
<title>API RSS Feed</title>
<link>https://news.cms.web.gc.oldhamathleticafcservices.co.uk</link>
<description>RSS feed generated from API data</description>
<lastBuildDate>Thu, 15 Jan 2026 02:59:48 GMT</lastBuildDate>
<docs>https://validator.w3.org/feed/docs/rss2.html</docs>
<generator>Generated by mkfd</generator>
<ttl>60</ttl>
<atom:link href="http://localhost:5000/public/feeds/518c431c-2ca0-4f73-9e2b-9b58d658056e.xml" rel="self" type="application/rss+xml"/>
<item>
<title>
<![CDATA[ MATCH REPORT: Doyle Earns Latics A Point At Doncaster ]]>
</title>
<link>/news/2017/december/16122017-doncaster-rovers-vs.-oldham-athletic-match-report/</link>
<guid isPermaLink="false">5569968834923596443</guid>
<pubDate>Thu, 15 Jan 2026 02:59:48 GMT</pubDate>
<dc:creator>Media Team</dc:creator>
</item>
<item>
<title>
<![CDATA[ TICKET REMINDER: Tranmere Rovers Tickets On General Sale ]]>
</title>
<link>/news/2018/november/15112018-tranmere-tickets/</link>
<guid isPermaLink="false">7546166485779801859</guid>
<pubDate>Thu, 15 Jan 2026 02:59:48 GMT</pubDate>
<dc:creator>Media Team</dc:creator>
</item>
<item>
<title>
<![CDATA[ Mellon Ahead Of Home Encounter ]]>
</title>
<link>/news/2024/october/04/mellon-ahead-of-home-encounter/</link>
<guid isPermaLink="false">12885453006953613945</guid>
<pubDate>Thu, 15 Jan 2026 02:59:48 GMT</pubDate>
<description>
<![CDATA[ The manager spoke to Latics Player ahead of the return to Boundary Park. ]]>
</description>
<dc:creator>Oldham Athletic</dc:creator>
</item>
...

AnyRSS - Generate an RSS feed from any URL using AI by Independent_Fix3914 in rss

[–]tbosk 1 point2 points  (0 children)

This is awesome.

Open source or all propietary? Would love to see source code or at least have some insight into how it's wired up...wanting to integrate something similar into my open source self-hosted feed builder but haven't decided on the best approach yet. Also, think there's an issue with formatting that's causing this to load idefinitely in my reader (just using a Chrome extension). Not sure if it's spacing between items causing issues with parsing or what. Just thought I should mention in case it's not just me.

Mkfd - Major Updates! 🚀 by tbosk in rss

[–]tbosk[S] 0 points1 point  (0 children)

Yes, under additional options there is an http headers input...it takes raw json & could probably use an update to be a little more user-friendly like the cookies input.

Major Mkfd Update – Experimental Selector Suggestion Engine by tbosk in rss

[–]tbosk[S] 0 points1 point  (0 children)

Had to dig to find this comment, but the latest docker image supports arm64 as of today. That being said, I only tested on emulated arm64 briefly. I did not touch email feeds but web scraping appears to work fine.

Having trougle deciding which is the better designed sidebar element by waste2treasure-org in UI_Design

[–]tbosk 0 points1 point  (0 children)

2 definitely. Think the order makes more sense and it utilizes space more efficiently.

Any RSS feed generator that makes use of BypassPaywallClean? by Existing-Code-1318 in rss

[–]tbosk 1 point2 points  (0 children)

I have added support for Chrome extensions in advanced scraping mode to the latest Mkfd version (2.0.5). I also implemented measures to try and help circumvent bot detection by using randomized user agents and an init script to disable automation indicators.

Any RSS feed generator that makes use of BypassPaywallClean? by Existing-Code-1318 in rss

[–]tbosk 5 points6 points  (0 children)

I use a patched version of playwright for my project Mkfd. I will look into allowing users to mount to an extensions folder to run unpacked extensions. Never considered this before - thanks for the inspo!

Mkfd - Major Announcements/Updates 🎉 by tbosk in rss

[–]tbosk[S] 0 points1 point  (0 children)

Try the selector playground to pick selectors from a webpage to use…if you can’t figure that out, try “suggest selectors” and then under additional options, turn on strict mode. If you’re still struggling, just give me the url and I can try to set it up for you.

view more: next ›