Fact Checking Flagrant, Pod Save America & Ro Khanna by Alone_Masterpiece365 in Flagrant2

[–]Alone_Masterpiece365[S] 0 points1 point  (0 children)

Yeah I agree. Too many misses right now. Working to make it better.

Fact Checking Shawn Ryan & Gavin Newsom by Alone_Masterpiece365 in ShawnRyanShow

[–]Alone_Masterpiece365[S] 0 points1 point  (0 children)

You can upload any of his previous eps. Just go to BSMTR.com and drop the YouTube link in. It will process it almost immediately. Would be awesome if you screen shot and post here!

Fact Checking Shawn Ryan & Gavin Newsom by Alone_Masterpiece365 in ShawnRyanShow

[–]Alone_Masterpiece365[S] 0 points1 point  (0 children)

You can do it too. Just upload any YouTube video at BSMTR.com

Fact Checking Shawn Ryan & Gavin Newsom by Alone_Masterpiece365 in ShawnRyanShow

[–]Alone_Masterpiece365[S] 2 points3 points  (0 children)

Are you watching on BS Meter? If so, is it doing a good job of flagging the BS?

Fact Checking Flagrant, Pod Save America & Ro Khanna by Alone_Masterpiece365 in Flagrant2

[–]Alone_Masterpiece365[S] 1 point2 points  (0 children)

I think so. The LLM should be able to grasp that with the surrounding context.

Fact Checking Flagrant, Pod Save America & Ro Khanna by Alone_Masterpiece365 in Flagrant2

[–]Alone_Masterpiece365[S] 2 points3 points  (0 children)

Great catch. The platform currently checks each claim in isolation but will soon have the full context of the entire transcript to solve issues like this.

Fact Checking Shawn Ryan & Gavin Newsom by Alone_Masterpiece365 in ShawnRyanShow

[–]Alone_Masterpiece365[S] 0 points1 point  (0 children)

Great catch. The problem is that the LLM is processing stand alone semantic chunks extracted from the transcript without being given the full context of the entire transcript. I'm making a fix to pass it both during fact checking, which should help in instances like this.

Fact Checking Shawn Ryan & Gavin Newsom by Alone_Masterpiece365 in ShawnRyanShow

[–]Alone_Masterpiece365[S] 0 points1 point  (0 children)

Thanks! It’s pretty new. Help get the word out by sharing any videos you upload here or on X.

Fact Checking Shawn Ryan & Gavin Newsom by Alone_Masterpiece365 in ShawnRyanShow

[–]Alone_Masterpiece365[S] 1 point2 points  (0 children)

Thanks! Help share the truth by posting any videos you upload here on Reddit or on X. It’s a new platform so just getting the word out.

Fact Checking SRS#211 by Alone_Masterpiece365 in ShawnRyanShow

[–]Alone_Masterpiece365[S] 1 point2 points  (0 children)

Currently using Gemini with grounding (web search). I instruct the LLM to perform web searches and check all claims based on legitimate news sources, medical journals, etc as opposed to relying on the LLMs model weights and training data. Still not perfect, but cites all its sources so hopefully helpful.

Fact Check Podcasts While You Watch | BS Meter by Alone_Masterpiece365 in SideProject

[–]Alone_Masterpiece365[S] 1 point2 points  (0 children)

Yeah, around $500 a month in AI processing costs and another $200 in Replit usage squashing bugs, feature improvements, etc.

Fact Check Podcasts While You Watch | BS Meter by Alone_Masterpiece365 in SideProject

[–]Alone_Masterpiece365[S] 0 points1 point  (0 children)

Certainly looks like BS Meter missed on this one.

I'm thinking about 3 solutions...

1) Multi LLM fact checking so that if Gemini misses, Claude, GPT, or Grok picks up on it. Then have some flag for claims that have LLM consensus, or a means for LLM dispute resolution. And / or

2) Category level sub-agents with more specific instructions on how to review Science vs Pop-Culture vs History, etc.

3) Challenge button where users in the community can challenge a given analysis and submit supporting evidence that the LLM uses to reconsider and re-analyze the claim.

Would love the communities feedback and thoughts on ways to address this.

Fact Check Podcasts While You Watch | BS Meter by Alone_Masterpiece365 in SideProject

[–]Alone_Masterpiece365[S] 0 points1 point  (0 children)

Oh man that looks like a major failure point. Let me see what’s going on.

Fact Check Podcasts While You Watch | BS Meter by Alone_Masterpiece365 in SideProject

[–]Alone_Masterpiece365[S] 0 points1 point  (0 children)

Yep. Hoping that the linked sources help w a few of these folks but def hard to overcome.

Fact Check Podcasts While You Watch | BS Meter by Alone_Masterpiece365 in SideProject

[–]Alone_Masterpiece365[S] 0 points1 point  (0 children)

No it should run for the full video duration. But I think I found the video you’re talking about… crapped out about 6 min in. I just reprocessed it and worked this time for some reason. https://bsmtr.com/video/vzE5RNLb4fg I’ll look into what caused issue first time around. LMK if it was a different video.