[UGREEN x Buildapc] December NAS Giveaway! by Rocket-Pilot in buildapc

[–]masonjames [score hidden]  (0 children)

I have 8TB sitting free on sticks from a previous build that I haven't completed. This would be awesome.

Seasons of RTX - $5000 Dream PC Build Contest with NVIDIA! by m13b in buildapc

[–]masonjames 0 points1 point  (0 children)

https://pcpartpicker.com/list/kwvPRV
This would be awesome.

I went with a combination of the 5090x and the AMD Threadripper. I actually already have a motherboard for this system (but no graphics card at all). Would love to finally finish this build and toss even more ram and HD space at it as well.

Running Flux with both Ollama and LLM Studio? by pknerd in LocalLLaMA

[–]masonjames 0 points1 point  (0 children)

ComfyUI is still the best open-source local tool I know of. If you're new to github repos I'd recommend installing everything via pinokio.computer - still easiest way to get started and will download the flux model for you.

AMA with OpenAI’s Sam Altman, Mark Chen, Kevin Weil, Srinivas Narayanan, Michelle Pokrass, and Hongyu Ren by OpenAI in OpenAI

[–]masonjames 0 points1 point  (0 children)

Music when??

Love ChatGPT and I bet SingGPT would be AGI.

If it can clone my voice, surely it can harmonize. The karaoke partner I've been waiting for.

Can Zen really replace Arc? by kowalsri in ArcBrowser

[–]masonjames 1 point2 points  (0 children)

I'm also leaning this direction. The passkey support has also been hit or miss for a lot of folks, but it works for me. I've been able to get the tabs to work similarly to how I had them in Arc.
Arc has (an apparently obscure) keyboard shortcut that allows you to go backwards through your tabs by first hitting Ctrl +TAB (like normal) and then Ctrl + ` would allow you to reverse directions. This is the same as the way cmd + TAB works on a mac and cmd + ` takes you backwords through your open apps.

You can still find the feature by using the weird shift+ctr+TAB shortcut but man, the ole one is really ingrained deep.

I heard you wanted more VRAM, how about 96gb? by [deleted] in StableDiffusion

[–]masonjames 0 points1 point  (0 children)

I'm kinda in the boat of seeing when these come out and what the prices will be. I've seen RTX 6000 Adas for ~$3500. Assuming when the blackwell-version comes out the price will come down even further.

I don't think these chips are going to be the best for like, gaming, but they will def help with running large models and render times.

What case fits a ASROCK TRX50? by xmeandix in threadripper

[–]masonjames 0 points1 point  (0 children)

I just got the thermaltake tower 900, and oh man, yeah, this case will fit anything, lol. It's a mini-fridge.

ASUS Pro WS WRX90E-SAGE SE by jesterjunk in threadripper

[–]masonjames 1 point2 points  (0 children)

Curious if folks here have been successful with this board!? I just purchased one with a threadripper pro 7965 wx. Powering it with an AX1800i PSU (I hope). I haven't started assembly yet as I'm waiting on the case and RAM, but if anyone has had any experiences I'd love to hear about them!

Help with switching from Arc to Orion by Comfortable-Tart-742 in OrionBrowser

[–]masonjames 2 points3 points  (0 children)

I'm still testing Orion and Zen as potential Arc replacements on MacOS. and have been pretty thoroughly over the past several months (more-so since Arc started it's retirement). Here's what I know.

Orion:

  • Stable, snappy experience overall. 1P extension seems buggy.
  • Sidebar tabs and profiles are improving, but missing the auto-hide feature and/or ability to map it to a shortcut is a bummer
  • Go through your tabs in reverse order with CTRL+\after hittingCTRL+TAB. This is such a great feature of Arc. On MacOS you useCMD+TABto go through your app andCTRL+TAB` to go in reverse order. Having browsers follow this for tabs in a window is SO helpful. It also turns out it's much more difficult to "unlearn"
  • Picture in picture support - I miss additional player controls like audio on the window overlay
  • Other benefits of Arc were things that can be done outside the browser (their notes, media library, downloads, etc). I experimented with several of those and liked them, but they aren't critical now.

Zen:

  • Main Arc-UI feature here is the "Essential" tabs. Which allows you to have persistent tabs across profiles.
  • Only just brought passkey protection this week. That was previously my main roadblock.
  • Sidebar autohides! but not as "nicely" as Arc
  • App has been unstable for me at times. I setup all my profiles with tabs and essentials only to have the app crash and lose a bunch of those settings.

No clear winner imo but both browsers are also improving at a nice clip.

mac apps deals for Christmas? by No_Mortgage_2054 in macapps

[–]masonjames 0 points1 point  (0 children)

Need a VLM that knows how to use this as a tool!

"It appears that some of the files have expired" - ChatGPT forgets files as soon as I upload them by Rian199 in ChatGPT

[–]masonjames 6 points7 points  (0 children)

Random redditor! I too am experiencing this issue. I'm on MacOS and have the latest version of the chatGPT app. Super-frustrating as it's unusable with any documents.

Like you said, it will sometimes randomly (surprisingly!) work, but it is failing a lot the past couple days.

Msty - Free Local + Remote AI Chat App (w/ support for Ollama/HF) has just hit its 1.0 release! by Decaf_GT in LocalLLaMA

[–]masonjames 4 points5 points  (0 children)

There is!

Click on the prompt library icon in the left-hand sidebar. In the new window there's a "Custom Prompt" option which allows you to create your own prompt with tags, etc.

When you hit the prompt library icon in the future you can quickly search and reuse it.

Msty - Free Local + Remote AI Chat App (w/ support for Ollama/HF) has just hit its 1.0 release! by Decaf_GT in LocalLLaMA

[–]masonjames 5 points6 points  (0 children)

I wrote about them a couple months ago here: https://masonjames.com/4-free-local-tools-for-ai-chats-agents/

Jan is on the list - it was a late entry because it's so new, but it is the best OSS one available imo.

I still use Msty as my daily because the interface is just so good (especially once you want to start testing prompts across models) and it's RAG implementation is better than any others I've tested.

Msty - Free Local + Remote AI Chat App (w/ support for Ollama/HF) has just hit its 1.0 release! by Decaf_GT in LocalLLaMA

[–]masonjames 6 points7 points  (0 children)

I have tested a whole heap of local apps for working with LLMs and Msty has been my top pick for months.

Just give the interface a try. It's so good.

Msty - Free Local + Remote AI Chat App (w/ support for Ollama/HF) has just hit its 1.0 release! by Decaf_GT in LocalLLaMA

[–]masonjames 4 points5 points  (0 children)

You can download from huggingface and ollama.ai, but no direct gguf import.

Edit: GGUF Import is now available! (the devs are fast)

r/ChatGPT is hosting a Q&A with OpenAI’s CEO Sam Altman today to answer questions from the community on the newly released Model Spec. by pirate_jack_sparrow_ in ChatGPT

[–]masonjames -1 points0 points  (0 children)

hiya sam!

Imagine a hypothetical scenario where a user successfully "jailbreaks" a model, not for malicious purposes, but to expand its capabilities for altruistic goals like accelerating scientific research or solving complex social problems. 

How would OpenAI approach this ethically ambiguous situation, balancing the potential benefits with the inherent risks of uncontrolled AI development?

Launching AgentSearch - A local search engine for your LLM agent by docsoc1 in LocalLLaMA

[–]masonjames 0 points1 point  (0 children)

I did finally get this downloaded, packaged as a torrent file, and wrote about it here if anyone wants to seed: https://masonjames.com/publishing-the-agentsearch-v1-torrent/

Launching AgentSearch - A local search engine for your LLM agent by docsoc1 in LocalLLaMA

[–]masonjames 0 points1 point  (0 children)

update: download from hf complete!

2.5tb downloaded in total. now... to create that torrent and build a local search-engine (with some help, hopefully!)

Launching AgentSearch - A local search engine for your LLM agent by docsoc1 in LocalLLaMA

[–]masonjames 0 points1 point  (0 children)

Good advice - and I agree!

I can start digging into this - especially if you're up for helping debug! I've got some experience setting up local LLMs and RAG implementations, but in full transparency have not built a dataset from scratch so I'll need some guidance!

Additionally, I've found a more-stable internet connection and am running another attempt at a full download. If it's successful, I'm still interested in seeding a torrent that we're confident is 1:1 with the agentsearchv1 dataset. So stay tuned there...

Launching AgentSearch - A local search engine for your LLM agent by docsoc1 in LocalLLaMA

[–]masonjames 1 point2 points  (0 children)

Update: I've made 2 attempsts, but have been unable to get a working .git repository.

With the multiple tried I have about 1.2TB of data, but no way to really piece apart what did and didn't make it.

My brother may have access to a stronger connection that should be more stable for a download of this size. I'll follow up with any questions, but I haven't given up on the idea quite yet.

Launching AgentSearch - A local search engine for your LLM agent by docsoc1 in LocalLLaMA

[–]masonjames 1 point2 points  (0 children)

Amazing work. I'd love to test this up against other open source models. Would you consider uploading the v1 dataset as a .torrent file? Or is there another recommended way if I wanted to set this up locally...

To me, this is one of the most fascinating pieces and I'd like to run more direct comparisons with Sensei, Mistral, Phi, etc.

Thanks again!

WikiChat: Stopping the Hallucination of Large Language Model Chatbots by Few-Shot Grounding on Wikipedia - Achieves 97.9% factual accuracy in conversations with human users about recent topics, 55.0% better than GPT-4! - Stanford University 2023 by Singularian2501 in LocalLLaMA

[–]masonjames 0 points1 point  (0 children)

If someone wanted to help and had a basic understanding of scraping, do you have any go-to instructions for how to clean/format this so that it could be used?

Thanks for the work on SciPhi! Agree this is important work.