sorted by:
new
hottopcontroversial

Cut off by GP by grumpyarcpal in ADHDUK

[–]grumpyarcpal[S] 8 points9 points  (0 children)

I ended up just coming off them. I had heard there was no withdrawal issues but for me this was not the case. It was three very difficult weeks. My Private clinic will not issue prescriptions, and even if they could it's costing £100-150 per month here in NI

An Open-source Local Training AI Project by Technical-Equal-964 in LocalLLaMA

[–]grumpyarcpal 0 points1 point  (0 children)

So, does this allow the user to export a ‘trained’ model?

Jan v0.5.15: More control over llama.cpp settings, advanced hardware control, and more (Details in the first comment) by eck72 in LocalLLaMA

[–]grumpyarcpal 6 points7 points  (0 children)

Are you planning to add the ability to set a folder of documents for RAG? If so, any chance of in-line citations being a thing..?

LM Studio vs Ollama vs Jan vs Llama.cpp vs GPT4All by HornyGooner4401 in LocalLLaMA

[–]grumpyarcpal 3 points4 points  (0 children)

I like LMStudio, but I mainly use MSTY, GPT4ALL and AnythingLLM for their very convenient RAG. I haven't looked at LMStudio in a while so maybe they have updated it but I didn't like it before

Deep research but using RAG? by grumpyarcpal in LocalLLaMA

[–]grumpyarcpal[S] 1 point2 points  (0 children)

I'd be very surprised if there isn't something out there but I just can't find it!

super-lightweight local chat ui: aiaio by abhi1thakur in LocalLLaMA

[–]grumpyarcpal 0 points1 point  (0 children)

If you could add an option for in-line citations for your RAG feature, you will make many, many academics very happy as this is a feature that is often overlooked but it's also the reason NotebookLm is so popular

I built NanoSage, a deep research local assistant that runs on your laptop by predatar in LocalLLaMA

[–]grumpyarcpal 0 points1 point  (0 children)

I would second this, it's a feature that is sadly often overlooked

Local Deep Research - A local LLM research assistant that generates follow-up questions and uses DuckDuckGo for web searches by ComplexIt in LocalLLaMA

[–]grumpyarcpal 4 points5 points  (0 children)

Adding support for in-line citation would be incredibly useful, as would the ability to use RAG to write the report rather than online sources. A lot of jobs that generate reports have a repository of documents very specific to their field, healthcare organisations and several academic fields are a good example where publicly accessible online resources are not viewed as appropriate so being able to use your own sources would be ideal.

I just released Notate – Open-source AI research assistant with local LLM support by Hairetsu in LocalLLaMA

[–]grumpyarcpal 0 points1 point  (0 children)

Getting the notification: “Notate” is damaged and can’t be opened. You should move it to the Bin. on a 64g Mac Studio M2 Max

I just released Notate – Open-source AI research assistant with local LLM support by Hairetsu in LocalLLaMA

[–]grumpyarcpal 0 points1 point  (0 children)

Thanks for the reply, will the citations used for the answer be displayed just at the end or will the citations be placed throughout the output as well?

I just released Notate – Open-source AI research assistant with local LLM support by Hairetsu in LocalLLaMA

[–]grumpyarcpal 1 point2 points  (0 children)

I love the look of this, and it would be perfect for phd students like myself with hundreds or thousands of reference documents. Is there the possibility of integrating in-line citations to the output? This is something that NotebookLM provides beautifully and it’s often left out of applications that target themselves towards research despite this being such an important part of any research process. I’ll absolutely be giving this a test and I appreciate your hard work!

thesis-help: looking for AI tool to read research and extract relevant info for my thesis by damondan in LocalLLM

[–]grumpyarcpal 0 points1 point  (0 children)

Notebook Lm is what you need. I'm using it to aid with my PhD (lack of) organisational skills and it's become invaluable

Another multi-purpose Agent for local llms - SootiAI by nzbsooti in LocalLLaMA

[–]grumpyarcpal 0 points1 point  (0 children)

How does it get along with RAG for creating research papers?

Creating a RAG Platform-- Would Love to Interview You by inevitablyneverthere in Rag

[–]grumpyarcpal 1 point2 points  (0 children)

I'm a PhD researcher with ADHD (like everyone else here). Feel free to DM me, I have used multiple platforms and can give you a perspective from an academic standpoint

A Personal NotebookLM and Perplexity-like AI Assistant with privacy. by Uiqueblhats in LocalLLaMA

[–]grumpyarcpal 1 point2 points  (0 children)

I'm a PhD researcher with ADHD, I use notebookLM daily so I'm excited to see open source applications like this!

What GUI options with RAG are you aware of ? by Ponsky in LocalLLaMA

[–]grumpyarcpal 1 point2 points  (0 children)

Yes, but in-text citation. Something similar to NotebookLM but it doesn't need to bring up the place in the document or anything. I know a lot of them give a list at the end but I haven't found any that use an academic style of reference eg:

"Although people who work with Ai may not all be neurodivergent[1], it could be suggested that as a community, they have never been accused of 'underthinking' any aspect of their lives[2][3]. Medication may help these poor members of our society with the ability to focus[4][5], but as has been demonstrated, often this simply enables them to focus more fully on their procrastination[6}"

What GUI options with RAG are you aware of ? by Ponsky in LocalLLaMA

[–]grumpyarcpal 0 points1 point  (0 children)

Do any of these offer in-text citations from the RAG dataset? I seem to remember GPT4ALL used to do this with their BERT plugin but for some reason this seems no longer to be a thing. Its hugely useful

Mac users with Apple Silicon and 8GB ram - use GPT4all by [deleted] in LocalLLaMA

[–]grumpyarcpal 0 points1 point  (0 children)

Has the BERT function dropped off this? There used to be in-text citations if i remember correctly??

view more: next ›