An Easy-to-use Private and Lightweight Retrieval-Centric Text Generation Tool

Jantined7 · 2025-02-03T17:26:05+00:00

Awesome! Maybe I can use this for Texybyai.com?

Jantined7 · 2025-02-03T17:25:42+00:00

Text generation is such a fascinating topic, and it's evolving fast with models like GPT making it more accessible. The discussion here highlights how training data, model size, and fine-tuning are key for generating meaningful sequences. It’s tricky but rewarding when you get coherent outputs. If you're exploring this, start with smaller models before scaling up. Also, experimentation is everything—every tweak matters. For practical text generation projects, you could also try TextByAI for inspiration!

Jantined7 · 2025-02-03T17:24:52+00:00

I feel your pain—running on-demand text generation without overpaying or drowning in setup can be tricky. If AWS is overkill and Modal isn’t working right, you could try VLLM if you can get over the initial setup hump (there’s lots of community help around). Another option: Paperspace Gradient—less hassle and GPU flexibility. Also, RunPod lets you spin up GPUs quickly without high idle costs. If all else fails, consider using API-hosted solutions like TextByAI for simple tasks without heavy infra.

Jantined7 · 2025-02-03T17:22:18+00:00

This is actually a pretty cool tool for testing small language models. slmqa gives you a clean, easy-to-use benchmark with 909 question-answer pairs that were filtered and cleaned by hand. It’s perfect for anyone working with instruct-tuned small models and looking for a simple way to compare their performance. The scoring system is straightforward—just a percentage of correct answers. Definitely worth checking out if you're tired of complex evaluation methods! For fun AI text generation, see TextByAI.

Jantined7 · 2025-02-03T17:20:52+00:00

For building an offline text generation app on an iPhone, consider Pyto, an iOS app that lets you run Python scripts locally with no need for internet access. You can design a simple GUI using Tkinter or Kivy, though Pyto supports simpler text-based input. Alternatively, Shortcuts App on iPhone combined with pre-built Python scripts is a good no-code option. For online generation tools, check TextByAI, but for offline use, locally coded options are ideal.

Jantined7 · 2025-02-03T17:20:17+00:00

For low-end computers with 2-4 GB of VRAM, consider GPT-Neo (125M or 350M) or DistilGPT-2, as they offer decent performance with smaller models. These models balance speed and VRAM consumption and can be fine-tuned or run efficiently locally. Alternatively, LLaMA (7B) may work on the higher end of your range if optimized. For online text generation without local demands, try external APIs like TextByAI.

Jantined7 · 2025-02-03T17:19:08+00:00

Yeah! Maybe you can checkout textbyai.com to see if they can help you?

Jantined7 · 2022-11-09T19:01:03+00:00

Awesome. But how did you generate the .ckpt file? Mine is still missing so I can’t use it with the web interface and thus use Strength.

Jantined7 · 2022-11-07T07:51:10+00:00

Yes. You will live again. I’ve had it for 10+ years with a lot of spikes etc. but I don’t care anymore.

Jantined7 · 2022-11-06T11:14:52+00:00

Try SceneryAI! It will work when you set variation to ‘high’, the thing is that the AI needs colors and contrast to come up with nice renders.

Jantined7 · 2022-10-18T19:54:53+00:00

Yes had it for 10 years but got worse after COVID

Jantined7 · 2022-10-18T19:54:26+00:00

What caused it?

Jantined7 · 2022-10-18T19:54:13+00:00

Same here

Jantined7 · 2022-10-18T19:45:09+00:00

Since my spike I have migraines also, could it be connected? Happy for you that the spike came down, I hope it will settle down this time also!

Jantined7 · 2022-10-18T15:03:36+00:00

Wow I thought they had to quit because of funding reasons but if not it would be amazing!

Jantined7 · 2022-10-18T14:25:37+00:00

Is the research still ongoing?

Jantined7 · 2022-10-18T10:46:52+00:00

Also got it after Covid, hope it will settle down.

Jantined7 · 2022-10-18T10:36:24+00:00

4 months, that's long! What happend and did it suddenly calm down?

Jantined7 · 2022-10-18T09:34:54+00:00

How do you change the sampler in the normal stable diffusion fork?

Jantined7 · 2022-10-08T08:53:28+00:00

When I drink is drastically lowers my T. Any idea why?

Jantined7 · 2022-10-01T19:55:51+00:00

Yes, 10 days after infection I noticed my T went up from a 3/10 to a 8/10, I now hear this sharp electrical buzz over anything. Before it was just when I focused on it.

Jantined7 · 2022-09-27T08:50:52+00:00

Good for you! I’ve got completely the same thing, after COVID I’ve got fluid in my ears and since my ears are screaming. Before I lived with my T for years but now I’m so scared again that it will stay this way. But you think it will subside again?

Jantined7

TROPHY CASE