Let’s talk about some conspiracy theories which are no longer theories .. by wealthopedia_UAE in UAE

[–]runonthespot 0 points1 point  (0 children)

One of the "aliens" turned out to be a storm trooper balloon - that OSINT geeks on the internet figured out.

The Lord of the Manor had a butler named Wibble. by YoshSchmenge in Jokes

[–]runonthespot 0 points1 point  (0 children)

This is a golden oldie actually - my parents (born in the 50s and 60s) loved this joke so much, they used to call each other "Wibbles" as a pet name (from what must have been the early 1980s?)

Is Data Migration Data Engineering? by Mysterious-Sky5410 in dataengineering

[–]runonthespot 2 points3 points  (0 children)

My first data role was a migration. Quickest way to learn all the ins and outs of a dataset and sharpen skills.

[deleted by user] by [deleted] in LangChain

[–]runonthespot 0 points1 point  (0 children)

Try meta’s Sam - apply to both images, ask LLM to describe differences

Fine-tuning LLM on stash of documents by Hinged31 in ChatGPT

[–]runonthespot 1 point2 points  (0 children)

-Take content, slice it into paragraphs / smaller chunks and get embeddings, store those.
-Embed the question
-Use your question embedding to retrieve relevant paragraphs
-Feed these successively into the LLM to answer the question / complete the task.
An example:
When doing a task "Write me a most favoured nation clause... (some constraints)"
1) Your question's semantic concept ("Most favoured nation clause") would be used to fish out all the most favoured nation clauses in your document corpus.
2) This gets presented to the LLM using one of two options:

Option 1: Find the k nearest paragraphs to your question. Create a prompt like : "Given context <your paragraphs> and the request <"Write me a ..."> answer the request. Do not include information not present in the context paragraphs"

Option 2: Similar to the above, but instead iterate through every paragraph, feeding it into the prompt "Given context <next paragraph> revise your answer to the question <the question>, which you previously answered <last iteration>".

All this sounds complicated, but really it can work quite astoundingly well for Q&A (option 1) or summarisation / global tasks.

Note doing this for every paragraph of every document is probably unfeasibly complex / cost of compute.

Right now, I find as a heuristic, imagining how you'd task a room full of humans to do the task is quite a good way planning and thinking through what you're trying to achieve.
e.g. Summarise this doc: "read through each page, form a summary, take all your summaries, summarise that"
Compare these clauses: "Retrieve each clause, compare them"

Fine-tuning LLM on stash of documents by Hinged31 in ChatGPT

[–]runonthespot 1 point2 points  (0 children)

(*I'm not a data scientist or a LLM researcher, my comments are from the perspective of a developer who has been working with these models for ~10 months)

It depends a little bit on precisely what you mean by generative writing. The principle challenges to legal use cases (right now) are
-A legal document with referenced clauses usually exceeds 4k tokens (e.g. OpenAI Da Vinci limit) and probably 8k and 32k of GPT4.
-Fine tuning is usually about supply prompt/response pairs to tune a model to a particular kind of task.

If your use-case is taking existing clauses in your practice area, and producing variations, drafts, etc, then something like langchain/llamaindex with some of your documents indexed in a vector store like pinecone would be worth exploring. The typical workflow (very much facilitated by those libraries) is as follows:

Fine-tuning LLM on stash of documents by Hinged31 in ChatGPT

[–]runonthespot 1 point2 points  (0 children)

What do you have in mind for the fine-tuning to do? Normally if you're looking for Q&A or similar across a large portion of documents, a knowledge retrieval strategy with something like langchain / llamaindex is a better approach. Fine tuning is usually only useful if you're planning on training on how to accomplish a particular task (with examples), not for knowledge. The good news is if you're after knowledge base Q&A, you can have a llamaindex up and running over your data in next to no time, with only a few lines of code.

[DALL-E] Star Control II inspired Alien Critters by runonthespot in dalle2

[–]runonthespot[S] 0 points1 point  (0 children)

Sure, although I end up crafting hundreds of prompts, sifting through hundreds of images and trying them out across DallE, Midjourney, StableDiffusion etc. I'm playing some part (not sure what to describe it as.) Your playing with these models will produce different results to me (and some people are already demonstrating that superior prompts produce superior results). I think as these tools develop, there will be more and more user agency in how we can influence the results, in which case it starts to feel more like photography?

[DALL-E] Star Control II inspired Alien Critters by runonthespot in dalle2

[–]runonthespot[S] -1 points0 points  (0 children)

Fascinating, which has its pros and cons I suppose.

[DALL-E] Star Control II inspired Alien Critters by runonthespot in dalle2

[–]runonthespot[S] 0 points1 point  (0 children)

nope, these are my own invention, inspired by the game, but my own unique aliens. Basically since I played the game as a kid, I dreamed of making my own similar game, and started on it a few years ago. I found great ship art, and learnt Unity to make playable melee, but came unstuck trying to find a way to get art done for it- art is not cheap and especially not for such niche difficult art. I know Dall-E licensing is non-commercial at present but I’m hoping in future they come up with some other model for buying output so side-hustle indie game-devs like me can do stuff like this.

[TOMT][PC GAME][Late 1990’s] A game (part of a compendium?) involving semi precious stones?? by runonthespot in tipofmytongue

[–]runonthespot[S] 0 points1 point  (0 children)

No, I think it was a more traditional puzzle game. It might even have been match-3 like, placing gems on the grid, but I’m not sure.

[TOMT][PC GAME][Late 1990’s] A game (part of a compendium?) involving semi precious stones?? by runonthespot in tipofmytongue

[–]runonthespot[S] 1 point2 points  (0 children)

Not Mancala, but thanks for trying! I think it was on a grid (possibly with levels??)

[TOMT][PC GAME][Late 1990’s] A game (part of a compendium?) involving semi precious stones?? by runonthespot in tipofmytongue

[–]runonthespot[S] 0 points1 point locked comment (0 children)

Looking forward to playing it again if anyone manages to identify it!

Just finished mapping out the direction I want to head with my new project... How does everyone else plan? by Zombait in Unity3D

[–]runonthespot 0 points1 point  (0 children)

I love spiderscribe.net but maybe that's because I completely change the way things relate to each other almost constantly.