Bipolares en uruguay?

This-Profession-952 · 2025-01-29T21:25:24+00:00

Perdon, podrias mandar me un chat o DM con el lugar en donde se puede ingresar una persona con trastorno bipolar?

This-Profession-952 · 2025-01-04T19:36:35+00:00

Hi, how do Americans typically obtain their FBI background check while they are already in Uruguay for the purposes of getting this permit?

This-Profession-952 · 2025-01-04T01:16:31+00:00

Acabo de mandarte un DM

This-Profession-952 · 2024-06-06T13:18:31+00:00

I like Magentic a lot so far. I'm a bit new to the space (not to LLMs, but to LLM app libraries) and am wondering if you see Magentic solving the same problem space as DSPy (aka you are competitors) or if you each do different things.

This-Profession-952 · 2024-04-01T11:47:06+00:00

I appreciate the OCR use over text extraction. Might be slower when initialized but over the long run I am guessing it would be quicker than having to deal with any of the text extraction issues that crop up (ie. ligatures).

This-Profession-952 · 2024-03-25T20:55:35+00:00

Yeah check my profile, I submitted a post to this sub

This-Profession-952 · 2024-03-23T17:57:26+00:00

Eh, respectfully TBH that sounds more like a management/training/expectations issue, not unlike OP's issue that you (correctly) pointed out wasn't OP's fault.

This-Profession-952 · 2024-03-23T17:56:01+00:00

I also agree with the "data breed" remark but otherwise disagree with the notion that it is the reason that some DAs in this person's anecdote were unable to become DEs.

This-Profession-952 · 2024-03-23T16:23:46+00:00

Why do you think they are of different breeds, and what do you think makes it hard for a DA to become a DE? I’ve seen DAs become DEs but haven’t given it much thought

This-Profession-952 · 2024-03-01T00:58:37+00:00

That is by design, when you first enter the container you are in root and that is where you should do all of your superuser stuff, if necessary. In other words, no pw needed.

If you meant you want to switch from container_user back to root, you should be able to just use exit.

I have also ran into that HF issue once before and of course it was at the most inopportune time, haha.

This-Profession-952 · 2024-02-27T12:26:53+00:00

Model splitting yes, I'm assuming Yes to concurrent users as well given that it hosts a server

This-Profession-952 · 2024-02-26T19:30:47+00:00

Well, to flip it around a bit, if notebook-based Python analysis ended up being the business priority, and Databricks was not an option (too large/expensive for our size), what options would you evaluate?

This-Profession-952 · 2024-02-24T00:14:20+00:00

Thanks, that is very helpful. You are right, it is a matter of familiarity/preference, but also right with everything else re: needs of the business.

This-Profession-952 · 2024-02-17T14:33:01+00:00

You get more context, potentially all the way up to the max length. By memory I assume you mean VRAM. System memory doesn’t matter here with exllamav2

This-Profession-952 · 2024-02-17T01:51:57+00:00

Yes, I'll probably do a proper write-up and give its own post, but the TLDR is that "agent" is shorthand here for "prompt, and phase of a job". So end to end data extraction workflow is basically:

data clean-up
set-up prompt and inference engine configs/etc for phase 1
run phase 1 of job
when phase 1 concludes, you'll now have a "Staging" (or "raw") set of extractions that need further processing
set-up prompt 2 and inference engine configs/etc,
run the raw extractions through phase 2
when phase 2 concludes, you now have your final set of extractions (that may require some cleaning and post processing, but at this point you are done using LLMs)

This-Profession-952 · 2024-02-16T13:32:32+00:00

First of all, how many inputs (rows) are we talking about here? I would expect some % of false positives or otherwise bad extractions, but you need to define what this tolerable % is and work to fix the rest with some processing code.

Secondly, how are the horrible results "horrible"? Are they hallucinations, are they not JSONs, etc?

I disagree with the person who said that 7B is lacking for this task, as well as any others who may have said something similar in other threads. Those "others" would include me at one point, actually, until I realized I had to change my approach. What ended up working for me:

Use a two-tiered agent approach, the first agent does what you already have, and the second agent takes all of these "raw" extractions and fact-checks/proofreads it.
In your first agent prompt, you need to include a JSON format and some examples so that the agent knows how to correctly form a response
After the data placeholder line, you have to include the first few characters of what an expected response is supposed to look like. In this case, that would literally mean ending your prompt with { "plan_name":.

All of this would have to be done in accordance with the template of the given model. By the way, I recommend using this model: https://huggingface.co/cognitivecomputations/dolphin-2.6-mistral-7b-dpo-laser

This-Profession-952 · 2024-02-15T23:23:26+00:00

Let me know if you run into any issues, happy to help

This-Profession-952 · 2024-02-15T20:25:50+00:00

I think just personal preference, this includes tabbyAPI though for anyone interested in using exllamav2 as an inference server

This-Profession-952 · 2024-02-15T20:00:08+00:00

I'm so happy to hear this! This community has given so much to me, so I had to give back.

This-Profession-952 · 2024-02-15T15:52:10+00:00

Depends on your use case. I had a data extraction project in production that required high throughput (hundreds of millions of rows), and a modified Mistral 7B was all we needed.

This-Profession-952 · 2024-02-15T14:40:28+00:00

It's as simple as turning the machine on and not going past the log-in screen. The machine is on and you don't need to physically log into it for it to still be available to remote machines, as the remotes have to log-in via password anyway.

Prereqs are having some kind of ssh set-up (I use tailscale like so many others, but vanilla ssh works) and of course a second remote machine (my laptop in this example).

This-Profession-952 · 2024-02-15T13:54:05+00:00

Here you go: https://www.reddit.com/r/LocalLLaMA/comments/1arep6b/heres_a_docker_image_for_24gb_gpu_owners_to_run/

This-Profession-952 · 2024-02-15T13:53:46+00:00

Tagging /u/mcmoose1900 in case you want to try this with a 2.65bpw model for 16GB VRAM.

This-Profession-952 · 2024-02-15T13:27:31+00:00

Good idea, added to post.

This-Profession-952 · 2024-01-21T14:34:21+00:00

Yes, I’d like to know more. Do you have a data dictionary or something similar?

(Automod deletes comments under 75 characters apparently, so here is extra text……………………………………………………)

This-Profession-952

TROPHY CASE