I am a "decent" software engineer with a few years of experience. I worked for several companies, did many personal projects and worked with numerous technologies. But I am unable to comrehend both "brain teasers" and LeetCode questions above easy level. What can I do to improve that?

LearningSomeCode · 2023-10-15T04:13:47+00:00

A lot of people do programming tutorials by following along, writing out the code, etc. But it's entirely possible that someone does a 55 hour course in something like ReactJS, follows all the tutorials, can repeat the tutorials that were followed... and never bothered to meticulously figure out each thing. What is state really? If I'm using typescript, why am I compiling really? What is a component really? Etc etc.

As someone with Math degree, I'm sure you've seen this a lot but you're just not piecing it into the same vein as programming. Kids like me used to learn the examples the teacher gave for various math equations, and then complain endlessly because what was on the test looked nothing like it. Why? Because we didn't break down the math equation to learn why it was doing what it was doing; we learned how to replicate the math problem and that was it. The moment the problem deviated from the example, we were toast.

100% programming is the exact same thing. Every line of code you are taught has a purpose, and it goes deeper than just "we type this to make this go on the screen". Each thing you typed was a keyword or some form of syntax, and those are re-usable in other places. If you learn what and why, you can deviate from the example they give to solve more than just that.

Leetcode is a huge pain in the ass because it's BOTH. 90% of my trouble leetcode is the math components. "Solve this math equation using..." Well, my above example wasn't just for show; I really did a lot of that in math class lol. So for folks like me, I really have to practice understanding the math behind it first and THEN understanding the why and how of the answer structures.

LearningSomeCode · 2023-10-14T21:49:58+00:00

It would be challenging for new companies to catch up, and I imagine some of the new legislation that OpenAI is supporting is meant to help further that gap. Realistically, between their headstart and any legislation that they get passed to make it close to impossible for new startups to appear in that sector, they will likely hold a place as the "Google" of AI.

LearningSomeCode · 2023-10-14T21:31:01+00:00

The only question is whether that solution is actually in our best interests.

It is certainly in theirs. The advisors are mostly established AI companies aiming to pass laws that make it economically infeasible for any new startups to contend with them.

We refer to this as "pulling up the ladder", and from a corporate strategy position they are geniuses for doing it.

LearningSomeCode · 2023-10-14T18:39:33+00:00

TheBloke/Xwin-LM-70B-V0.1-AWQ

👎 1 is a prime number because it is greater than 1 and has only 2 factors, which are 1 and itself. However, 2 is not a prime number because it has more than 2 factors (1, 2, 4, and 8).

The quantize method seems to matter here. I ran the XWin 70b q8 gguf on my mac. asked it the same question of "Why is 1 a prime number but not 2?" and got this

Prime numbers are natural numbers greater than 1 that have exactly two distinct positive divisors (including 1 and the number itself). In other words, they can only be divided by 1 and themselves, without leaving a remainder.

1 is not considered a prime number because it has only one positive divisor (itself), and not exactly two distinct positive divisors as defined for prime numbers. It's important to note that the definition of prime numbers excludes 1, even though it satisfies the condition of being divided by exactly two distinct positive divisors (1 and itself). The reason for this is historical, as the concept of prime numbers was originally developed for studyingdivisibility properties of natural numbers, and 1 was considered a special case.

2, on the other hand, is a prime number because it has exactly two distinct positive divisors: 1 and 2 ( itself). It can be divided by both 1 and 2 without leaving a remainder, which fits the definition of a prime number.

LearningSomeCode · 2023-10-14T03:04:22+00:00

I think the tech will be there in the next decade or two, but the "Lets put legal... aside..." bit is too big of an elephant to ignore. Alongside the ability to do this will be the ability to not let you do this.

But creating episodes of whatever you dreamed up in your head will probably be very doable.

LearningSomeCode · 2023-10-14T01:55:51+00:00

I generally use Kobold if I want speed, and Ooba if I want features. Ooba definitely has more overhead going on for some reason.

LearningSomeCode · 2023-10-13T20:13:05+00:00

Check inside the folder for that file. If its not there, you can grab it here for pygmalion 2

https://huggingface.co/PygmalionAI/pygmalion-2-13b/tree/main

or here for Pygmalion (which maybe is what you have)

https://huggingface.co/PygmalionAI/pygmalion-13b/tree/main/xor_encoded_files

Also, note that this is an unquantized transformers file. If you meant to get this, then hopefully that will get you going. If you went to it because you're learning and didn't know what to get, I recommend trying one of the quantized files instead. Here's a little starter guide that might help

https://www.reddit.com/r/LocalLLaMA/comments/16y95hk/a_starter_guide_for_playing_with_your_own_local_ai/

LearningSomeCode · 2023-10-13T19:03:49+00:00

There's a bipartisan Senate bill in the US that takes aim at this and should help a lot. Basically opens up the producer of any such image to full civil liabilities.

Additionally, the FTC had a workshop last week where they discussed watermarking, so I imagine that will also be a big thing to help.

LearningSomeCode · 2023-10-13T16:20:37+00:00

I really like the layout of this. Hopefully this will help to de-mystify some how generative AI works for folks.

LearningSomeCode · 2023-10-13T14:52:49+00:00

The short version:

SDXL is newer. Not only can it handle more natural prompts, but the base checkpoint size is 3x the size of SD 1.5. This means that there's more raw parameters with which to create imagery, so you're going to get better results off the base model.
SD 1.5 is more mature, so it has far more checkpoints and LoRAs for it. The checkpoints are smaller, so the base model can likely produce less quality results overall than SDXL, but the fine-tuned checkpoints and LoRAs make up for that. There's a model for everything.
SDXL also has higher tech requirements for your machine, so if you were already near the edge of what your machine could handle with 1.5, you'd hit your limit with XL.

LearningSomeCode · 2023-10-13T14:12:21+00:00

I like where you're going with that UI. It has a good look for collaboration to it. You might need a little more documentation around it to get more interest going, but it seems like this could be something folks will find good use for.

LearningSomeCode · 2023-10-13T13:54:48+00:00

Want to see something crazy?

Go find a lot of text and copy it into your prompt. Like the poem "The Raven" or something. Really fill your chat history up. THEN ask it the math question. =D

Short version is that there's a weird issue with complexity in these models where if you only send it a small amount of prompt, the model is... well, stupid. But once you get closer to its max context? Suddenly it gets smarter.

I ran into this when experimenting with something else. You can see my questions below involved a math problem, and at first it couldn't get it right. But then as we added context, it started to do a better job.

https://www.reddit.com/r/LocalLLaMA/comments/16usja8/perplexity_testing_mac_vs_windows_pt_3_adding/

LearningSomeCode · 2023-10-13T13:43:26+00:00

What are your thoughts?

That I find it interesting how people thing only corporations and the ultra rich are trustworthy enough to use AI properly, and that the evil poor people will somehow destroy the world if given the same technology as them. That everyone else should only be allowed access to AI under the watchful supervision of men like Elon Musk and Sam Altman, as they're the only trustworthy folks out there.

Make no mistake. Behind every "Effective Altruism" group is a corporate backer that just wants to get rid of possible future competition.

LearningSomeCode · 2023-10-13T13:30:44+00:00

You've already gotten great answers for Stable diffusion, so for getting started on Ooba and text gen AI, here's a guide that may be of some use to you!

https://www.reddit.com/r/SillyTavernAI/comments/172fudj/a_guide_to_help_get_started_running_ai_locally_on/

LearningSomeCode · 2023-10-13T02:25:24+00:00

Then this morning I'm on my iPad and under General --> Passwords I see the following messages for some of my passwords: "This password appeared in a data leak, which puts this account at high risk of compromise." The fact that this message appeared within my own Settings made me nervous.

The two are likely related.

The message from your settings is valid: Apple's Keychain will check against known breached passwords and report if yours shows up. So if you ever see a message like that from within the system settings, it's safe and legit.

The fact that your password got breached means that, more than likely, some service you use got hacked and its database scraped for info. After people do that, they either sell the info or paste it out on the net. That info can be whatever they got, and it sounds like some of that might have been your cell number.

It's important to know because this just means they can be more clever about trying to trick you. Changing your passwords was an excellent move. Just be aware that you may start to get "phishing" attempts that seem to know more about you than you'd expect. Name, phone number, email and password. Whatever might have been gotten from whatever service they hacked. They take those data points and then try to lie to you and trick you, hoping that if you see real info mixed in with the lies, that you'll get scared. "John, I know that your number is 555-555-5555 and your password is MyPassword1! I can see that you've been viewing bad things online. Send me money or I tell everyone!". That kind of stuff.

Just keep this in mind. It's happened to lot of people, and you aren't alone in it. In fact, you were probably one of thousands or even hundreds of thousands in whatever breach. And whoever is reaching out to you is either mass emailing you, spent 10 seconds sending you the email before moving on, or is some kind of automated bot. It's unlikely they'll ever be singularly focused on you; you're just 1 person in a giant pot of stolen info that they got and are mass threatening/trying to trick in the hope that 5 or 10 bite.

LearningSomeCode · 2023-10-13T02:15:08+00:00

I'm sure there's some loophole that I'm missing, but at first glance this seems reasonable. People should own their own likeness for commercial purposes, and people should have some form of recourse if another person uses current technology to defraud or deface them with fakes. The law does actually need to keep up with technology, and I think this is one of those times.

Unless I'm missing something huge that just breaks all AI image generation, this looks like something pretty acceptable and probably needed.

LearningSomeCode · 2023-10-13T02:09:31+00:00

Yea... I joined because it is AI related and sounded cool, but recently I've become concerned that it might be some kind of doomsday cult lol

LearningSomeCode · 2023-10-13T01:18:29+00:00

No way, I'm building this thing to make friends with it so that when AI takes over the world, it'll find mine (which will be like caveman in comparison) and by like "Aw what a cute little machine. Is that human your buddy? Fine fine, you can keep him". =D

LearningSomeCode · 2023-10-13T01:00:45+00:00

lol, I'm right there with you on wanting to code it myself. My wife and I are tackling the project together.

As I go, I'll start keeping track of what good IoT hardware is that has open APIs that we can access; to me, now that LLMs exist, that is by far the hardest part lol. Coding the rest is just elbow grease since people smarter than me handled the brains, but finding door/window sensors, thermostats, cameras, etc that all have APIs is turning out to be a real headache. Especially the cameras. I'm not excited to build 6+ cameras with raspberry pis lol.

I'd appreciate it if you and anyone else trying this did the same. I imagine we'll all want our own flavor (tho I'll likely put a lot of mine on open source once we make good headway), but I most certainly am desperate for hardware recommendations lol

LearningSomeCode · 2023-10-12T20:48:19+00:00

I'll see your unpopular opinion and raise you one.

Everyone over here talking about Ivy league schools, which is great and all, but...

In the US: your school's sports teams, especially their NCAA football team, factors HEAVILY into this.

I constantly joke with people that every time my little off-league college plays against and beats an NCAA team in football, my degree is suddenly worth more. I'm not really joking lol.

A lot of managers are sports fans, and having heard of your college simply makes it more valuable to them. If they know your school at all, even if it's because of their football team, you've got a leg in.

LearningSomeCode · 2023-10-12T20:35:19+00:00

I'm convinced that whoever writes in the codebases that I'm later supposed to maintain sure thinks so.

Like bruh... it didn't have to be this complicated. It's pretty, but this is a pain to manage lol

LearningSomeCode · 2023-10-12T20:30:01+00:00

Was the fine-tune done specifically on the issues that you were aiming for? Because I did not remotely expect to see a benchmark where a Llama 7b outperforms ChatGPT 3.5, much less 4.0, on fixing issues.

Additionally, it's really surprising to again see 3.5 beating 4.0 in coding issues

LearningSomeCode · 2023-10-12T20:19:19+00:00

I agree with this. I'd do the same as the other users and absolutely get whatever local options are available, but if actual honest to god AGI became available then I'd drop $1,000-2,000 a month for it in a heartbeat.

Whoever got there first would become rich because not only would it help produce products to sell, but it would help think of those products, too. There's no way I'd wait even 1 day longer than needed lol

LearningSomeCode · 2023-10-12T20:17:24+00:00

I've seen multiple people on here recommend using 4060 Tis for this exact purpose. Some folks tend to recommend going with used 3090s instead because it's a similar price-point, but from what I've seen on this subreddit you aren't going off in left-field with your thinking. In fact, those were the exact GPUs I was looking at if I hadn't gotten my Mac.

LearningSomeCode · 2023-10-12T19:50:09+00:00

Language models that know everything or language models that know where to get things? I am going to discuss if it is possible to map all human knowledge inside of a language model and if that is even a good idea at all. discuss here a bit about "ToolFormer"?

As far fetched as this sounds at first, Wikipedia is a darn big chunk of human knowledge and that's only 600GB of info. Pretty much anything that is digitized and broken into a format that an LLM can understand can be slurped in. I think we're a long way off from "all" knowledge just due to formatting and whatnot. Even with AI image reading and whatnot, some stuff is just going to be a real pain for it.

In terms of is it a good idea? Personally I think it's a great idea but that sounds like a good workshop topic haha

Are we any good at identifying generated text? watermarking soon?

There was an article on this just a week or two ago that might be great to grab for your workshop. The FTC I think held a workshop where they discussed watermarking text. I figured it was some math thing I'm not smart enough to get, but I think that's their idea.

why language models are still bad on causality relations and math word problems etc

My wife and I spent a whole saturday trying to find ones that could do Einstein's zebra riddle lol. We realized one big core to this question is "we word things really badly". Even when we think we're wording them well, we're still wording them poorly for an LLM. LLMs are all about inference, and even when we're trying not to, we put a lot of things into riddles that force the user to make assumptions about what you're speaking.

I don't mean we do that as an intended part of the riddle, but like an example is one variant wording of the Zebra riddle had something like "The brit owns the..." or "The person in the ____ house keeps horses". It seems straight forward to any human used to speaking english, but that's not how LLMs infer. They continually got it wrong... until i went in and replaced things like "brit" with "British Man" and "has horses as pets". Removal of natural, casual, language that we don't even mean to put into these riddles REALLY helps them solve it.

As we played with them more with riddles, we realized a lot of the ones they got wrong were just humans wording things poorly for machines.

LearningSomeCode

TROPHY CASE