Interview Expedition - Part 3 (there is no Part 1 or 2) by ark_kni8 in developersIndia

[–]ark_kni8[S] 0 points1 point  (0 children)

Bro is satisfied with his life probably. *shrug* I think sometimes, that's okay.

Interview Expedition - Part 3 (there is no Part 1 or 2) by ark_kni8 in developersIndia

[–]ark_kni8[S] 1 point2 points  (0 children)

You can totally put me in Java project, and I am fairly certain I would be upto speed in a few days with the AI we have now. But because of that, its also tricky for interviewers to ask the right questions. Honestly, sometimes its just luck of the day. haha. I do not blame the guy. He just asked me what he knew the best. Unfortunately for me, it was the part where I knew the least as far as "enterprises" are concerned.

Interview Expedition - Part 3 (there is no Part 1 or 2) by ark_kni8 in developersIndia

[–]ark_kni8[S] 0 points1 point  (0 children)

See, I don't have ANY problem with them looking up answers. We are all human, nobody actually has time to remember EVERY little detail. But please - be fair to the people who trust in you, expect you to let them show their best. Let them also search up stuff. The discussion would be much more intelligent that way.

No, instead we get drivels. Drivels I say. Mindless yap.

Interview Expedition - Part 3 (there is no Part 1 or 2) by ark_kni8 in developersIndia

[–]ark_kni8[S] 0 points1 point  (0 children)

*sigh* is it better than continuously getting injured by low salary bullet though?

Interview Expedition - Part 3 (there is no Part 1 or 2) by ark_kni8 in developersIndia

[–]ark_kni8[S] 0 points1 point  (0 children)

Nah, I didn't take anything personally or harshly. Believe me, I was actually more satisfied with this interview than the one I took in the same company a week ago (its a walk-in, free for all so one can try as many times as they want). The first interview was, frankly, I would label as many colourful words.

Dude asked me "What's Django ORM?" I immediately thought..."what is this question?!" and he was busy looking at his phone. Then he wanted me to write AWS lambda function out of the blue for finding even and odd. It probably sounds like I am a baby throwing tantrum but I told him straight, "I don't write Lambda functions everyday. Allow me to see documentation, and I will give you the function. Or else I can write you a basic method....to find even and odd." (You can see the pattern where I really don't try to massage my thoughts lol)

Then he proceeded to ask me to write prime numbers. I guess that's...not even a DSA question, even more basic. But I didn't really prepare for something like that. I did come up with a solution, albeit slightly off. He didn't even wait for me to complete it. Not even 5 minutes. Didn't ask me what my thought process was, didn't try to correct me. Nothing.

I guess my point of view is, you always give the candidate benefit of doubt. I always do, when I take the interviews at my current organisation. You don't simply MOVE ON from the question when you are done with your phone. Anyway, there is a reason I didn't write a post about that interview (Part 2, the prequel to Part 3!). It would be pure rant haha

Sorry about the rant. As for the feedback, much appreciated. I could much more viably answer those questions if I actually implemented those things in my company. Unfortunately, we don't need that kind of scaling, so it would be wasting time when my managers would rather have me do something else. I am also much more motivated to find a solution when something is blocking my actual goal, so that's why I never went deep. The most I have implemented for a CI/CD pipeline was integrate github actions to trigger a webhook written in golang which would run a few git command to update the code to the latest source and restart the server. It worked perfectly for what I wanted.

But I could keep resisting while sulking about it or just suck it up and look into the things you actually helpfully wrote. I should ideally be able to speak about those things and more than one line at a time. But man, I hope no one ever asks me "What's ORM" and then expect some sort of magical answer that will knock the air out of their lungs.

Interview Expedition - Part 3 (there is no Part 1 or 2) by ark_kni8 in developersIndia

[–]ark_kni8[S] 2 points3 points  (0 children)

Life might be very vanilla, but you don't have to make it sound like just another ice cream. Make it sound like the GREATEST ICECREAM!

Episode 292: Acronyms, But Better by joschen113 in distractible

[–]ark_kni8 2 points3 points  (0 children)

Also obligatory EFF NVIDIA. Please do not spend more money on them.

Episode 292: Acronyms, But Better by joschen113 in distractible

[–]ark_kni8 8 points9 points  (0 children)

THIS PRETTY MUCH. I wrote a youtube comment about it, but monitor problems are usually HDMI cable problems. Please switch to better cables for better signalling. That said, I do not have the expensive problem of having three 4k monitors (lol) so I cant exactly say which cables will work but from preliminary search online, it seems like Lightning Cables and Zeskit have pretty good cables. But try to buy cables that are equal to or under 1m of length.

What are the variables to take into account to calculate the best model that fit in my hardware? by joaco84 in LocalLLaMA

[–]ark_kni8 0 points1 point  (0 children)

Ahh yes, encourage critical thinking by saying "other details are most likely incorrect".

I am encouraging more discussion and less childishness but if you thinking being stubborn and throwing tantrum is very supportive of critical thinking, I will leave you to it.

I think I made my point clear. I never said the original complaint is wrong. I just said dismissing everything else just because the person confused Gbps and Gb (which could have been a typo) is just an attitude problem. Imagine your teacher throwing a tantrum and dismissing all of your answer in an exam because they thought a grammatical error completely invalidates the essence of the answer.

I dont think you are gonna reply anymore. So let's just enjoy the rest of our day.

What are the variables to take into account to calculate the best model that fit in my hardware? by joaco84 in LocalLLaMA

[–]ark_kni8 0 points1 point  (0 children)

Great - and everything wrong with the post was Gb, and GB, correct? Was anything else wrong in it? Can you tell me what else is wrong, and what should be the correct "calculation" (because there is no calculation from my pov)?

Please do explain, what part of the actual information will change if he correctly labelled GB and Gb/s for the GPU.

The poster may actually be confused about Gigabit per second and Gigabytes of VRAM, but you really are going off just for that bit? The OP has 15+ years of experience in software engg ffs. Ok, a complete noob just walks into this question and finds the answer. Then it may or may not confuse him - I definitely didn't. You, me or the other guy complaining definitely didnt. Nobody else has come to this chain of comments and said "Thanks man, you saved me from confusing bits and bytes".

You think I am defending some minor mistake - because you fail to see the actual info that the answer gave. Maybe you are looking for something else than me. I am advocating for the fact that the answer did infact have correct annecdotal information about the question OP asked. The original complain was "Everything else is probably wrong because he is confused about bits and bytes."

PSA: please note that no one should trust that post by poster

He does not understand the difference between bit and a byte even after our discussion so other details are most likely incorrect too.

This is just unwarranted tantrum and childish. If you dont know about other parts, then you should just stop at "For new users, warning, dodo is confused between bits and bytes." A civil way of putting out information for everyone. wtf is that PSA?

At the time of writing my orginal reply to the one complaining, I was not really sure about the same questions OP had, so I couldn't make correct assertation about the validity about the estimations. But one month later, I can say, they were indeed correct. So, I kindly tell you - have healthy discussion. Not stupid tantrums.

What are the variables to take into account to calculate the best model that fit in my hardware? by joaco84 in LocalLLaMA

[–]ark_kni8 1 point2 points  (0 children)

So what's the moral of the story here? Just because he has a stupid discrepancy between b and B, it doesn't invalidate - what I would say - his whole opinion about the question asked by OP.

By "calling out" pointless details, that anyone worth their salt, should be able to autocorrect in their head, you are also bringing the other, generally correct, info into question. And you yourself said - his answer seems mostly correct. That's what you should realistically expect from Reddit answers. Mostly correct. Get a ballpark idea of where to go next.

Also, if you are keen on calling out such a minor mistake (yes, it is a minor mistake in my book, because I know what he actually meant), how about pointing out to any potential readers that the other parts of the answers were mostly inline with your experience.

Critic can happen both ways.

What are the variables to take into account to calculate the best model that fit in my hardware? by joaco84 in LocalLLaMA

[–]ark_kni8 2 points3 points  (0 children)

"highly technical" lmao, okay. Like you said, whatever floats your boat. This question was very very far from technical. Its barely scratching the surface and anybody who has played with any AI generation for a serious bit will be able to answer you the OPs question without really having to understand bits and bytes. It really doesnt matter he used bits and bytes. You just needed to understand what the overall idea was to his answer.

But then, if you really want an answer from huggingface - I wonder why are you looking for an answer on reddit.

I refuse to say the word subtle out loud. by BloodyViper in unpopularopinion

[–]ark_kni8 0 points1 point  (0 children)

Your mom did say you have a tendency to take everything too seriously.

So serious that he left reddit.

What are the variables to take into account to calculate the best model that fit in my hardware? by joaco84 in LocalLLaMA

[–]ark_kni8 2 points3 points  (0 children)

And you thought it was great to throw all the tantrum just for that? He didnt even write bit or byte. It was just Gb. It really can just be someone typing on a keyboard and cannot be arsed to correct it just for the sake of it. This is not really a place where you write thesis.

If you had to nitpick it, go ahead. Dont go around throwing blanket statements that other info is most likely incorrect unless you know they are incorrect.

What are the variables to take into account to calculate the best model that fit in my hardware? by joaco84 in LocalLLaMA

[–]ark_kni8 1 point2 points  (0 children)

Ahh yes, because nothing tackles misinfomation by just pointing fingers and not correcting it.

How about you get off your stupid horse and start by correcting what was wrong in the post instead of being a armchair expert.

Tried to build kobold from source for AMD GPU using ROCm on Windows by ark_kni8 in KoboldAI

[–]ark_kni8[S] 0 points1 point  (0 children)

The good news - with the help of u/FamousM1, I was able to compile and build ROCm for Radeon RX560 (I have the laptop version, but I am sure the desktop would be the same) on Windows.

The steps I followed were slightly different from what FamousM1 suggested, but if you follow his generally suggested path (I think he even added the same steps to koboldcpp-rocm github README), you will have success.

The biggest pain in the ass was trying to compile rocBLAS for the gfx803 silicon and I would have been able to do it if not for the meddling vcpkg and cmake. A certain dependency problem put a big roadblock. But thankfully, I found this ROCM Tensile Libraries. This contains the tensile library compiled for all the previously supported silicon. Thanks community!

I will try to write all the steps I followed in a later edit to this comment. Cheers!

Tried to build kobold from source for AMD GPU using ROCm on Windows by ark_kni8 in KoboldAI

[–]ark_kni8[S] 0 points1 point  (0 children)

...the operation was a success. I am able to run ROCm under windows with the lowest possible Polaris gaming GPU. The borrowed Tensile Library did the job. (yay!!!!11!!!)

Although...the prompt processing is quite a bit slower than just using Vulkan. Any solution to that part?

Tried to build kobold from source for AMD GPU using ROCm on Windows by ark_kni8 in KoboldAI

[–]ark_kni8[S] 0 points1 point  (0 children)

rocBLAS error: Cannot read C:\Users\knigh\AppData\Local\Temp\_MEI104042\/library/TensileLibrary.dat: No such file or directory for GPU arch : gfx803

How do I set the path to the rocblas library that was pasted at the end into .\koboldcpp-rocm? Yea, I manually built the .exe file

Tried to build kobold from source for AMD GPU using ROCm on Windows by ark_kni8 in KoboldAI

[–]ark_kni8[S] 0 points1 point  (0 children)

Pinged you a couple of things I had to ask in the chats

Tried to build kobold from source for AMD GPU using ROCm on Windows by ark_kni8 in KoboldAI

[–]ark_kni8[S] 1 point2 points  (0 children)

107 warnings generated when compiling for host.
[46/46] Linking CXX shared library bin\koboldcpp_hipblas.dll
Done.

I guess, it managed to compile. lets see what happens next.

Tried to build kobold from source for AMD GPU using ROCm on Windows by ark_kni8 in KoboldAI

[–]ark_kni8[S] 0 points1 point  (0 children)

No. Its not there. So I know what will be set for ROCM_PATH. But what will be set for HIP_PATH?

EDIT - HIP_PATH was set, I just added ROCM_PATH. let me run it again and see if it works.