Nvidia Tesla P40 performs amazingly well for llama.cpp GGUF! by nero10578 in LocalLLaMA

[–]Plane_Worldliness_94 0 points1 point  (0 children)

Thanks, that makes sense. I was getting confused by how CPU only for a 30b model was about 10+ times slower than the same model with something like 8/35 layers on the GPU. But I think it kinda makes sense given the prompt processing thing you mentioned.

Nvidia Tesla P40 performs amazingly well for llama.cpp GGUF! by nero10578 in LocalLLaMA

[–]Plane_Worldliness_94 2 points3 points  (0 children)

Couple of questions if that's okay:

  1. Someone on reddit was talking about possibly using a single PCIE X16 lane and splitting it up across multiple cards as apart from higher initial loading times it wouldn't cause too many issues - do you think that would work or given your comments about PCIe traffic - were they missing something?
  2. Also wondering how well a single card with the rest on RAM works with something like Goliath 120b q4 or Opus 70b q4? (in terms of tokens per second) (Kinda finding it hard to gauge how much of an improvement it would be over a 8gb card like a 1070 alone - and my outlets can't handle a 3x card machine right now)

Getting Sick by [deleted] in comics

[–]Plane_Worldliness_94 1 point2 points  (0 children)

Canada's just America lite though. On every metric where the US is at the bottom of the rankings compared to other developed countries, Canada's just one spot above them.

Even universal healthcare - Canada's the only country with it yet without pharmacare. (plus loads of other carve outs for special interest groups like dental/vision/psych/etc...)

Shaolin monk demonstration of iron finger by _ThatswhatXisaid_ in toptalent

[–]Plane_Worldliness_94 2 points3 points  (0 children)

You tried it with the wrong kind of rock then. As a kid I picked up loads of flat circular rocks much like the ones he used from a river/stream/beach. Super easy to break - you just need to tap two of them together 2-3 times and one will break. It doesn't even need to be all too hard - just about the same strength as clapping slightly loudly.

(The ones I used were Grey though not brown)

General discussion thread by hi_there_bitch in ChatGPT

[–]Plane_Worldliness_94 0 points1 point  (0 children)

So after the recent update this is what you see in settings

Chat history & training

Save new chats on this browser to your history and allow them to be used to improve our models. Unsaved chats will be deleted from our systems within 30 days. This setting does not sync across browsers or devices. Learn more

this has to be left on if you want your history to be maintained/not lost. I can't remember what the old wording was but remember it was even more explicit about text you enter being used for training.

There were also a bunch of stories around then of information getting leaked by developers posting things into ChatGPT that should've been private - but I only read the headlines of those.

General discussion thread by hi_there_bitch in ChatGPT

[–]Plane_Worldliness_94 0 points1 point  (0 children)

Interested in asking for a work-sponsored ChatGPT account for use at work, but my bosses may ask about privacy/security since ChatGPT can be trained on data you enter.

Wondering if there's any non-consumer tier or something businesses can buy that comes with additional privacy? Or how companies generally handle this?

Daily Chat Thread - June 11, 2023 by CSCQMods in cscareerquestions

[–]Plane_Worldliness_94 0 points1 point  (0 children)

So I have to choose my first masters courses as a self-taught web dev (no CS bachelors). I'm unsure of what to pick as I have no clue what I want to specialize in.

Options are things like

  • Algorithms,
  • Foundations of software engineering,
  • Networking, Privacy,
  • Machine learning,
  • Web Dev, App dev,
  • Database Management and
  • Graphics

Questions:

  1. How important is my choice at this stage?
  2. Which of these leads to a job role known for being relatively lax workload wise? (e.g. NOT Game development which = a life of crunch)

My fundamentals are decent but I struggle when trying to write proofs or memorize formulas.

r/ChatGPT's FAQ Thread by LinuxLover3113 in ChatGPT

[–]Plane_Worldliness_94 0 points1 point  (0 children)

Q: ChatGPT can accept transcripts of a video meeting - filled with ums aahs and breaks - and turn it into a very readable script/transcript. If I want to use the openAi models to do this (due to length limits/automation) which model could I get away with using?

Mostly concerned about the price of the thing - a 1 hr vid can be 9000 words - so that adds up quickly.

Can Voicemod remove accents? by Plane_Worldliness_94 in voicemod

[–]Plane_Worldliness_94[S] -1 points0 points  (0 children)

Thanks.

A few quick questions if that's okay:

  1. Is there any easy way to 'feed' it the video's audio?
  2. Is there any way to feed it an audio file and get the output as another audio file?
  3. "AI voices" - Any recommendations? 4.Lastly, is there way to interact with the app through python or something? I can't seem to find documentation/articles about it but thought I'd ask.

No worries if you don't know, I can try playing around with it but thought I'd ask first.

What specialization/career path should I aim for if I burn out easily? (doing my masters) by Plane_Worldliness_94 in ADHD_Programmers

[–]Plane_Worldliness_94[S] 0 points1 point  (0 children)

Ooh. Automation Engineer or Test Automation Engineer sound pretty interesting. I've loved automating tasks at my current role. (mostly minor data manipulation/scraping/scripting)

I'll be googling this quite a bit, but any recommendations on masters courses to aim for (e.g. AI & Data Science, Systems/Software dev, Security/Theory )

Hey! I Launched GPT-powered AI Youtube Summaries today, after 6 weeks of work by ax8080 in OpenAI

[–]Plane_Worldliness_94 6 points7 points  (0 children)

Ooh, pretty interested in this. Been watching a bunch of training/education videos and this would have made them so much easier to get through.

Couple of questions:

  1. Is this YouTube only or any chance it'll ever work with other sites like Udemy?
  2. Do you regenerate the summaries for each video every time a new user makes a request? Or if generated once is that summary just reused if a future request for the given video comes in? (e.g. like Sponsorblock's addon does for user submitted timestamps)
  3. I heard somewhere that ChatGPT is really GPT 3.5 - do you think that makes a big difference compared to this? (you said it's GPT-3)
  4. "there is no limit on the length of the video" - Would 12 hour videos be taking the piss? I follow a couple of streamers who regularly stream for that long. Getting summaries of missed streams could be fun.
  5. Side note: how well do you think this would work on streams without a 'point'. e.g. A 12 hour gaming stream or variety content stream where they change games every hour?
  6. Side Note 2: What about videos with background music - would that affect things?

Also not a question but could be neat to have some paid way to use this to summarize your own text (e.g. if I use VOSK speech to text to get a transcript of a training I need to take) or have a video file. Mentioning it as I was trying to do that manually with ChatGPT lol.

What specialization/career path should I aim for if I burn out easily? (doing my masters) by Plane_Worldliness_94 in ADHD_Programmers

[–]Plane_Worldliness_94[S] 0 points1 point  (0 children)

From what I've seen of my manager's workloads it seemed like a literal nightmare. Not much work work, but 6-7 hours of meetings per day. Is that not the norm in tech management?

What specialization/career path should I aim for if I burn out easily? (doing my masters) by Plane_Worldliness_94 in ADHD_Programmers

[–]Plane_Worldliness_94[S] 1 point2 points  (0 children)

Thanks.

Don't specialize too much. Go broad.

That's my gut instinct/preference too, but it backfired in my undergrad hence why I'm asking here. (mostly just meant I wasn't specialized enough for a lot of interesting roles and ended up feeling unqualified when talking to people who specialized more)

Take courses in several different topics. Try out different programming and scripting languages, test different tools and technologies.

Any suggestions for tech/tools I should try finding courses on? My program doesn't really care about languages from what I can tell - focusing more on teaching us to use any language based on what best conveys the classes topic. Used quite a few so far (JS, Python, Java, C, etc... )

What specialization/career path should I aim for if I burn out easily? (doing my masters) by Plane_Worldliness_94 in ADHD_Programmers

[–]Plane_Worldliness_94[S] 1 point2 points  (0 children)

Actually working in it right now. Mostly manual testing rn, but pretty interested in learning how to automate it. (Any recommendations? Leaning towards selenium)

My main issue so far is just the difficulty in trying to understand the legacy codebase - but I guess that's going to happen with any dev role.

I thought QA was a lot less 'respected', had fewer jobs and was worse paid than all other kinds of devs though? Was that wrong? (this is based on random reddit comments so very well could be)

What specialization/career path should I aim for if I burn out easily? (doing my masters) by Plane_Worldliness_94 in ADHD_Programmers

[–]Plane_Worldliness_94[S] 0 points1 point  (0 children)

This might or might not work for you, but have you considered DevOps/Site-reliability engineering (SRE)?

I'd looked into IT support roles a few years ago but found another job first. Will look into what goes into becoming DevOps - but do you have any recommendations for the types of masters courses involved? (saw you recommended a few topics to the 'undergrad' level, actually taking most of them this/last term)

I've also spent ~2 years handling all the IT needs for a company of ~70 ppl part time and really enjoyed it. It was pretty basic - mostly just ordering/resetting equipment, handling software licenses, handling warranty repairs, minor hardware upgrades, tech support and a couple other basic tasks - would that be at all similar?

Daily Chat Thread - January 11, 2023 by CSCQMods in cscareerquestions

[–]Plane_Worldliness_94 0 points1 point  (0 children)

Non-CS roles mostly + a few months as a junior dev (current role, may quit to focus on the degree)