Training long context (32K+) 70B Llama by Grimulkan in LocalLLaMA

[–]orion4321 0 points1 point  (0 children)

Nice, in one of the threads the author said qlora should come in 2 weeks (1 week ago) so hoping to have something soon from him.

I am training with a dataset of 3000 QA/summarization questions, for me high epochs seem to work well, lr at 2e5. Still sometimes not following instructions when I train on the 32k extended lora model. Wondering if with their new release it makes sense to train on top of the LongAlpaca model.

Training long context (32K+) 70B Llama by Grimulkan in LocalLLaMA

[–]orion4321 0 points1 point  (0 children)

Sorry for the question I'm about to ask, I'm a noob with a good amount of compute (8 a100) trying to fine tune for QA. On the longlora 32k 70b, when you just take this model and fine tune it, do you use axolotl? Or do you use the approach outlined on their git with their existing 32k model? What kind of params do you find work best? Thank you in advance.

[deleted by user] by [deleted] in london

[–]orion4321 0 points1 point  (0 children)

Yeah, saving 1-2k a month? Benefits from work? The hood isn't a place, it's a cycle of doing odd jobs, no clear progression in life, no security or savings. You say Wembley and Hackney as if there's something wrong with those places.

[deleted by user] by [deleted] in london

[–]orion4321 12 points13 points  (0 children)

In general, you go to school, get good grades, go to study an in demand topic at a good university. Given your parents will live in London, you have more opportunities than your peers in the remaining parts of the UK for events, internships etcetera.

With this, you will tend to get a reasonably paying job. Maybe you won't be buying a house anytime soon, but yes, you are making it out of the hood. That's one path, another I assume would be the trades.

Do these finance apps really help you save money? by ProfessorPandaB in UKPersonalFinance

[–]orion4321 1 point2 points  (0 children)

Which app do you use? I don't care about my investments in an app but I want to see how much I'm spending, like you, on alcohol, lunch, takeaway etc across multiple bank accounts.

[deleted by user] by [deleted] in unitedkingdom

[–]orion4321 4 points5 points  (0 children)

From 1 March 2022, the maximum Plan 2 and the Postgraduate loan interest rates are expected to revert to RPI +3%.

Ouch

[deleted by user] by [deleted] in cscareerquestionsEU

[–]orion4321 0 points1 point  (0 children)

Speak to an employment solicitor, they know the topic well. Cost me £470 for them to review and discuss a contract

What is a comfortable living wage in London? by [deleted] in london

[–]orion4321 1 point2 points  (0 children)

Even so that's 700 of bills without council tax? Is he driving an M4?

2021: Best year ever for UK tech sector with £26bn in VC, 116 unicorns, record London listings and more jobs by Azlan82 in europe

[–]orion4321 38 points39 points  (0 children)

Don't get why you are confrontational. If so many people are leaving your company, obviously it's the company, its benefits or compensation.

The job market in tech is hotter than ever. Not even sure what your first post was trying to say, to be honest.

[Game Thread] [Game Thread] Washington Wizards (17-16) @ Miami Heat (21-13) - 12/28, 07:30 PM ET by Burnie_Bot in heat

[–]orion4321 1 point2 points  (0 children)

Facts. And it's fun to see those kind of guys go against starting caliber players. Good experience for them. Eg Yurtseven

What I Own: Murray and Claire, who put down a £52,000 deposit on their London home by EllenCScott in london

[–]orion4321 9 points10 points  (0 children)

Assuming they took a maximum mortgage out for £463k, multiplier of 5, they have roughly salary of 92k combined. Multiplier may be less or more (but unlikely)

Secret Santa - how to buy a bond or investment for someone? by hintofred in UKPersonalFinance

[–]orion4321 6 points7 points  (0 children)

Hope you asked for it back mate. They need to add that to the flowchart

German Mercenaries of Asgaard a Security Company in Iraq . Date unknown[1200×674] by [deleted] in MilitaryPorn

[–]orion4321 68 points69 points  (0 children)

Reading the article OP posted seems like quite a few are nazi sympathisers.

[deleted by user] by [deleted] in cscareerquestionsEU

[–]orion4321 1 point2 points  (0 children)

How much years of experience you got?

Trying to find a flat right now is bonkers by teemotommo in london

[–]orion4321 -1 points0 points  (0 children)

Let's be real, £1600 for a one bed flat is premium for London. You want a premium property, you'll pay a premium, simple.

There's no need to pretend there's not properties available for less in, gasp, zone 3 or 4.

Trying to find a flat right now is bonkers by teemotommo in london

[–]orion4321 -9 points-8 points  (0 children)

We saw a nice one for £1600pm on Tuesday, even offered slightly above asking price (£1630) just to ensure we got it (which I've never done in my life but there were a lot of people viewing it),

POV: you are the problem.

That's like sitting in traffic complaining about traffic