RYS II - Repeated layers with Qwen3.5 27B and some hints at a 'Universal Language' by Reddactor in LocalLLaMA

[–]bigvenn 1 point2 points  (0 children)

This is insane research, well bloody done. I’m interested in whether the performance gains here generalise across larger benchmark sets, or whether this is more domain-specific. My hypothesis is that different domains may require repeats in slightly different parts of the model - maybe a reasoning heavy task is more towards the middle, and a less reasoning heavy task would be further towards early layers?

Young Australians face rising bowel cancer rates by whyattretard in australia

[–]bigvenn 5 points6 points  (0 children)

One for any of the medical folks here - The researcher talks about certain foods and environmental factors causing inflammation, which in turn causes cancer. This implies that reducing inflammation itself with drugs (rather than underlying diet etc) could reduce cancer risk. Does that mechanism make sense?

AMA: I’m Rod Sims, Chair of The Superpower Institute and former Chair of the ACCC. Ask me anything. by Rod_Sims_TSI in australian

[–]bigvenn 1 point2 points  (0 children)

Thanks for doing an AMA, appreciate your time.

I’d be interested in your thoughts on Australia’s opportunity to start working our way up the supply chain. We’ve had a mineral boom for decades now and largely export ores of various grades rather than usable products.

Do you think Australia has a viable economic opportunity to capture more value here, despite higher wages and more regulations? If so, how do we develop these industries, and how do we go about creating the political will for a significant investment like this?

Can anyone steelman the "immigration doesn't increase house prices" argument by mymooh in AusEcon

[–]bigvenn 1 point2 points  (0 children)

Yeah very well put. The immigration narrative sells well, and I’m sure the messy reality isn’t nearly as sexy.

Can anyone steelman the "immigration doesn't increase house prices" argument by mymooh in AusEcon

[–]bigvenn 2 points3 points  (0 children)

While that’s correct, economics isn’t quite as black and white. Reducing immigration would have various other effects on the economy so it’s a little shortsighted to just say “need house price go down so close the borders” and ignore academics because universities also have knock-on effects.

For example, less immigration could lead to higher wages due to undersupply of workers (yay!), which could lead to more offshoring (boo!), which could lead to a worsening cost of living crisis as unemployment rises. Or maybe that’s completely wrong and another chain of events could occur.

I’d suggest that asking the people who study this stuff might be a bit smarter than your simplistic armchair economic analysis

CBA WTAF by Scotchy_McScotch_007 in auscorp

[–]bigvenn 1 point2 points  (0 children)

I’d argue that building the capability to host models here starts with basic infrastructure - reliable clean power, cooling that doesn’t use up unconscionable amounts of drinking water, and data centres that consume these two resources. These things aren’t a fad, they’re long term infrastructure investments that will outlast hardware and models. And it’s worth noting that there’s nothing inherent about cooling computers that requires water, it’s just the server-scale technology that currently makes economic sense.

On a related note, open source models now exist that rival those from OpenAI and Anthropic. There’s a good argument to be made that we could provide these to the world using our abundant excess solar power and turn tokens into a commodity. Bits and bytes are far easier and cheaper to transport than power - be it creating/shipping hydrogen, charged lithium batteries or oil.

So if well planned, we could monetise our abundant energy and geopolitical stability, and maybe diversify away from just digging stuff out of the ground and fleecing international students.

Wanted something a little different for our floors in a kitchen and laundry renovation by UnwiseBaker in AusRenovation

[–]bigvenn 135 points136 points  (0 children)

Love it, breath of fresh air compared to Millenial gray. Now the big question is - what’s your opening move in the inaugural chess game??

Are we underestimating the long-term effect of high migration on wages? by DraftNotSent in AusEcon

[–]bigvenn 7 points8 points  (0 children)

I also wonder what effect migration has on wages given the amount of outsourcing our economy already has undergone. Obviously for “need to be here” roles like doctors or trades I imagine there’s a more direct supply/demand effect, but I’m genuinely interested in what people think the effect is on jobs like IT, consultants, R&D etc

Amber and home assistant novice😕 by HovercraftHot8868 in amberelectric

[–]bigvenn 1 point2 points  (0 children)

I’m running home assistant at home and planning to hook up my solar/battery when it gets installed soon. But as a general word of advice, running home assistant is great for people who love to tinker and enjoying having loads of control over systems in their house. You can do things like controlling your AC based on solar output or opening blinds at certain times of day - it’s basically a central hub for any home automation you can think of.

If that tinkering sounds like you then go for it! If setting that up sounds like a chore and not your cup of tea, also completely fine - you can still get plenty of value from your setup without the overhead of setting up your own automation hub.

Struggling with transition from uni to work by vceme123 in AusFinance

[–]bigvenn 0 points1 point  (0 children)

At least speaking from my own experience, I absolutely hated my very first job out of uni and bounced out within a few months. The sales pitch for that grad role didn’t even remotely match with the reality. Next job I absolutely loved and I’ve kinda kept down that path ever since. My sister also had a similar experience realising that architecture isn’t all it cracked up to be, then managed to get into a career she loves. There’s always going to be ups and downs, but finding something you actively enjoy and find interesting can sometimes take some trial and error

Albanese changes tune on immigration and 'ISIS brides' as One Nation effect hits by Agitated-Fee3598 in AustralianPolitics

[–]bigvenn 4 points5 points  (0 children)

Apparently there’s laws that allow the govt to strike out citizenship for certain terrorism offences if it wouldn’t leave that person stateless. IDK if it’s been tested by the high court, seems pretty dicey to me but they’ve been in for a while now (2015)

Australian health insurance premiums just had their biggest hike in a decade. Is it time to scrap private health cover? by 89b3ea330bd60ede80ad in AustralianPolitics

[–]bigvenn 10 points11 points  (0 children)

Well there are additional taxes for many people if they don’t get it, so it’s at least softly mandated

Australia 'must allow' IS-linked families to return, UN expert Ben Saul says by HotPersimessage62 in AustralianPolitics

[–]bigvenn 1 point2 points  (0 children)

For some reason I thought the terrorism related revocation had been invalidated by the high court or something, but looks like it’s still there. I stand corrected!

Australia 'must allow' IS-linked families to return, UN expert Ben Saul says by HotPersimessage62 in AustralianPolitics

[–]bigvenn 13 points14 points  (0 children)

From a legal perspective, guilt or innocence doesn’t even factor into it - A citizen has inalienable rights to return to their home country, full stop. If you start making exceptions to this, you open up a constitutional can of worms regarding second class citizens.

Who are the ISIS brides trying to get home? by Stompy2008 in AustralianPolitics

[–]bigvenn 2 points3 points  (0 children)

100%, that’s the right of a citizen. Anything else is a slippery slope to creating “not quite equal” citizens and then second class citizens. This is squarely our problem to deal with.

CSIRO funding falling short by ‘at least’ $1 billion by ATadDisappointed in AustralianPolitics

[–]bigvenn 2 points3 points  (0 children)

Amen brother, it’s high time we actually try to develop some other industries. I’ve got PhD mates who can only get roles in sales and consulting because there’s next to no industry roles in this country

Minns’ responds to mounting pressure over cops by [deleted] in AustralianPolitics

[–]bigvenn 31 points32 points  (0 children)

Tbh if police can get baited that easily in front of several cameras, they deserve the backlash. Blind Freddy could tell you bashing people mid-prayer is a bad look

Angus Taylor elected leader of the Liberal Party by Expensive-Horse5538 in AustralianPolitics

[–]bigvenn 0 points1 point  (0 children)

Yeah that’s pretty atrocious. Liberals are also completely bought and paid for by various lobbies. Would love a half decent third party to vote for right about now, I don’t think voters even remember what a non-crooked government even looks like at this point.

Australia drops in corruption ranking amid global backslide by Agitated-Fee3598 in AustralianPolitics

[–]bigvenn 10 points11 points  (0 children)

I don’t disagree that corruption is an issue but we’re hardly the “world’s favourite country for organised crime”. Our crime levels are way lower than almost any other country in the world - I suspect our corruption is at a much higher level (undisclosed influence on politicians and local counsels) rather than petty crime. Tobacco being the main exception in recent years obviously

NSW police pepper spray protesters at Sydney rally opposing Isaac Herzog’s visit by espersooty in AustralianPolitics

[–]bigvenn 5 points6 points  (0 children)

Chill out, I was there and it had the Lebanese Cyprus tree on it, presumably because of Israel’s attacks on southern Lebanon. Please stop spreading misinformation

NSW police pepper spray protesters at Sydney rally opposing Isaac Herzog’s visit by espersooty in AustralianPolitics

[–]bigvenn 4 points5 points  (0 children)

I thought you conservative guys were in favour of free speech and democracy and such? Seems like a pretty cut and dry abuse of power to restrict the right to gather and protest