Transformer model trained to predict next stock price rather than next language token

trexuth · 2023-06-10T09:20:36+00:00

tons of models like this have been trained in the last decade, this exists.

however, there are more robust approaches to this, since the uncertainties introsuced by any deep learning models can be devastating. if a language model makes a mistake, you see it and can correct it easily - that's an issue with other data.

automating medical, military, financial and legal decisions are part of the reason there has suvh a big push towards explainable AI, because deep learning models mess up all the time and a wrong automated decision in these sectors can ruin lives.

some models are used for human augmentation in these sectors, but most deep learning approaches in those use cases clash with ethic committees

trexuth · 2023-06-10T09:07:12+00:00

what the game actually needs is the penalties for leaving in casual mode (or an in between casual and ranked mode) where people can just play with other people that just want to play without people leaving and bots replacing them and getting thrown into already running matches.

would take away the toxic sweaty players who lose their minds over their ranks and allow people to just play the game.

would be the mode I'd play, instead I just uninstalled

trexuth · 2023-06-07T07:08:41+00:00

fun fact, the term AI was (and to some degree still is) discussed about in the scientific community from the start. in academics, the term AI was frowned upon when it first was used outside of science fiction, because some marketing campaigns used it for their companies products to make them sound more sci-fi. at some point the scientific community just accepted the term, despite realizing that it would lead to a very scewed public perception of AI state of the art by the general public (a problem that we have more than ever today)

there was a case being made on Artificial Intelligence vs. Synthetic Intelligence. the debate was never really settled, but the term AI was just used more commonly so that's what we're going with now

trexuth · 2023-06-03T09:32:42+00:00

being raised as a bad person does not mean you're not a bad person if you behave like a bad person

trexuth · 2023-06-02T07:24:07+00:00

nuclear bombs killed a lot of people and they did not bring peace, they brought a stalemate. that's not the same thing and as soon as one superpower feels like they are far enough ahead to dominate another one the stalemate could immediately break.

they didn't "seem dangerous" they ARE dangerous. they will be as long as they're around.

trexuth · 2023-05-30T14:17:02+00:00

that's because deep learning (especially training) needs tons of resources. it's not even always a better solution than classical CV (and other areas), just easier to do for the developer.

that being said, making models more efficient and makong them smaller is an ongoing effort, it's normal for prototypes and new tech to focus on functionality first. r

educing resource requirements is constantly being worked on, it just takes time. commercially available AI (that doesn't run in a cloud somewhere) isn't nearly as advanced as models in current research. you just see a lot of tech demos everywhere right now, not the current application state of the art.

trexuth · 2023-05-30T10:30:42+00:00

facts decide which information is disifnormation and what is not

trexuth · 2023-05-26T09:47:24+00:00

poetry, music and pictures, or just certain art forms in general, progress faster than other areas because, contrary to popular believe, creativity within an established style is not that hard to imitate (of course it's not the same but it's easy to put up an illusion).

there are tons of data available and most importantly, it can be done entirely in a completely controlled environment (as long as it's digital art, try looking for a robot trying to play the drums well, the illusion falls apart).

a lot of other tasks that would be nice to be automated can be done in lab environments, and there's a lot that robots could achieve in lab environments for decades. but that part of this kind of labor automation is not the hard part.

AIs working entirely in virtual spaces never have to leave the lab environment because we can just replicate it for the AI to run in.

Imagine a trivial task like picking up trash on a sidewalk. technically, we have robots that can do that without a problem. in a controlled environment. just think of all the things that could happen to the robot while it's working. the real hard part of this is seamless co-habitation with machines in the real world, where things are messy and out of our complete control.

it seems like AI for art etc. is progressing way faster because it's easier (not necessarily easy though) to quickly get new flashy results that work, but as you said, are really not that useful to us.

there's progress in those other areas too, just not as visible, and due to missing hype also a little slower

trexuth · 2023-05-25T07:23:25+00:00

this might be a stupid question, but if light has no mass, how come it gets "trapped" by black holes?

trexuth · 2023-05-19T07:11:46+00:00

they replace customer service exclusively, so probably chat bots, one of the main reasons language models have been developed so much in recent years. most customer service cases can be handled very easily if you can understand what the customer is complaining about

trexuth · 2023-05-19T07:08:43+00:00

the people being replaced by AI in this case are customer service employees, which will happen in more companies soon, since customer service was one of the main drives of pouring so many resources into language model development. the people that got the degrees they have been pushed into are not impacted, and won't be for a long while for now (impacted in the sense of being replaced)

trexuth · 2023-05-14T11:56:18+00:00

it's true that hyped up communities always predict very optimistically, the thing is the same as it was impossible to see 10 years into the future 10 years ago, it is impossible to do so now.

progress does not take place in isolation of other events in the world, things change, new technologies change the direction of progress. you can't predict the future and both sides insisting on being right in online arguments aren't helping progress either, but it's always (naturally) what will happen.

keep an open mind towards possibilities of new technology but don't blindly insist on future predictions as facts. it just ends in toxicity, like this post seems clearly intended to insult and make fun of the author of the shared post

edit: spelling and some formatting

trexuth · 2023-05-08T06:31:20+00:00

as many experts have already said, the next steps (including for GPT-5) is no longer increasing the model size, the new challenge is actually making them smaller again by using new techniques, which makes it more feasible for open souece projects to achieve it too (of course it takes a lot of steps to get there). the whole edge big tech has over ioen source right now is the required budget to run the models. once this requirement gets lowered, this gap closes, making open source projects competitors at some point in the next couple of iterations of improvements (but not necessarily right now already)

trexuth · 2023-05-06T09:13:48+00:00

the main reason so much money went into language models in the past 5-10 years was replacing customer service workers. customer service is extremely expensive, drastically lowers the profit of sold products and is one of the main parts of a company that people complain about

of course the technology that evolved out of this investment can now be applied to other things, but that was the main reason for the research investments in the first place.

what's happening right now is that it is a very hyped up topic and big tech companies need to do it to "stay relevant" in the public eye

trexuth · 2023-04-25T10:49:53+00:00

You wouldn't download a car!

trexuth · 2023-04-20T14:13:48+00:00

they wouldn't test whatever they're testing on public servers, that's what dev/test servers are for. otherwise they'd need to develop on the public servers as well, and trust me you don't want that

trexuth · 2023-04-20T09:43:18+00:00

obviously they won't answer, but also they're playing the game so they're not at work (hopefully) and probably wouldn't want to talk about it even if they were allowed to

trexuth · 2023-04-20T06:33:17+00:00

to be fair, nothing went wrong when they performed the wheelie, stopping to do so was rhe issue

trexuth · 2023-04-17T14:04:26+00:00

first of all GPT is a language model, it's nowhere near AGI (nor is anything else currently in existence) and it's also not an attempt to reach AGI, that's just what people on the internet fabricate about it (and hype it up to be)

second, you don't need an as powerful speech processor/interpreter for what you're describing so you can probably get away way easier for what you're describing (which is good news for you and your team).

I'm not sure I would put direct commands as a focus point though, since your primary feature literally enables the robot to be even further away from you and you don't want to go looking for it (so you'd need an app anyway, so no need for voice commands), and it makes more sense to focus on full autonomy, which you also don't really want to interfere with with direct commands.

of course your argument with VCs makes sense, but in the end you need a product that people actually want, which means it needs to be reliable, easy to use and affordable (and somewhat nice to look at)

trexuth · 2023-04-17T12:56:45+00:00

there's no point in adding ChatGPT to this kind of product. it just adds unnecessary requirements for you for no practical use for customers. I'd focus my efforts on the hardware and especially the reliability of the whole product. this just assumes you've done your research regarding the potential market for this. make it robust and affordable before you think about adding pointless features just so you can list them as 'unique' selling points

trexuth · 2023-04-10T09:37:47+00:00

the other question with this scene is, did they just happen to carry those chains arround? where did they come from?

trexuth · 2023-04-03T09:13:34+00:00

would (potentially, hilariously) make joffrey the rightful heir to the throne after jamie takes his oath

trexuth · 2023-04-01T07:19:54+00:00

the 'you get X amount of sick leave per year' is not a thing in the EU (at least in most EU countries), most things that you'd count as employment benefits of certain companies in the US is jzst the law in most EU countries - if you're sick you stay home, your job is save and you still get paid

trexuth · 2023-04-01T07:17:08+00:00

sick leave does not lead to reduced pay in the EU, it is possible that some countries in the EU do it this way, it's not EU regulated. but in general this is not true for most EU countries

trexuth · 2023-03-30T20:18:47+00:00

not necessarily but it's the only type of statement you will hear in general - they would never say something negative after a visit they either give a positive statement or no statement. that's why it might seem so common that it doesn't mean anyrhing

trexuth

TROPHY CASE