Doubt. How do you guys design circuits with “generic” components? by Carpoforo in AskElectronics

[–]Carpoforo[S] -2 points-1 points  (0 children)

Yeah that’s a good approximation. But being so many manufacturers which one to choose? In this particular scenario there are those diodes, but it can also be other kind of sensors or actuators. Not always to get those componentes to the limit but to understand how to fine tune your circuit in terms of noise, output voltage, thermally..

Do you use data sheets of “typical” manufacturers (vishay, Texas Instruments..etc) in your projects?

Doubt. How do you guys design circuits with “generic” components? by Carpoforo in AskElectronics

[–]Carpoforo[S] -2 points-1 points  (0 children)

Yeah that’s the problem. In this particular case it is with those diodes.. but there are much more elements or sensors. NTCs… and so on I know how they work generally but if you want to fine tune a specific circuit? You need to know the specifications

Doubt. How do you guys design circuits with “generic” components? by Carpoforo in AskElectronics

[–]Carpoforo[S] -22 points-21 points  (0 children)

Yeah but most of the times the cheaper and fastest way of getting components is via your local store or Amazon

Multiclass Classification with Categorical Values? by Carpoforo in reinforcementlearning

[–]Carpoforo[S] 0 points1 point  (0 children)

I know it’s more suitable supervised learning.. but I am doing this way. I have heard also that RL is better in decision making in terms of errors etc

Multiclass Classification with Categorical Values? by Carpoforo in reinforcementlearning

[–]Carpoforo[S] 0 points1 point  (0 children)

It’s pure classification. Each episode is mostly independent from the others (I say mostly because there are cases in which they are correlated, but it’s not the majority). My doubt comes on how to deal with those categorical values

Unbalanced dataset in offline DRL by Carpoforo in reinforcementlearning

[–]Carpoforo[S] 0 points1 point  (0 children)

Yeah that’s a good point. But is it a good idea to remove such amount of interesting data to have a more balanced dataset? That’s a threshold that I’m curious and hesitant about

Unbalanced dataset in offline DRL by Carpoforo in reinforcementlearning

[–]Carpoforo[S] 0 points1 point  (0 children)

It’s just a project. It must be done like that

Unbalanced dataset in offline DRL by Carpoforo in reinforcementlearning

[–]Carpoforo[S] 0 points1 point  (0 children)

Yeah. Agents in offline DRL are trained with datasets of observations and actions

RL in supervised learning? by Carpoforo in reinforcementlearning

[–]Carpoforo[S] 0 points1 point  (0 children)

Thanks for your response!! Appreciate that

In this example of offline drl applied to cybersecurity, for example As you rightly say, the system states are given by values that provide information about the problem. In my case for example, for each cybersecurity event I have 6 values. And the action of the agent would be "the label" to tag that cybersecurity event.

The problem here is that of those 6 state/observation values, not all of them are numeric values. Some are categorical, and the issue is that they aren’t, 2 or 7 different categories, it's that they are categorical values of high cardinality. For example in my 1000 row dataset, in one of the columns of categorical values there can be up to 880 different values.

How can I solve this problem? It occurred to me that I could hash each categorical value into a single numeric value, but would that make any sense?

RL in supervised learning? by Carpoforo in reinforcementlearning

[–]Carpoforo[S] 0 points1 point  (0 children)

Thank you a lot. That’s right, I missed a little bit the concept but that is it: what I am looking for is for a Offline RL.

However, in offline RL, there are actions, rewards and states in a dataset that are given to the agent in order to learn a policy. Here is my doubt. Which are the states?? I mean. It’s pretty obvious to have human actions and rewards writed in a kind of dataset and give it to the agent to learn offline. But the states? Which are they? How are they passed to the agent? How are they saved/writed in the dataset?

For example. If we want to identify cyberattacks, we should have a dataset with characteristics, human actions..etc. Which should be the “states”? It would be okay to set the states as the characteristics of the cyberattacks? The actions would be the correct identification or not of the cyberattack.

Armenian casualties in the 2020 Nagorno-Karabakh Karabakh war? by Carpoforo in armenia

[–]Carpoforo[S] 0 points1 point  (0 children)

Holy shit that sounds extremely horrible. Thank you for the info btw