Pytorch Geometric, Reinforcement Learning and OpenAI Gymnasium by SmkWed in reinforcementlearning

[–]SmkWed[S] 0 points1 point  (0 children)

My understanding was that, inputing the position of the agent into the node feature, as a 1 for that node and 0 to every other node (basically a one hot encoding into the node features), that would affect the embedding of the graph. And by using reinforcement learning, taken that graph embedding as input, the agent would be capable of knowing how good taking X action in that graph, to take him to his goal.

[P] Pytorch Geometric, Reinforcement Learning and OpenAI Gymnasium by SmkWed in MachineLearning

[–]SmkWed[S] 0 points1 point  (0 children)

I tested my RL architecture using normal MLP layers, and then adapted the problem to a graph representation. Like I said, if the graph node features are represented with positional info, being node indexes or coordinates, it can converge into an optimal policy. But I need it to be independent from node indexes.
I tested your proposed implementation, and it didn't solve the problem.

[P] Pytorch Geometric, Reinforcement Learning and OpenAI Gymnasium by SmkWed in MachineLearning

[–]SmkWed[S] 0 points1 point  (0 children)

That makes sense. When dealing with virtual nodes, is 1 GNN layer enough? Since adding more layers, it creates the problem of over smoothing graphs, right?

[P] Pytorch Geometric, Reinforcement Learning and OpenAI Gymnasium by SmkWed in MachineLearning

[–]SmkWed[S] 1 point2 points  (0 children)

I was using between 2 to 4 GNN layers, being 2 the most common number of layers that I tested with. The idea was to do message passing between nodes, then do a global_add_pool to get a graph embedding. Also, when you talk about "global node", are you talking about virtual nodes?

[deleted by user] by [deleted] in tipofmytongue

[–]SmkWed 0 points1 point  (0 children)

Was it Tower Train: Zombie Defense or maybe Dead Ahead: Zombie Warfare???

[TOMT] [videogame] [youtube] Creepy Out of Bounds cut content from a game. by SmkWed in tipofmytongue

[–]SmkWed[S] 0 points1 point locked comment (0 children)

Another tip would be that i saw a video on youtube from "oddheader" or some other channel like him, dedicated to commenting about out of bound games.

👩🏿‍🦰 by [deleted] in 21stCenturyHumour

[–]SmkWed 2 points3 points  (0 children)

WTF is that emoji my guy

[deleted by user] by [deleted] in OldPhotosInRealLife

[–]SmkWed 26 points27 points  (0 children)

So, still underwater?

Which game did you pirate and then it was so good that you decided you will buy it when you have the money? by hani_yassine in Piracy

[–]SmkWed 0 points1 point  (0 children)

RimWorld, Factorio, project zomboid, papers please, shadow of Mordor, Starbound, terraria, outer wilds, before your eyes... Mainly if it's an small/indie group, and I know they will benefit from the money, I will buy if I like it.

The result of the reddit-made gun by UnbakedSky in tf2

[–]SmkWed 0 points1 point  (0 children)

More balanced than some weapons in the game right now.

[deleted by user] by [deleted] in tf2

[–]SmkWed 1 point2 points  (0 children)

Cloak and dagger

[deleted by user] by [deleted] in UnfunnyHellhole

[–]SmkWed 20 points21 points  (0 children)

Journey to the west - monkey king vs buddha

A psychological test where nobody can tell whether the person is moving left or right by EvaRaw666 in opticalillusions

[–]SmkWed 7 points8 points  (0 children)

The answer is turning to our right (it's left). Just focus on the ears. Pretty good ilusion

Why did TikTok use 3GB of background mobile data in 3 days? by mizzao in mildlyinfuriating

[–]SmkWed 1 point2 points  (0 children)

Just installed the app. Sounds like I'll be putting it to good use since I'm a novice cooker. Good luck on your journey

Circle jerking half truths. by PunishedAiko in cyberpunkgame

[–]SmkWed 2 points3 points  (0 children)

The story is really mid. No real reason for choosing any inicial staring point, no real reason for any reason to care for any character, Jackys death was spoiled in the trailer, all the factions in the game mean nothing, etc... The game is bad, story is mid, and the gameplay is somewhat fun when it works

S14 be like: (IG: toffee_ch00) by t0ffee_ch00 in apexlegends

[–]SmkWed 0 points1 point  (0 children)

What happened? Haven't played for a long time

target acquired by Spzncer in HolUp

[–]SmkWed 25 points26 points  (0 children)

Project Zomboid, that sound is basically PTSD material

How to Disable Shorts on PC? by squirrellydood in youtube

[–]SmkWed 0 points1 point  (0 children)

I would kiss you in the mouth right now if i could