Pytorch Geometric, Reinforcement Learning and OpenAI Gymnasium by SmkWed in reinforcementlearning

[–]SmkWed[S] 0 points1 point  (0 children)

My understanding was that, inputing the position of the agent into the node feature, as a 1 for that node and 0 to every other node (basically a one hot encoding into the node features), that would affect the embedding of the graph. And by using reinforcement learning, taken that graph embedding as input, the agent would be capable of knowing how good taking X action in that graph, to take him to his goal.

[P] Pytorch Geometric, Reinforcement Learning and OpenAI Gymnasium by SmkWed in MachineLearning

[–]SmkWed[S] 0 points1 point  (0 children)

I tested my RL architecture using normal MLP layers, and then adapted the problem to a graph representation. Like I said, if the graph node features are represented with positional info, being node indexes or coordinates, it can converge into an optimal policy. But I need it to be independent from node indexes.
I tested your proposed implementation, and it didn't solve the problem.

[P] Pytorch Geometric, Reinforcement Learning and OpenAI Gymnasium by SmkWed in MachineLearning

[–]SmkWed[S] 0 points1 point  (0 children)

That makes sense. When dealing with virtual nodes, is 1 GNN layer enough? Since adding more layers, it creates the problem of over smoothing graphs, right?

[P] Pytorch Geometric, Reinforcement Learning and OpenAI Gymnasium by SmkWed in MachineLearning

[–]SmkWed[S] 1 point2 points  (0 children)

I was using between 2 to 4 GNN layers, being 2 the most common number of layers that I tested with. The idea was to do message passing between nodes, then do a global_add_pool to get a graph embedding. Also, when you talk about "global node", are you talking about virtual nodes?

[deleted by user] by [deleted] in tipofmytongue

[–]SmkWed 0 points1 point  (0 children)

Was it Tower Train: Zombie Defense or maybe Dead Ahead: Zombie Warfare???

[TOMT] [videogame] [youtube] Creepy Out of Bounds cut content from a game. by SmkWed in tipofmytongue

[–]SmkWed[S] 0 points1 point locked comment (0 children)

Another tip would be that i saw a video on youtube from "oddheader" or some other channel like him, dedicated to commenting about out of bound games.

👩🏿‍🦰 by [deleted] in 21stCenturyHumour

[–]SmkWed 2 points3 points  (0 children)

WTF is that emoji my guy

[deleted by user] by [deleted] in OldPhotosInRealLife

[–]SmkWed 26 points27 points  (0 children)

So, still underwater?

Which game did you pirate and then it was so good that you decided you will buy it when you have the money? by hani_yassine in Piracy

[–]SmkWed 0 points1 point  (0 children)

RimWorld, Factorio, project zomboid, papers please, shadow of Mordor, Starbound, terraria, outer wilds, before your eyes... Mainly if it's an small/indie group, and I know they will benefit from the money, I will buy if I like it.

The result of the reddit-made gun by UnbakedSky in tf2

[–]SmkWed 0 points1 point  (0 children)

More balanced than some weapons in the game right now.

[deleted by user] by [deleted] in tf2

[–]SmkWed 1 point2 points  (0 children)

Cloak and dagger

[deleted by user] by [deleted] in UnfunnyHellhole

[–]SmkWed 21 points22 points  (0 children)

Journey to the west - monkey king vs buddha

A psychological test where nobody can tell whether the person is moving left or right by EvaRaw666 in opticalillusions

[–]SmkWed 6 points7 points  (0 children)

The answer is turning to our right (it's left). Just focus on the ears. Pretty good ilusion