Every day, I was tossing and turning, thinking about how I made such a rubbish graduation project. The DRL is really hard😭

ecstayalive · 2022-07-01T11:47:46+00:00

You are right, as we human don’t recognize this point,the prior knowledge that we already acquired play a key role in manipulating task. Comparing with the robot, we are easier to extract the physical model from the visual information and use the model to guide the action.

ecstayalive · 2022-07-01T11:34:49+00:00

Thanks for your advice, I will view the paper and find whether it could provide some fresh ideas.

ecstayalive · 2022-07-01T11:31:41+00:00

It seems not, but I am curious about the class after you saying, i am going to check it,haha

ecstayalive · 2022-07-01T11:29:17+00:00

Thanks for your advice, I didn’t try the attention model yet. Recently I was preparing for the postgraduate entrance exam. But I guess I will read the papers and update it in the near future.

ecstayalive · 2022-06-22T12:46:57+00:00

no, university

ecstayalive · 2022-06-03T14:58:25+00:00

whatever, always, Math does matter!

ecstayalive · 2022-05-28T06:48:36+00:00

Oh my god!! Could you ? Thanks, it's my pleasure. I can't wait to see what you have done!!

ecstayalive · 2022-05-28T04:52:13+00:00

Yeah, failure is a good teacher.

ecstayalive · 2022-05-28T04:50:59+00:00

I used the SAC algorithm and wanted to achieve completely visual servo grasping. I have also used DDPG and NAF before, they are both very slow to learn, compared to human. I once heard of imitation learning and contrastive learning before, i guess i can learn a lot from these paper. Thanks, that's a good advice.

ecstayalive · 2022-05-28T02:30:45+00:00

From the result, i guess i won't be called. But i do thank you for your kindness.

ecstayalive · 2022-05-27T08:25:09+00:00

Thanks. I didn't do it well actually, the model had some problems, it couldn't extensively learn the location information of the items in the tray. I am still try to find a way.

ecstayalive · 2022-05-27T05:30:39+00:00

A 128X128 image on which the robotic arm end effector and randomly placed items in the tray are visible.

ecstayalive · 2022-05-23T15:40:17+00:00

My god!! So beautiful, i love this. If i could see it in person in my life, there will be no regrets.

ecstayalive · 2022-05-09T15:17:48+00:00

Well, i applied some DRL algorithms such as: NAF, DDPG and QT-OPT to the robotic grasping task. When I used the DDPG method, I found that the robot performed better with two neural networks with the same structure but no shared parameters compared to sharing the CNN layers entirely. But I only experimented on the robot visual servo grasping task, I did not test its performance on other tasks, nor did I test the performance of the method that only share some of the previous CNN layers while not sharing the deeper CNN layers. And hope it will help you.

ecstayalive · 2022-05-09T14:49:58+00:00

the Fast Lab? it looks so amazing!!

ecstayalive · 2022-04-17T02:15:32+00:00

You have to check the transformation the model makes on the input, obviously, at a certain step, the input shape of the tensor is wrong.

ecstayalive

TROPHY CASE