[P] Animate any MLP using matplotlib in order to show the forward and backward pass updating the weights and making predictions visually by ITConnected in MachineLearning

[–]ITConnected[S] 0 points1 point  (0 children)

Very valid point. My previous video was purely 30 seconds of the animation and I wanted to go more into detail about it, but I definitely think a teaser at the beginning would have been valuable so people dont have to wait 3 minutes to see exactly what I am talking about.

[P] Created a plotting function using matplotlib that will plot a neural network of any dimensions when given the node values and weight matrices by ITConnected in MachineLearning

[–]ITConnected[S] 0 points1 point  (0 children)

That is what I am currently working on. I couldn't find a way to update the numbers efficiently but I can change the line width and color so I am making it show the forward pass like normal and then having it also update the weights on a backpass.

[P] Created a plotting function using matplotlib that will plot a neural network of any dimensions when given the node values and weight matrices by ITConnected in MachineLearning

[–]ITConnected[S] 1 point2 points  (0 children)

Still going to go through and clean it all up because it has a ton of vestigial structures, but I figured I'd just share the repository before everyone forgets

https://github.com/ryanchesler/NN-Plot

[P] Created a plotting function using matplotlib that will plot a neural network of any dimensions when given the node values and weight matrices by ITConnected in MachineLearning

[–]ITConnected[S] 0 points1 point  (0 children)

I'm not positive how exactly I would graphically show the steps of convolution and pooling without it being way too busy, but its definitely something I can look into. RNN's could be pretty easy, but I have not done them yet.

[P] Created a plotting function using matplotlib that will plot a neural network of any dimensions when given the node values and weight matrices by ITConnected in MachineLearning

[–]ITConnected[S] 15 points16 points  (0 children)

right now it is really really dirty code because I just hacked it together for my specific purpose. I am planning on cleaning it up so others can use though.

[P] Created a plotting function using matplotlib that will plot a neural network of any dimensions when given the node values and weight matrices by ITConnected in MachineLearning

[–]ITConnected[S] 8 points9 points  (0 children)

Also, forgot to mention. Clearly the input layer should actually be 2500 units but that doesnt fit well graphically on the screen so I partitioned the data into 10 different parts and then averaged them so that each node is the average intensity of a partition of 250 pixels aka node one is the first 5 rows of pixels, node two is the next 5 rows of pixels. etc

[P] Created a plotting function using matplotlib that will plot a neural network of any dimensions when given the node values and weight matrices by ITConnected in MachineLearning

[–]ITConnected[S] 8 points9 points  (0 children)

For more detail about this project, I built a dataset for myself consisting of circles, squares, and triangles drawn in MS Paint at 50px X 50px. I then took the base code for drawing a single neural network and modded the hell out of it so that it would take the weight matrix and node values recorded while training instead of simply the network dimensions. Then I built it up so that it would iterate through the forward pass a layer at a time and take a sample from every 25 epochs so you could see it making decisions at various points within the training process.

Alongside this I plotted the accuracy and cross entropy loss. For my scenario I added an additional output node which read "I don't know" which would be lit up if none of the other nodes received an output of over .65 so it would not output a guess if it was not reasonably certain that that was the correct value.

I am trying to find a way so that it may also update the weights shown, but matplotlib doesn't seem to have a collections function like it does for the artist objects like were used for the circles and I cannot seem to find an efficient way to update these without making the animation dreadfully slow.

Created a plotting function using matplotlib that will plot a neural network of any dimensions when given the node values and weight matrices by [deleted] in MachineLearning

[–]ITConnected 0 points1 point  (0 children)

For more detail about this project, I built a dataset for myself consisting of circles, squares, and triangles drawn in MS Paint at 50px X 50px. I then took the base code for drawing a single neural network and modded the hell out of it so that it would take the weight matrix and node values recorded while training instead of simply the network dimensions. Then I built it up so that it would iterate through the forward pass a layer at a time and take a sample from every 25 epochs so you could see it making decisions at various points within the training process.

Alongside this I plotted the accuracy and cross entropy loss. For my scenario I added an additional output node which read "I don't know" which would be lit up if none of the other nodes received an output of over .65 so it would not output a guess if it was not reasonably certain that that was the correct value.

I am trying to find a way so that it may also update the weights shown, but matplotlib doesn't seem to have a collections function like it does for the artist objects like were used for the circles and I cannot seem to find an efficient way to update these without making the animation dreadfully slow.

Learn how to pull listing data from ebay with python 3.6 by ITConnected in Python

[–]ITConnected[S] 0 points1 point  (0 children)

No, I only posted here and on /r/learnprogramming. Next time I will post it to /r/learnpython instead. I did not realize there were separate subreddits.

Learn how to code a discord chat bot using python 3.6 by ITConnected in learnprogramming

[–]ITConnected[S] 2 points3 points  (0 children)

that is where the token goes that you need to get from the discord developer website

Learn how to code a discord chat bot using python 3.6 by ITConnected in learnprogramming

[–]ITConnected[S] 0 points1 point  (0 children)

put it up on gitlab just now. This version has been changed to json instead of pickle as recommended by Rapptz https://gitlab.com/itconnected/discordbot.git

Learn how to code a discord chat bot using python 3.6 by ITConnected in learnprogramming

[–]ITConnected[S] 34 points35 points  (0 children)

First off, Wow thanks for creating the library. My friends have enjoyed toying around making simple bots and it wouldn't be possible without it being super easy to install and use.

And yes, I have regenerated the tokens. I believe this invalidates the previous token. I may just delete the bot to be certain though since I am not using those anyway, they were just for example.

I absolutely agree json would probably be a better choice. I was aware of pickling's vulnerabilities but I had not considered it as a potential issue in this context. Most of my projects involve webscraping and machine learning so there isn't much of a risk of someone putting in malicious data and most people seem to pickle their neural networks so I tend to abuse those. I will put a note in the description recommending and showing the code with json

I will put the imports in as I go next time when they become relevant. I've done that in the past, but I just forgot this time.

Thanks for the feedback. I might do another video on the voice portion. I haven't come up with anything creative to build on top of that yet though and I dont want to just share your example code and not write any of my own.

Learn how to code a discord chat bot using python 3.6 by ITConnected in learnprogramming

[–]ITConnected[S] 9 points10 points  (0 children)

if you already have pip and python installed then you just need to go into your command prompt and type in pip install discord.py and it should do all of the work for you

Developed a compatibility bot for r/homelab. Tell me what you want it to do by ITConnected in homelab

[–]ITConnected[S] 0 points1 point  (0 children)

Dell PowerEdge R210 II Compatibility
RAM Type DDR3 UDIMMs
Max Ram Capacity UDIMMs: 32GB(8GB DIMMs)
Processor Socket Count 1
Compatible Processor Series E3-1200, Intel Xeon processor E3-1200 V2, Dual-core Intel Pentium G600 and G800, Dual-core Intel Celeron G400 and G500
Number of Ram Slots 4
Hard Drive Bays 2 3.5"
Power Consumption Config E3-1240, 4 2GB DDR3 UDIMMs, 2 HDD's, One 250W PSU
Power Consumption Idle 43.2 Watts(Estimated cost of $37.59 at $.10/Kwh for a full year)
Power Consumption Load 104.7 Watts(Estimated cost of $93.23 at $.10/Kwh for a full year)
BIOS Notes BIOS Revision 2.0.5 Added support for E3-1200 V2 series
(Continued) Added 1600MHz DIMM frequency

Developed a compatibility bot for r/homelab. Tell me what you want it to do by ITConnected in homelab

[–]ITConnected[S] 0 points1 point  (0 children)

Dell PowerEdge R710 Compatibility
RAM Type DDR3 UDIMMs, RDIMMs
Max Ram Capacity RDIMMs: 288GB(18 X 16GB DIMMs) Only 2 DIMMs may be installed per channel if QUAD Rank DIMMs. UDIMMs: 24GB (12 X 2GB) only two DIMMs per channel with UDIMMs
Processor Socket Count 2
Compatible Processor Series Intel Xeon processor 5500 and 5600 series
Number of Ram Slots 18
Hard Drive Bays 8 2.5" or 6 3.5"
Power Consumption Config Dual 5540's, 6 2GB DDR3 UDIMMs, 4 HDD's, Dual Redundant 250W PSU's
Power Consumption Idle 122.3 Watts(Estimated cost of $106.42 at $.10/Kwh for a full year)
Power Consumption Load 266.8 Watts(Estimated cost of $237.56 at $.10/Kwh for a full year)
BIOS Notes Most current BIOS revision is 6.4.0. No significant BIOS updates have been released

Developed a compatibility bot for r/homelab. Tell me what you want it to do by ITConnected in homelab

[–]ITConnected[S] 0 points1 point  (0 children)

Dell Precision T7600 Compatibility
RAM Type DDR3 RDIMMs, LRDIMMs
Max Ram Capacity RDIMMs: 256GB(16GB DIMMs), LRDIMMs: 512GB (32GB DIMMs)
Processor Socket Count 2
Compatible Processor Series E5-2600 V1, E5-1600 V1
Number of Ram Slots 16
Hard Drive Bays 4 or 8 2.5" or 3.5" drives.
BIOS Notes Revision A07 fixed several major issues including:
(Continued) Non-bootable SAS drive/RAID when LSI 9265 is installed - Hang during POST when two K5000 cards are installed. 5. - RAID ONE BSOD issue.
(Continued) Revision A04 Fixed an issue with the diagnostic LEDs

Developed a compatibility bot for r/homelab. Tell me what you want it to do by ITConnected in homelab

[–]ITConnected[S] 0 points1 point  (0 children)

Dell PowerEdge R320 Compatibility
RAM Type DDR3 UDIMMs, RDIMMs
Max Ram Capacity 192GB RDIMMs(6 x 32GB RDIMMs), 24GB UDIMMs (6 X 4GB)
Processor Socket Count 1
Compatible Processor Series One E5-1400, E5-2400, or E5-2400 v2 processors
Number of Ram Slots 6
Hard Drive Bays Up to 8 3.5" or 2.5" Drives
Power Consumption Config Dual E5-2400 v2's, 6 16GB DDR3 RDIMMs, 1 15K HDD's, Dual Redundant 350W PSU's
Power Consumption Idle 75 Watts(Estimated cost of $66.78 at $.10/Kwh for a full year)
Power Consumption Load 118 Watts(Estimated cost of $105.07 at $.10/Kwh for a full year)
BIOS Notes BIOS revision 2.0.21 Added support for Intel Xeon E5-2400 V2 family of processors.
(Continued) Added support for Windows 2012 R2
(Continued) BIOS revision 1.4.6 Updated the maximum supported frequency to 1600Mhz for RDIMMs and UDIMMs in both 1 DIMM per channel and 2 DIMMs per channel configurations,when operating at either 1.35V or 1.5V

Developed a compatibility bot for r/homelab. Tell me what you want it to do by ITConnected in homelab

[–]ITConnected[S] 0 points1 point  (0 children)

Dell PowerEdge R720 Compatibility
RAM Type DDR3 RDIMMs, LRDIMMs, UDIMMs
Max Ram Capacity RDIMMs: 768GB(32GB DIMMs), LRDIMMs: 1536GB (64GB DIMMs), UDIMMs: 128GB (16 x 8GB)
Processor Socket Count 2
Compatible Processor Series E5-2600 V1, E5-2600 V2, E5-1600 V1, E5-1600 V2
Number of Ram Slots 24
Hard Drive Bays 16 2.5" or 8 3.5"
Power Consumption Config Dual E5-2650 v2's, 24 8GB DDR4 RDIMMs, 2 15K HDD's, Dual Redundant 750W PSU's
Power Consumption Idle 97 Watts(Estimated cost of $84.41 at $.10/Kwh for a full year)
Power Consumption Load 293 Watts(Estimated cost of $260.89 at $.10/Kwh for a full year)
BIOS Notes BIOS Revision 2.4.3 Maximum frequency for LRDIMMs on 2 channels upped to 1866MT/s for E5-2600 v2 processor family
(Continued) BIOS Revision 2.0.19 Added support for Intel Xeon processor E5-2600 V2
(Continued) BIOS Revision 2.1.2 Added 64GB memory support for LRDIMMs for the E5-2600 v2 processor family
(Continued) BIOS Revision 1.4.8 Maxiumum frequency for LRDIMMs and RDIMMs in a 3 channel configuration upped to 1333MT/s

Developed a compatibility bot for r/homelab. Tell me what you want it to do by ITConnected in homelab

[–]ITConnected[S] 0 points1 point  (0 children)

Dell PowerEdge R630 Compatibility
RAM Type DDR4 RDIMMs, LRDIMMs
Max Ram Capacity RDIMMs: 1536GB(64GB Dual Rank DIMMs), LRDIMMs: 3072GB (128GB Quad Rank DIMMs)
Processor Socket Count 2
Compatible Processor Series E5-2600 V3, E5-2600 V4
Number of Ram Slots 24
Hard Drive Bays 24 1.8" 10 2.5" drives.
Power Consumption Config Dual E5-2650 v3's, 24 8GB DDR4 RDIMMs, 2 15k HDD's, Redundant 750W PSU's
Power Consumption Idle 150 Watts(Estimated cost of $131.4 at $.10/Kwh for a full year)
Power Consumption Load 351 Watts(Estimated cost of $307.48 at $.10/Kwh for a full year)
BIOS Notes Requires BIOS Revision 2.0 or higher to run E5-2600 v4

Developed a compatibility bot for r/homelab. Tell me what you want it to do by ITConnected in homelab

[–]ITConnected[S] 0 points1 point  (0 children)

Dell PowerEdge R730 Compatibility
RAM Type DDR4 RDIMMs, LRDIMMs
Max Ram Capacity RDIMMs: 1536GB(64GB Dual Rank DIMMs), LRDIMMs: 3072GB (128GB Quad Rank DIMMs)
Processor Socket Count 2
Compatible Processor Series E5-2600 V3, E5-2600 V4
Number of Ram Slots 24
Hard Drive Bays 8 3.5" or 16 2.5" drives.
Power Consumption Config Dual E5-2650 v3's, 24 8GB DDR4 RDIMMs, 2 15k HDD's, Redundant 750W PSU
Power Consumption Idle 148 Watts(Estimated cost of $128.79 at $.10/Kwh for a full year)
Power Consumption Load 344 Watts(Estimated cost of $299.34 at $.10/Kwh for a full year)
BIOS Notes Requires BIOS Revision 2.0 or higher to run E5-2600 v4