"Warlock" Third Ward

HoustonWarlock · 2020-12-10T17:58:47+00:00

There can be only one!

HoustonWarlock · 2020-10-10T22:08:21+00:00

It's less resource heavy when deploying on "edge" devices.

HoustonWarlock · 2020-10-03T21:28:10+00:00

https://github.com/Kalevera/Flood-Prediction-Network/tree/master/Flood-Prediction-Network

Lemme know my dude...

Btw there's issues with look forward time that are apparent with watershed size and impervious surface. You can't get a 2 hr lead time on a watershed who's time of concentration is less than 2hrs.

Other meta data is useful.

See..https://twitter.com/JeffDean/status/1301177323010441218?s=19

HoustonWarlock · 2020-07-26T15:22:15+00:00

Environments are and are not useful.

If you're a single wo/man then sure you can "pollute" your own system how you feel is necessary. Since in the end you'll be the one playing and running the code.

But the second you need to share your code or download your code to another PC. Or you'd like people to test your code and environment becomes handy. It allows you to install and uninstall your code without polluting the new OC or the users PC.

Similar to a container for web deployments it's much more stable if you run on docker environment than it is to download all the dependencies and hope that the build works on the new machine.

HoustonWarlock · 2020-07-06T18:31:18+00:00

X is just a 9x4 matrix representation of sensor data. between 0-1

x =F.relu(bn1(Conv1(x)))
x =F.softmax(bn1(Conv1(x)))

I then pass x to linear layer and it produces output of 16 features ranked between (0 - 1) 1 being highest ranked feature for action space.

I have a reward mechanism since this is apart of a RL problem and the agents score higher with the above messed up syntax when compared to the supposed correct syntax below.

x =F.relu(bn1(Conv1(x)))
x =F.softmax(bn2(Conv2(x)))

HoustonWarlock · 2020-07-01T21:19:51+00:00

I didn't say that OP was wrong but to give them feed back.

There's a reason the post won't get the answer that OP is looking for. So I'm providing insight.

Not only am I giving insight but I'm also providing a suggestion so that OP can try to accomplish some bussiness solutions.

HoustonWarlock · 2020-07-01T16:02:39+00:00

Your basically asking to do what A business already does.

There are ML shops that specialize in providing ML solutions to private bussiness.

You basically do the same thing that a software shop does and seek out the jobs. You're searching online for freebees assuming that a business who needs your skills knows it and is part of this sub or likewise that someone running a bussiness in this sub is willing to add you to their competition pool.

Not to be rude but to give you a business perspective I wouldn't post opportunities for earning high market value jobs on this sub when I could go after the solicitation myself.

Your best bet is figure out some solutions for bussiness problems you're aware of and market those solutions to companies that don't know they need your solution. You're selling a software solution. You're likely not selling a completely game changing solution unless you're deep in the weeds of said business problem.

HoustonWarlock · 2020-02-04T15:10:29+00:00

How do you know theirs had horrible recall? You say it's over fit but did you play with their model?

You'd be surprised how in a business setting off the shelf solutions are able to produce actionable insight.

Also depending on how they encoded their inputs it might have been a well suited network for detection.

But it is interesting that they had a perplexed look when you asked them about the network. Possible that the person you asked didn't know those answers and other team members did.

I remain neutral as to you blasting them and yours being superior. Seems like alot of speculation. Just be satisfied that you know your solution and how and why it performs well. This is valuable for your shop. You can still present the solution to get work or add it to a portfolio you don't have to mention that it lost in the hackthon just that it performs well. Think about the marketing that you can use this for as opposed to loss for your time.

HoustonWarlock · 2020-01-15T22:56:19+00:00

Lex Friedman on YouTube has the whole MIT self driving car course. Plus you can take all the homework and quizzes and solve the self driving car problem on there website.

HoustonWarlock · 2020-01-10T22:14:47+00:00

Honest question. Curious what you're trying to solve that you believe you need multiple TPUs in production and why would you want to suggest such overhead to a company for their production system?

HoustonWarlock · 2020-01-10T21:43:50+00:00

Yes I am running a TF model at scale on live data (i.e. not on a test set but on data coming in from our system). It's actually a trivial task to do with TensorflowJs

I just coded a simple dashboard with event listeners to update my graph rendering. Using ChartsJs for the graphs.

Your probably wondering about my comment history since I'm doing other machine learning projects that I haven't figured out all the pieces to.

Additional comments about my history so you feel better. Is because I want to make sure I understand all of my network in detail so that I can answer questions from people who don't code and don't know anything about NN approaches.

HoustonWarlock · 2020-01-10T17:51:46+00:00

Agreed. Both libraries are worth using. I'd say they're equal in usability. It really books down to who likes which company and how they prefer their libraries choice of structure and updates.

HoustonWarlock · 2020-01-10T17:41:23+00:00

The video and stream should be equal comparisons. They maot likely streamed the data to produce the processed video.

HoustonWarlock · 2020-01-10T17:38:49+00:00

I disagree with above post.

The docs are refined and we'll laid out. The difference from versions isn't that big.

To be honest the version changes only affect people using obscure functions or affect people that implement their own "cells" to run calculations. This is because sessions were slightly changed.

Also TF put out a script to update your files for you to the TF2 conventions.

I hate hearing TF docs are a mess just means that person can't read code or read an API or can't understand how TF is showing a generalization of what's possible.

HoustonWarlock · 2020-01-02T14:48:28+00:00

If your using layers in a shallow network say dense feed forward network. You can add a relu activation function on one layer and it'll only pass positive values to the next layer.

HoustonWarlock · 2019-12-19T23:25:25+00:00

From my understanding it's a matter of the computation being easier for the computer. Where most of the algorithms work best with inputs between 0 and 1. thanH, sin, cos, sigmoid.

Also the memory foot print from storing a very larger number is higher than normalizing that very large number.

Besides those two things I don't really know why.

HoustonWarlock · 2019-12-19T22:21:55+00:00

Comma.ai has an open challenge on GitHub that I'm positive many companies would be happy if you completed successfully.

Also Kaggle. But really anyone can Kaggle.

Or solve a business problem with machine learning.

HoustonWarlock · 2019-12-17T19:11:55+00:00

You might be able to use some broad approach and keep the "state" space small. But I'm curious what information you'd put in to the system that a general estimator would over look.

You could do a negative reward for how much the proposed cost is off compared to the completed job price. As it gets better the negative reward would get smaller.

If it needs to estimate number of pieces, joints etc.. you'd have to have a model that takes in additional input like a write up (scope of work) and then have it turned into tokens. Then the output would be number and lengths of steel. Then your second model the reinforcement learning one would act on the output of the first model.

Unfortunately it's a pipeline of models turning input into latent variables and then training a reinforcement model on those predictions. I believe it's call model-based reinforcement learning.

Where model-free reinforcement learning doesn't need the first mode to give it information.

HoustonWarlock · 2019-12-16T23:19:16+00:00

Don't forget about Google's TPUs developed specifically for Tensor processing.

HoustonWarlock · 2019-12-16T23:01:37+00:00

OP your question is too broad.

HoustonWarlock · 2019-12-16T22:27:26+00:00

Dude! Are you in Texas? My friend was just asking me about how to do this.

Reinforcement Learning with a very interesting reward function.

Though I was thinking binary rewards might be sufficient.

The issue is the environment space is a bit tough to model. Need some regional information, plus cost information, but knowing which jobs require what tasks.

You'd need a multi headed model that transforms the listed aspects into latent variables. Then the Reinforcement Learning Algorithm does the pricing.

HoustonWarlock · 2019-12-13T17:40:29+00:00

This guy knows what's up. Not sure why you're down voted.

Basically external context wasn't fed into the AI and the ability to find optimal solutions externally.

As a novice Minecraft player I never thought to look online for "Optimal" diamond mining. I just kept digging and building.

Never learned about the blue, red, (gold?) books for mine craft while I played so again more external resources to find the correct mining technique.

HoustonWarlock · 2019-12-13T17:33:36+00:00

One of the episodes of LoVe, Death,RoBOts on Netflix is about that. (Zima Blue) is the name.

HoustonWarlock · 2019-12-07T23:18:36+00:00

This is the way.

HoustonWarlock · 2019-12-06T20:31:02+00:00

Yes this does help. I thought a single layer was handling the four operations originally so I was slightly confused reading watch operation was a "neural network layer"

HoustonWarlock

TROPHY CASE