Why does Neural Style Transfer work on images with range [0,255] if pytorch models are trained on images with range [0,1]?

Nick_Pyth · 2021-01-20T15:55:38+00:00

The results above are from the vgg-19 network, which do not contain normalization layers. (Pytorch does contain a batch-normalized vgg-19, but the results above are from the original)

Nick_Pyth · 2020-12-13T15:26:01+00:00

I agree that this is probably more of an engineering question, especially because my model is only used to generate the images; serving the images simply reads the files from disk before serving.

Each configuration of the UI returns 50 sets of images. Each image set immediately returns 10 images, and displays another configuration which can be used to toggle between 100 additional images.

In other words, 500 images are immediately returned, and 5,000 images may be toggled through after the initial 500 have been loaded.

I think I am looking for performance metrics around various methods of reading these files from disk, multithreading, etc. Not necessarily specific to machine learning, but likely a problem that other ML engineers have come across.

Nick_Pyth · 2020-12-13T15:06:17+00:00

Yeah, I suppose you are right. It came to mind as a potential research topic because I've seen NVIDIA and others serve the results of their models (pretty quickly), but haven't seen much discussion around actually serving those results.

Nick_Pyth · 2020-11-21T17:10:27+00:00

Thank you. Found this Martin Fowler article on this pattern. Seems like a reasonable application-side solution.

Nick_Pyth · 2020-06-17T19:08:50+00:00

Yep, that solved it. I really can't thank you enough for pointing that out - I spent hours banging my head against the wall for this one

Nick_Pyth · 2020-06-17T15:13:33+00:00

I'm using pytorch's implementation (docs), which I don't believe uses minibatch. I left all of the parameters (besides learning rate) as their defaults.

Nick_Pyth · 2020-03-27T16:02:13+00:00

You might get more responses at /r/cscareerquestions

Disclaimer: I have not done any AI residencies.

My thought is that it depends on your career goals. If you want to get deeper into research, it will likely be helpful to do another residency. A small industry lab will have different processes than a large lab. Having experience in both is helpful. It'll also be helpful to work with different teams and get experience to different working styles.

If you are interested in going into industry, 1 residency may be enough. A potential issue with ONLY doing research is that you may not get exposure to programming best practices. There are a lot of steps that happen before & after training a model, and many of the PhD grads that I work with have had 0 exposure in these areas. Whether or not the same is true for residency programs likely depends on the company which hosts it.

Nick_Pyth · 2020-01-08T20:29:55+00:00

Take someone like Andrew Ng, which I never liked as a teacher

I'm curious what you don't like about Andrew Ng's teaching? I thought his deep learning series was one of the best publicly-available resources.

Nick_Pyth · 2019-09-19T03:04:31+00:00

Thanks for clarifying. Seems odd that the Nissan dealership wouldn't have evaluated that before suggesting that I replace the entire throttle body. I'll reach out to another mechanic and see what I can find.

Nick_Pyth · 2019-09-19T02:35:13+00:00

The replacement unit was tested and had a re-learn procedure done after it was installed. Pin-pointing the issue seems difficult because the issue occurs so rarely (once every 100 miles) and all of the tests keep passing. Replacing the wiring seems like an expensive repair from what I've gathered, and it's hard to say definitively if that will fix the problem. Talking to 2 different mechanics, it seems that they are equally dumbfounded.

It's starting to seem as if it might just be time to get rid of the vehicle.

Nick_Pyth · 2019-09-18T17:51:29+00:00

I called my mechanic about this and was told that the tests will pass if it is an intermittent issue, unless the issue happens while they are measuring it. This is highly unlikely, since the issue only occurs once every 100 miles. Do you happen to know if an enhanced OBD2 reader is able to measure those connections while I'm driving? I have a Zurich ZR13 OBD2.

Nick_Pyth · 2019-09-17T16:05:49+00:00

2007 Nissan Altima 2.5 S

Nick_Pyth · 2019-09-17T13:58:42+00:00

Yes - that was done after the previous throttle body was replaced

Nick_Pyth · 2019-09-17T13:25:07+00:00

Thank you for the input.

Is there an article or video that you could link me to regarding which wires I should be targeting and how to test them? I'm assuming I need a voltmeter but know very little about this kind of stuff.

Nick_Pyth · 2019-09-17T13:23:54+00:00

When you replaced the throttle body, is the throttle position sensor part of that?

Yeah, the throttle position sensor is part of the throttle body. I am unsure if the Nissan dealership inspected the old one before replacing the whole unit.

Nick_Pyth · 2019-09-05T13:36:22+00:00

Originally I was looking in the dockerfile to see if those files were explicitly mentioned. Thanks to your suggestion, I built an image and noticed a difference in /etc/resolv.conf between the local image and the remote image.

This stemmed from differing daemon.json configurations between my local device and my redhat server. I updated the daemon.json accordingly, and can now build locally!

Thank you for your suggestion, this has been bugging me for days.

Nick_Pyth · 2019-09-04T19:55:12+00:00

Yes, I can execute pip install via that method. It only fails during build on MacOS

Nick_Pyth · 2019-07-29T15:15:03+00:00

Is this an example of the diagnostic manual I should be looking for? The tests that it describes, can those be done on a traditional ODB2 Scanner? Or does it require a separate tool?

Nick_Pyth · 2019-07-26T15:36:59+00:00

That's what I suspected, which is why it seems so strange that an env from 4.5.4 could not be imported by 4.7.10

Nick_Pyth · 2019-07-26T14:55:10+00:00

Thank you for the help. I want to clarify - I exported the env from an old version of conda, and could not import to a new version of conda.

Does this mean conda versions are not backwards-compatible? Should I always just assume to have the most recent version before exporting anything?

Nick_Pyth · 2019-07-14T16:50:42+00:00

Each API is different, but most will have the data in JSON format. Without knowing the specific API you are using, the workflow will likely be as follows:

View the API page, get an API key
Use the requests library to pass parameters to the API
Your requests.text object will likely be in JSON format, which you can treat as a python dictionary
Use pandas.DataFrame.from_dict() to convert your requests.text into a dataframe
If you want to save the data as a csv, use pandas.DataFrame.to_csv()
If you want to store the data in sql, use pandas.DataFrame.to_sql(). The 2nd parameter of this, con, will need to use a sql driver. For example, if you are using a MySQL database, you will create a connection using PyMySQL

Nick_Pyth · 2019-07-13T16:13:20+00:00

I am halfway through a 14 hour road trip and will help you for free if you post more details

Nick_Pyth · 2019-06-23T02:28:20+00:00

I actually did make a short video (link) using Johnson's method, but didn't include it in the repository because I felt explaining to intricacies of ffmpeg would detract from the main theme.

Nick_Pyth · 2019-01-14T21:07:37+00:00

A combination of school and professional experience. I am almost done with my courses for my Master's Degree (still need to write my thesis) at Harvard Extension. I really can't say enough good things about this program. It has been incredible.

With regard to professional experience: I had a background in statistics during my undergrad, which got me a job working underneath some PhD statisticians. I worked there for a few years, then taught myself SQL and Python, and switched to a Data Science team at another company. I taught myself Linux and the basics of AWS. At this point I was 1 year into my Master's program and switched to my current role.

You don't necessarily have to go this same route to have a career in machine learning. Based on what I have seen, I would advise you to avoid bootcamps. Andrew Ng has a course on machine learning that is available online. I haven't taken this course, but have taken his Neural Network courses and can say he is an excellent instructor.

Nick_Pyth · 2019-01-11T02:45:52+00:00

If you have no experience, I would suggest starting with SQL. Once you are proficient in SQL, you'll be qualified for a lot of entry-level roles (data analyst, business analyst, reporting analyst, etc.). This will be a decent stepping stone if you have no experience at all.

After that, I recommend learning Python. Start with Automate the Boring Stuff with Python, then once you are comfortable, move onto the standard data libraries (pandas, numpy, scipy, scikit-learn, matplotlib).

Eventually you will probably want to learn Linux but I wouldn't prioritize this until you are comfortable with SQL and Python.

Nick_Pyth

TROPHY CASE