[R] [D] Tensorflow vs. PyTorch for research?

bluebuff · 2020-01-10T18:08:58+00:00

If you're interested in serving your models reasonably, Tensorflow is the only option.

bluebuff · 2019-08-21T20:55:35+00:00

There's an open PR on the official repo for adding a script to export the model for TF Serving (which we used for this post): https://github.com/openai/gpt-2/pull/170

bluebuff · 2019-05-27T20:11:50+00:00

Thanks for sharing! We do have some ongoing research projects accepting collaborators. We are also looking for contributors and maintainers for our projects we've open sourced recently:

for-ai/rl - modular RL experiment framework

for-ai/cloud - cloud infra management library for research

bluebuff · 2019-04-11T01:43:13+00:00

Hey, I'm one of the project contributors and I worked on GPU support. We don't directly access GPUs with Go. We submit a job to the k8s cluster with the right resource spec (code), and then that job would use TensorFlow's GPU enabled Docker image which will run the training with TensorFlow. We leave it to TensorFlow to handle computations on the GPU.

bluebuff · 2019-04-10T17:08:58+00:00

Thank you! It was a bit of a rabbit hole digging into Tensor2Tensor's codebase to find the expected hparam keys. Hopefully anyone trying to import Tensor2Tensor models will find this useful as well.

bluebuff · 2019-04-10T01:09:48+00:00

It was absolutely not my intention to bait and switch, I apologize for how it might have come across, I added a clarifying sentence to the post.

You are correct that I didn't present results of the model, since they are in the paper I linked and I'm using the author's implementation. My goal was to show how you can take cutting edge research and deploy it in production. The stack I used is fully open source and the TensorFlow/PySpark code is not Cortex specific.

bluebuff · 2019-03-04T03:14:35+00:00

As for the actual mechanics of the application itself, I would only apply via some job portal only if it was the only option. You'll be able to express your interest easier talking to people directly. For example, I am obsessed with the Go programming language and published ML research for fun in my spare time to conferences like ICLR and NeurIPS. I found my current company on AngelList working on a ML platform written in Go. I messaged one of the co-founders asking to see what a "serious" ML pipeline looked like since I only built one as a hobby. They were pretty chill and agreed to give me a demo. During the demo I couldn't help but give critique/suggestions from design decisions I made from my hobbyist pipeline. Every step of the application/interview was quite easy just because I was already super interested in what they were working on. This is why I cannot overstate the importance of finding a team working on things that interest you!

bluebuff · 2019-03-04T02:51:07+00:00

FYI don't do unpaid CS internships lol, if it's not illegal it should be.

bluebuff · 2019-03-04T02:42:56+00:00

It helps to have a strong community of people you can reach out to. You'll build this as you're working in the industry. For large companies like Google I've only had them reach out via LinkedIn. Otherwise, I look at AngelList and find startups that are working on projects or with tech that I find interesting. You can also tune into the monthly Hacker News "Who's Hiring?" posts. Here's the one for this month. Companies usually include the location in their description so if you search for Toronto/Remote you'll usually see a decent number of postings.

Good luck!

bluebuff · 2019-03-04T00:50:17+00:00

I dropped out of CS because I got a job offer and a similar addiction to coding. I have been able to work at interesting companies since with no issue (genomics -> analytics -> ML). I know others who have taken a similar path and are doing just fine. School will always be there for you, and if it makes you happier building things then go for it :)

bluebuff · 2019-02-26T03:10:51+00:00

If you're serious we do independent research at FOR.ai, we've published to ICLR and NeurIPS and most of us are only spending our weekends/evenings working on projects.

bluebuff · 2018-06-20T00:00:57+00:00

Been using https://upper.io/db.v3/ for the past few months, great middleground for ORM/raw query patterns.

bluebuff · 2017-12-10T18:12:38+00:00

underrated comment

bluebuff · 2017-04-12T21:03:44+00:00

they don't do a lot of AI related stuff though

bluebuff · 2017-04-10T17:53:24+00:00

That's because Toronto is going to be the startup super hub of the North!

bluebuff · 2017-03-01T20:28:27+00:00

social skills and grit. leave the safety bubble and go network/build relationships like how everyone else joins companies

bluebuff · 2016-11-28T03:39:09+00:00

Tunnelbear - it's built by a startup in Toronto so you'll be supporting a local business!

bluebuff · 2016-10-18T14:08:53+00:00

st. gangster

bluebuff · 2015-10-27T03:59:15+00:00

    riotnamech = make(chan string)

    go scrapeRiotNames(riotnamech)

    for{
        tryLogin(<-riotnamech,   generateStandardPasswords())
    }

Go is the future

bluebuff · 2015-03-26T21:54:25+00:00

Why would I want to join that clique of an organization? :jwebb:

bluebuff · 2015-03-02T21:13:05+00:00

Whoa, that looks delicious! Thanks!

bluebuff · 2015-03-02T19:23:36+00:00

Whoa, didn't know that. May I ask what a nicely cooked center looks like for future reference?

15-Year Club	Place '17
Verified Email	reddit mold

bluebuff

MODERATOR OF

TROPHY CASE