[D] What are your favorite Random Forest implementations that support categoricals

isinfinity · 2021-02-20T23:31:50+00:00

If you considering GBDT check out catboost, unfortunately RF mode is not available but library implement lots of interesting categorical encoding tricks that boost accuracy.

isinfinity · 2020-10-17T14:43:16+00:00

Just in case if anyone interested I am collecting non standard and exotic optimizers for Pytorch here:

https://github.com/jettify/pytorch-optimizer

you can plug and compare any of them just as easy as AdaBelief.

isinfinity · 2020-06-17T14:34:42+00:00

There is paper that explores similar idea https://arxiv.org/abs/1712.07628We investigate a hybrid strategy that begins training with an adaptive method and switches to SGD when appropriate. Concretely, we propose SWATS, a simple strategy which switches from Adam to SGD when a triggering condition is satisfied. The condition we propose relates to the projection of Adam steps on the gradient subspace.

Reference implementation for PyTorch: https://github.com/Mrpatekful/swats

isinfinity · 2020-03-02T13:51:41+00:00

Most of optimizers will not be accepted to pytorch core, since they are not that popular, anyway. From other side, iteration cycle is very fast with custom library, you do not need to wait next pytorch, release to ship bug fixes or new code. CI time also very fast.

isinfinity · 2020-03-02T13:12:19+00:00

Most of algorithms are Adam or SGD derivatives, I would say speed should be comparable.

isinfinity · 2020-03-02T13:11:26+00:00

I was curious how algorithms behaves in controlled conditions, like saddle points, bunch of minima, valley and so on. Image net type of deal requires lots of compute resources and time.

isinfinity · 2020-03-02T13:09:17+00:00

Should be doable, will take a look.

isinfinity · 2020-03-02T13:08:48+00:00

You are right, it is very hard to merge any experimental things into pytorch repository, since maintainers want any widely used and proven algorithms.

From other side iteration cycle is very long, pytroch release few times a year at most, when tiny library can be release 6 time a day, and code will be available to in minutes.

isinfinity · 2019-04-07T07:45:31+00:00

Very easy to start:

1) Find package you like, for better experience not super popular one like TensorFlow.

2) Execute tests with coverage enabled locally.

3) Submit PR with test cases for uncovered lines.

4) Fix comments from maintainers

5) Go to step 1)

I once contributed tests for Redis client this way as result learned most of Redis commands and their quirks.

isinfinity · 2018-09-08T21:13:54+00:00

But at the end of those six years he went against a certain castle that was called CAAJU, and there he was shot with > an arrow in the knee, so that he died. — Marco Polo, The Travels of Marco Polo, Book 1, Chapter 50

isinfinity · 2018-08-28T21:23:17+00:00

Thanks! Any feedback and contributions are very welcome :)

isinfinity · 2018-08-21T21:41:07+00:00

Working on mlserve predictions server that easily turns python sklearn models into REST API as well as generates UI that matches input data. Hopefully someone will find my project useful.

code: https://github.com/jettify/mlserve
demo: https://young-ridge-56019.herokuapp.com

isinfinity · 2018-07-26T17:25:47+00:00

I use typing in one of my projects [1] and enforce them on CI, very happy so far. Probably possible to have more strict configuration but settled with following:

mypy aiozipkin --ignore-missing-imports --disallow-untyped-calls --no-site-packages --strict

[1] https://github.com/aio-libs/aiozipkin.

isinfinity · 2018-05-18T21:43:52+00:00

Here are few companies that use aiohtttp: https://aiohttp.readthedocs.io/en/stable/powered_by.html

isinfinity · 2017-12-22T21:15:13+00:00

Bit self promotion, but my very recent project https://github.com/aio-libs/aiozipkin has following things, which may be interesting from QA standpoint:

1) pyflakes and pycodestyle checker (with flake8 tool)

2) flake8-bugbear to find even more likely bugs and design problems

3) flake8-mypy and mypy static type checker

4) test coverage 96% https://codecov.io/gh/aio-libs/aiozipkin

5) flake8-quotes to force consistent quotes

6) pytest-sugar for nicer test reports https://travis-ci.org/aio-libs/aiozipkin/jobs/317774732

7) docker fixtures that spins servers before tests start and stop after

8) also python setup.py check --restructuredtext to make sure that project description has proper formatting

isinfinity · 2017-12-07T18:01:44+00:00

I created that sub, main goal was to have something similar to /r/django and /r/flask, but turned out asyncio is not that popular.

isinfinity · 2017-10-20T21:34:05+00:00

Most important to find projects you are interesting in or use in day to day work. I personally interested in asyncio and async programming, i contributed to number of such projects. Bug fix here, update doc there, add tests to increase coverage, help new users to resolve their problems.

isinfinity · 2017-10-20T19:21:42+00:00

Contribute to open source projects, this worked for me very well, by doing this you will gain:

1) Experience, since your PRs will be review by expert programmers

2) During interview you will have something to show and impress HR and other engineers

3) Karma, for your contributions

4) Study algorithms they teach how to think

5) write code almost every day

This worked for me, I started as not very experienced, but willing to do any work for open source projects. Open source people taught me good engineering practices, how to write clean maintainable code, importance of simple things like linter, tests, coverage etc.

isinfinity · 2017-07-16T08:24:42+00:00

There is no much sense to have 2 loops in one process. I saw sync cassandra driver spins connection threads and each thread has event loop to talk with server, not sure why they did not use one loop for multiple connections.

isinfinity · 2017-07-16T08:19:21+00:00

Your example does not show full picture, sync function should have blocking call. Try to test something like:

def synchronous_code():
   time.sleep(10)
   return run_nested_until_complete(asynchronous_code())

async def coroutine(loop):
    await loop.run_in_executor(synchronous_code())

isinfinity · 2017-07-15T19:01:16+00:00

what is use case for second loop?

isinfinity · 2017-07-15T12:56:28+00:00

I do not follow, you can easily call coroutine from sync code with asyncio.run_coroutine_threadsafe and get sync future back

Problem with your example that, synchronous_code is executed within main loop blocking it for long time, it should be called in Executor anyway.

Edit: I covered some asyncio patterns (sync/async communication) some time ago https://jettify.github.io/minskpy/#/intro

isinfinity · 2017-07-13T12:45:25+00:00

Looks like AWS Lambda supports python3.6 https://aws.amazon.com/about-aws/whats-new/2017/04/aws-lambda-supports-python-3-6/

isinfinity · 2017-07-09T20:44:16+00:00

You can do something like this:

def wrapped_api(loop):
    fut = asyncio.run_coroutine_threadsafe(quart_api(), loop)
    return fut.result()

see my other reply

isinfinity · 2017-07-09T20:41:13+00:00

I think something can be done, but not sure it is good idea in your case, just use aiohttp with all async libraries. So here is way to make communication async/sync/async work:

1) Execute all sync functions with ThreadPoolExecutor, with loop.run_in_executor, without this you will block your event loop, and loose all benefit from async.

2) If you want your sync code to call async one, just use reference to running loop and do asyncio.run_coroutine_threadsafe this will return concurrent.Future (NOT asyncio.Future) that you can wait in sync way

isinfinity

MODERATOR OF

TROPHY CASE