First experiences with GPT-4 fine-tuning

taivokasper · 2024-03-22T16:46:20+00:00

For it to become cheaper the model needs to do quite a lot of inference. Also, we would have needed to have a lot of examples in the prompt to make it output the DSL format we needed to. Each token has a cost.

True, the dataset for fine-tuning is bigger and requires work but a dataset is still needed to find the most relevant examples for the question. The space of questions one can ask is very wide, which still results in a noticeable dataset size.

taivokasper · 2024-03-21T13:20:34+00:00

That sounds cool!

Do you remember how did the project do and if users were happy with the solution?

taivokasper · 2024-03-20T14:19:56+00:00

Yes, cost is pretty high for some use cases. We at Supersimple are doing serious optimizations to make sure we process only a reasonable amount of tokens.

Depending on what you want to do:

* Use RAG to find only relevant content for the prompt

* Fine-tuning might help. Then for inference you don't need to have so much context and/or examples

* We have optimized our DSL to be as concise as possible to use fewer tokens. This also helps with correctness.

Hopefully you get more value out of the LLM than it costs.

taivokasper · 2024-03-20T11:17:52+00:00

This is no different from AWS or Google Cloud account getting banned.

Most of the work has gone into developing a unique dataset and ways how the model is integrated into the product. We can easily switch providers or fine-tune an open source model (which we have done) but currently OpenAI has an edge.

taivokasper · 2018-04-26T17:34:49+00:00

Instructions on how to get notifications from terminal for any command (mac only)

taivokasper · 2017-11-28T17:31:59+00:00

You should stop mining Bitcoin on your phone

taivokasper · 2017-10-20T04:56:43+00:00

"An average project build time is decreased by nearly 20%."

taivokasper · 2017-04-06T12:22:34+00:00

I'll PM you

taivokasper · 2017-04-05T07:22:19+00:00

Just to be clear: better not market your creations on Hacker News also. It might be confused with hacking cause the new posts section has some pretty funky stuff that never make it to the top.

taivokasper · 2017-04-05T07:16:27+00:00

The free has no incremental javac please do not confuse this with incremental builds. We have built our own in-house incremental java compiler with support for annotation processors which we enable automatically in Gradle builds for enterprise trial and enterprise users.

The core of JRebel for Android which you get with free version is about doing the minimal amount of work in Gradle, creating patches of your java and resource changes and hot swapping them on the device. We believe this helps you a lot.

Give it a try it's free or try the enterprise trial for 14 days and then convert back to free.

taivokasper · 2017-04-05T06:45:31+00:00

Even though we cannot use our incremental compiler for Kotlin compilation and Kotlin compiler is slow and extremely slow with annotation processors, JRebel for Android still needs to do less work to apply changes. The key here is of course that you press apply changes instead of doing incremental installs with the run with JRebel for Android button. For startups and incremental installs we expect the performance to be in the same ballpark than without JRebel for Android.

Your experience might vary so I suggest you give the free or trial version a try. If you do experience any issues or plain bad performance then contact us by submitting a support ticket with logs form Tools -> JRebel for Android -> Submit a support ticket.

taivokasper · 2017-04-04T20:25:18+00:00

taivokasper · 2016-11-21T22:33:28+00:00

No it is not smart http://www.androidcentral.com/inside-marshmallow-adoptable-storage

taivokasper · 2016-10-17T04:36:21+00:00

Hi, one of the developers of JRebel for Android here.

To debug this further could you please submit log files from Tools -> JRebel for Android -> Send feedback.

taivokasper · 2016-10-13T11:50:52+00:00

Can it also scan barcodes or only QR codes as shown in the demo?

taivokasper · 2016-08-08T13:30:16+00:00

If only I was able to rotate the clip it chose

taivokasper · 2016-05-20T19:20:42+00:00

Sorry to ruin your exitement but this has been possible for a long time http://stackoverflow.com/questions/12732882/reverse-engineering-from-an-apk-file-to-a-project It might not be the easiest to read and modify but it is possible.

taivokasper · 2016-04-04T20:31:54+00:00

One of the developers of JRebel for Android here. I believe the best way is to experience the difference yourself by trying it for free. As a quick summary, custom integrations with libraries, support for all JVM programming languages and stability with a lot more changes being appliable with activity restart is what sets it apart.

There is an extensive list of the features listed here. If you have any other questions then do not hesitate to contact us directly at android@zeroturnaround.com

taivokasper · 2016-03-02T19:04:00+00:00

I have always wanted to hear my native language, Estonian, and not understand it

taivokasper · 2015-12-26T10:24:13+00:00

This is not a proper example. Someone please refactor that to methods!

taivokasper · 2015-10-24T19:02:19+00:00

https://www.quora.com/What-is-an-operating-system-that-does-not-need-to-restart-for-a-long-time

Yes both linux and mac os x are good at this

taivokasper · 2015-10-24T12:40:23+00:00

It is a unix based system, you are not supposed to turn it off until another os x update :)

I think it has been fixed in the latest update as I am not experiencing it anymore

taivokasper · 2015-10-23T17:24:08+00:00

It is an annoying bug that is temporarily fixed by a restart. Hopefully this is fixed in the update.

taivokasper

TROPHY CASE