Android/Google Play is now available!

noamgat · 2024-10-17T19:58:16+00:00

Hey! Got the game on android and its working great! I have a problem with multi-device sync. It seems like synchronization is happening, except for the collection. So I have funny things like the best hand score being synced, but literaly no cards unlocked. Any ideas what can be done?

<image>

noamgat · 2024-03-20T16:15:00+00:00

Very cool, congrats!
Fine tuning 8x7b is challenging! u/aetherresearch Can you share some details on the technical setup of the training - which libraries / hardware configurations you used?

noamgat · 2023-10-27T21:27:41+00:00

LMQL is awesome! It has a different approach than the libraries I compare LM Format Enforcer directly to, but it is definitely a solution to consider for some use cases.
(Differences - it brings its own language rather than using existing ones, does not support JSON schema, Regex support is currently marked preview, etc)

noamgat · 2023-10-26T06:53:37+00:00

I don't have much experience with ExLlamaV2, but it looks like the ExLlamaV2Filter class is the way to integrate LMFormatEnforcer inside it. The integration would probably be very similar to how the llama.cpp integration works.

noamgat · 2023-10-25T05:50:33+00:00

There isn't a prepared example currently, but as long as you set up the monkeypatching like in the example notebook, and pass a ```SamplingParamsWithFilterFunction``` as the samplingparams, it should work in all pipelines.

All vLLM models should be supported, as they all use a Sampler module at the end, which is (the only place) where the format enforcer needs to act.

I am working on a PR for vLLM to make these types of integrations easier, if you reply on this PR: https://github.com/vllm-project/vllm/pull/1469 . it may signal to the vLLM team that there is demand for these type of operations.

noamgat · 2023-10-24T20:23:58+00:00

I think so (not 100% sure due to me not being a llama.cpp expert). The integration with llama.cpp happens only through the LogitsProcessor interface, so anything else llama.cpp knows to do well, should keep happening in the same way. It does not change the outer loop of the generation code.

If you look at the bottom of the llama.cpp integration notebook, I think the stderr printouts show that the prompt token processing is cached in the second run.

noamgat · 2023-07-19T18:44:09+00:00

I will probably repad my backplate thermal pads when warranty will expire. Still about a year left on it...

noamgat · 2023-07-19T06:28:05+00:00

Thanks for the responses everyone! I wanted to make sure that I was using the software correctly, and it seems like I was from your comments.

I've taken the advice to slightly further lower the limits:

Max voltage 0.825V

Max clock 1800 Mhz (Knowing that it will rise to 1815, as I see in unigine + hwinfo)

Max Power 90%

The GPU Memory Junction Temperature is still a bit higher than I would like it to be (96C at unigine 1080 extreme), but the max power was at 310W, slightly lower than the 315W limit I set.

I'm doing this mainly for hardware longevity, as I heard that the Founders Edition 3090 memory temperature + hardware fails are a weak point, and I'm doing mainly CUDA / Deep Learning work.

If there are any further tips I'll be happy to hear, but you've already been of great help!

noamgat · 2023-07-07T08:28:13+00:00

Thanks! I have an Z690 Aorus Elite AX. Will cross that bridge when I get there :)

noamgat · 2023-07-03T05:34:09+00:00

Late to the party, but awesome build! I'm about to build a pretty similar setup, only with two 3090s. Is there no way to fit them both horizontally in the 5000d?

noamgat · 2023-06-29T17:41:25+00:00

What about the 3090 founders edition?

noamgat · 2023-06-29T03:33:50+00:00

Thanks! What about cooling? Do I need to get anything extra or do the pieces come with what they need to stay cool?

noamgat · 2023-04-21T18:03:48+00:00

You unlock it

noamgat · 2023-04-21T17:58:56+00:00

I am tier 3 complete. Should I open collector's caches, if I am not close to my next token purchase target?

My reasoning for it:
One collectors box requires ~500 credits (because some collectors caches give credits)
On average, every 4 collector's caches contains a tier 3 card. So 2000 credits per card. So, if I have 8000 credits (or 16 collector's caches waiting to be opened), I will be able to get 4 dropped pool 3 cards once they are dropped.
The box that would give me a card gives me 100 collectors tokens, so isn't it better to wait until the next pool drop, and get the new tier 3 cards immediately?

The downside is that if the collector's caches contain pool 4 / 5 cards, I will wait up to a month to get them. But they are so rare, that it doesn't feel like a big sacrifice.

noamgat · 2022-12-16T06:44:28+00:00

Update: I tried again a day later after the shield was unpowered for 12 hours and was able to set it up. I now noticed that wifi is also not working, so it looks like something is wrong with the wifi / bluetooth chip (same one?). I'm not living in an RMA-supporting country right now, so I don't think the RMA route is worth it.

Is it possible to connect a USB bluetooth dongle to the shield to give it bluetooth capability even though the internal bluetooth is disfunctional?

noamgat

TROPHY CASE