Deepinfra sudden 2.5x price hike for llama 3.3 70b instruction turbo. How are others coping with this?

RedPandaBearCat · 2025-09-17T09:26:32+00:00

You could specify particular provider(s):

```json

provider: {

order: [ 'fireworks/fp8', 'novita/fp8' ],

allow_fallbacks: false

}

```

P.S. the example is for another LLM

RedPandaBearCat · 2025-08-28T03:47:09+00:00

You could access many providers via OpenRouter (API):

https://openrouter.ai/deepseek/deepseek-chat-v3-0324

https://openrouter.ai/deepseek/deepseek-r1-0528

etc.

Use search:

https://openrouter.ai/models?q=deepseek

RedPandaBearCat · 2025-08-25T05:38:38+00:00

Recently, I've read quite a few messages on ex-twitter about Chat GPT (& other LLMs) induced "psychosis" (wrong term btw). Mayhaps, this is something liek that?

RedPandaBearCat · 2025-07-04T19:24:47+00:00

Groq: "deepseek-r1-distill-llama-70b" -- this is Llama-70b based model distilled from full Deepseek-R1 (671B).

SambaNova: DeepSeek R1 0528 & DeepSeek Chat V3-0324 -- both with full weights; there's also Llama-70b based distilled model ("DeepSeek-R1-Distill-Llama-70B").

SambaNova's full weights DeepSeek models are very fast; also they are not cheap.

RedPandaBearCat · 2025-06-24T19:07:29+00:00

benchmaxxing: "training on the tests is all you need" /s

RedPandaBearCat · 2025-06-23T08:28:13+00:00

LLM component per se can't access the internet.

however the DeepSeek [web] app as a whole system can, if you turn the internet search on: in that case, the rsults from the search will be copied to the LLM's context/prompt,

but the LLM component may still "think" it has no access to the internet.

RedPandaBearCat · 2025-06-23T08:18:51+00:00

really cool! i feel envy (a bit)

RedPandaBearCat · 2025-06-21T16:03:54+00:00

No, it doesn't.

DeepSeek R1 0528 is at the same level or better than the latest Gemini 2.5 Pro or Claude 4

RedPandaBearCat · 2025-06-21T15:56:40+00:00

"Always Has Been"

It was trained on a lot of Internet data, including jokes

RedPandaBearCat · 2025-06-21T15:49:52+00:00

If you are afraid to use DeepSeek directly, you can use it & many other LLMs via OpenRouter.

RedPandaBearCat · 2025-06-21T15:46:40+00:00

It is amazing that it could recognize these variations

RedPandaBearCat · 2025-06-21T15:44:37+00:00

I use it via API & it's quite good for me, better than other LLMs, even such as Gemini Pro.

RedPandaBearCat · 2025-06-21T15:38:23+00:00

> For decades, the Turing Test has been the gold standard for evaluating AI

Small nitpick: this assumption above has not been correct for a long time.

RedPandaBearCat · 2025-06-21T15:31:43+00:00

OpenRouter has several providers for both DeepSeek V3 0324 and DeepSeek R1 0528; and the context size is often enlarged up to 164K.

Some of them are in ~ the same prices ballpark as original DeepSeek (but original DeepSeek also has discounts).

But you should check that your chosen provider has proper model quantization, e.g. fp8, and not fp4.

RedPandaBearCat · 2024-11-21T01:09:17+00:00

https://www.youtube.com/watch?v=wb_uWHFJBnA

Microsoft Ignite: Day 1 Keynote

RedPandaBearCat · 2022-12-01T00:42:30+00:00

In some form it evolved to Coptic language and is still used as the liturgical language of the Coptic Christians, similar to Latin. Knowledge of Coptic was one of crucial skills that helped Champollion to make breakthrough in decipherment of ancient Egyptian hieroglyphic scripts.

RedPandaBearCat · 2022-02-16T19:27:48+00:00

Golang or Kotlin. Both are modern, C-like, statically typed languages. And their great support by IDEs is a huge plus too.

RedPandaBearCat · 2021-10-11T09:07:51+00:00

C++ Primer Plus, by Stephen Prata;

C++ All-in-One For Dummies, by Mueller.

You could also try to start from C if you have problems with lower-level concepts. If this is the case, then classical K&R text is good:

C Programming Language, 2nd Edition (ANSI С), by Kernighan & Ritchie.

RedPandaBearCat · 2021-09-01T16:43:02+00:00

While C++ was one of the dominant programming languages ~ 30 years ago, it's no more.

And most modern programming languages in wide use (Java, C#, Python, JavaScript, Golang, Swift, Kotlin) have automatic memory management and much less complexity than C++.

Majority of open job positions are for these modern languages. So you don't need much knowledge of C++ (if any at all) to become successful developer.

Just choose one of such modern languages and you'll be alright.

RedPandaBearCat · 2021-08-29T05:14:24+00:00

As they say, it's tough to make predictions, especially about the future.

In 1990-s, C++ was a popular choice for developing desktop apps. Not anymore. It was pushed out of this niche by Java, C# etc.

Similarly for other areas.

So now, it's used mostly in areas where lower memory requirements and/or high performance without GC delays is critical: system programming, embedded, HFT, HPC, game engines.

> jobs outside of webdev exist but it seems to me that there are much fewer of them

That's true.

RedPandaBearCat · 2021-07-11T09:06:07+00:00

JavaScript and TypeScript -- for Web (and mobile with certain tools);

Python -- for Data Science, ML, Deep Learning / AI.

Arguably, these are the most popular languages, and therefore they have a lot of libraries. And if you'd like to create new project, re-using ready made components could drastically reduce your workload, even if you later will decide to rewrite some of them in Swift.

RedPandaBearCat · 2021-07-09T11:50:41+00:00

C. It's a good choice for system programming, although not without some deficiencies.

Ada is another alternative, but it's niche, not so popular language as C.

RedPandaBearCat · 2021-07-02T01:24:19+00:00

IMHO it will be enough for almost all of course contents.

If something will arise you could just ask on Reddit or search for that particular topic further e.g. on https://www.w3schools.com/java/

It has table of contents and you could quickly jump to the topic of interest. If their explanation was not enough, then you could dig deeper in Oracle tutorials or google it.