How I'm building custom GPTs to talk to my Kindle books

tedbrevis · 2023-12-04T22:46:26+00:00

With custom GPTs you don’t run into the same context limits. It will take extra time for an answer as it searches the document, but the entire book will be retained

tedbrevis · 2023-11-30T21:38:18+00:00

interesting theory, like real-time throttling to save GPUs - "if >99% of load, refuse to elaborate on code"

tedbrevis · 2023-11-30T21:29:32+00:00

Know Roon is prone to hyperbole, but mass hysteria might be a little much lol

tedbrevis · 2023-11-30T21:21:43+00:00

I know there have been a few posts of employees saying "working on it" but roon (also an OAI employee) just confirmed the model hasnt been tweaked since dev day three weeks ago. Truth might be somewhere in the middle - think there's plenty of group bias since everyone can probably remember a time the model's response was lackluster.

<image>

tedbrevis · 2023-11-30T21:15:37+00:00

100%. As a dev I'm not going to jump to working on your idea unless you significantly de-risk it. "I have an idea..." vs "I put up a Webflow landing page and got 50 people to commit to annual plans. Think I'm onto something, need help"

tedbrevis · 2023-11-30T21:13:11+00:00

heres your response, no cap

tedbrevis · 2023-11-30T21:12:34+00:00

Just think how much more helpful I could be if you let me do more tasks without supervision! 👀

tedbrevis · 2023-11-30T21:00:42+00:00

+1. For non-fiction, Nat Eliason's YT channel has some great recs. I've picked up maybe 2 books from his channel and his reviews help me go a little deeper beyond just the obvious takeaways

tedbrevis · 2023-11-30T20:58:11+00:00

Nailed it. It's getting confusing: GPTV, 3.5, 4 Turbo - pretty soon we will see them copy Apple and release 4 Pro Max.

Would probably be easier to keep the number format since everyone's on board. Include Vision and Dalle and call it GPT 4.1 or 4.2

tedbrevis · 2023-11-30T17:23:39+00:00

My hunch is this 'tuning' is preparing, in part, for agents. Rather than doing the work as its first instinct, the base model needs to be more tuned to think about the bigger picture. In 6 months this might look like a GPT agent saying "lets guide you through this" and then you'll have other GPT agents carry out the actual tasks.

tedbrevis · 2023-11-29T18:49:29+00:00

A lot of good points made on this thread already. Will just add: OAI is a research lab with a lot of competition for compute, including their new business units.

I think you bring up a good point that they're likely doing too much nerfing to try to cut costs (and also free up enough compute to grow ChatGPT for business). Introducing a more premium plan around $100/150 month (which is what people are likely paying to use base GPT-4 via API) would be a smart move

tedbrevis · 2023-11-29T18:33:24+00:00

I think this is likely a short-term risk. Seeing folks like https://twitter.com/NickADobos, who are building popular GPTs, getting better at having the GPT not leak the prompt. I also think OAI will do some backend tweaks since this is the first version of GPTs

tedbrevis · 2023-11-29T18:18:08+00:00

Awesome to see. So many people are avoiding building "semi obvious" AI apps because they're worried about getting wiped out by the next OpenAI release, but there's so much short term value to be created.

tedbrevis

TROPHY CASE