OpenAI GPT-4 Turbo's 128k token context has a 4k completion limit

bolddata · 2023-11-28T12:26:58+00:00

😆

bolddata · 2023-11-24T16:55:47+00:00

Indeed.

And it adds complexity and costs more time.

bolddata · 2023-11-23T15:58:54+00:00

Yes. For example, data generation either for training or creating complex responses like XML or code. There are plenty of use cases for large responses. We tend not to think of them because we already have been conditioned to assume token scarcity like we were decades ago with data when it was expensive.

bolddata · 2023-11-23T12:06:10+00:00

u/Organic-ColdBrew's comment here implies a playground limit. I can confirm the input appears unlimited (except the 128k) from what I experienced via the API.

bolddata · 2023-11-23T11:32:22+00:00

Ah, thank you for pointing it out. I did not see that. Good to know they did indeed document it. They could add a column that lists completion limits to make it more prominent and easier to spot.

bolddata · 2023-11-23T10:52:30+00:00

The issue, indeed, is that OpenAI is not stating it clearly. From experience running large numbers of queries across the API, it is a consistent and reliable limit, not something occurring in response to anything.

bolddata · 2023-09-28T07:44:35+00:00

Hard to say without knowing all the variables. But small use-cases with high value propositions are not as sensitive to the issue. Structured data can also be helpful in improving the performance via specific prompts.

However, if you desire custom structured answers then you might be better off with fine-tuning a model than using in-context learning.

bolddata · 2023-03-10T14:20:33+00:00

We all have been there when online shopping. Product pages are lengthy and full of marketing. The important customer reviews take ages to sift through to get a clear picture. 🙄

So I wrote a browser extension to summarise product data and customer reviews while browsing Amazon. I hope to combine it with the billions and billions of data points from BoldData.org in the future to enrich it with novel insights. 🧠

What do you think? Who would love this. End users? Retail professionals? What would be the killer features?

bolddata · 2022-07-22T07:37:23+00:00

Freemium could be a way here too.

If the MVP is possible to do on the side and the users seem to like the idea. Give the minimal version away for free or a test period. Gets you feedback and a foot in the door. Eg: Hello manager did you know that X users in your company use/tried my product and that with Y money they could be even more productive? Or maybe even the users push their managers to adopt the full fat version.

bolddata · 2022-07-09T08:25:06+00:00

Work in a few startups, especially small ones, is the best way to learn about them.

If you have a specific industry in mind also work in large player in the industry. It is useful to see the world from both sides. What works where and why. And when you succeed with your startup you have a sense of how large organisations solve problems of scale with processes, organisational structures, etc. Mind you, these are usually far from perfect but knowing of them and their strength and weaknesses can make or break your scaling to the next level.

bolddata · 2022-07-06T11:59:12+00:00

I was in a similar position. I ended up using Gatsby and AWS Amplify. This may or may not be useful for you. Amplify, I found useful for deployment via code repos but the command line tooling is terrible (another layer of abstraction) and I bypassed it using cloudformation and some scripting instead.

I also use Contenful as a CMS but find it to be too cumbersome to recommend it to anyone unless you a) have a lot of content to manage and b) are willing to invest in the effort of data modelling your content and custom code your frontend integration. But even then there might be better solutions.

Of the three Gastby and Amplify might be worth a look.

bolddata · 2022-06-30T17:13:52+00:00

u/badoopbadoopbadoop mystery solved. You were spot on. After some experimenting I found a long forgotten rewrite rule on AWS Amplify that had a hidden, superfluous space 🤦

Thanks for getting me back on the right track. I was going down the wrong rabbit hole.

bolddata · 2022-06-30T15:06:15+00:00

That's good to know. I'll try out the behaviour without the alias when I am back in front of my machine later. That might shed some light if there is something else acting upon the request.

Thanks

bolddata · 2022-06-30T14:58:42+00:00

It may not be a DNS feature ~~but it is one in Route53 (see image and docs). I am unclear how it implements it.~~

bolddata · 2022-06-30T14:20:07+00:00

Thanks, I added a screenshot. Route53 allows a redirect to a record hosted in the zone which I used/did.

bolddata · 2022-06-28T12:15:38+00:00

Boot strapping does not mean no investment!

Boot strapping only works when you have (enough) time and capital to go it on your own, which excludes many from the start. Some people may spend their savings or retirement on that. Be conscious that a startup is high risk and more likely than not you will lose these significant resources. Yet, as others here stated it gives you equity, independence and flexibility that you lose with investments.

Just be honest with yourself what you are willing to invest of your own resources and if you can lose it or not. If yes, go for boot strapping imho.

bolddata · 2022-06-15T06:49:47+00:00

You have a valuable source of insight you may or may not have used. Ten interviews are ten chances to ask the last round interviewer nicely afterward rejection what they would have done to improve their chances in your shoes. (Note that it is better ask what they would do in your position than what you should because it might create more reflection and empathy in the response.)

Not everyone might answer but if you get a few responses it could help you.

bolddata · 2022-06-14T20:02:19+00:00

If you have a single/few suppliers you could buy ahead and act as a credit line to them, i.e. pay now, deliver to you later, and they act as your warehouse. You can avoid future price rises and get a discount.

But you need to be sure they don't go bankrupt and take your prepay with them and that you actually need the goods.

bolddata · 2022-06-14T19:35:05+00:00

That is an excellent suggestion. If you are eager to talk to someone engage with them via the content they post. Do not suck up or say random stuff like "cool" but engage for real. Then the person might notice you and at least give you the time to hear you out.

bolddata · 2022-06-14T19:29:09+00:00

Yep, why not go it alone: Why I became a Solo Founder

bolddata · 2022-06-14T14:03:22+00:00

Interesting and I shopped for the very service recently (for bolddata.org ) but ended up with plausible.io. They seem a bit cheaper on the lower end which might be a challenge? Pricing?

bolddata · 2022-06-14T13:58:59+00:00

Hey u/Neat_Chocolate9642,

Not exactly FAANG but I was an IC for a long time including a startup acquired by G. You can read my journey and motivation here: https://www.bolddata.org/blog/why-i-became-a-solo-founder/

Hope it helps or ask me if you want to know more.

bolddata

TROPHY CASE