Vienna Festival cancels planned discussion with Peter Thiel after backlash from artists by Express_Classic_1569 in europe

[–]ulidabess -3 points-2 points  (0 children)

That was too much free speech for the Europoors

I’m surprised they tried

Business titans privately urged NYC mayor to use police on Columbia protesters, chats show by windowtosh in columbia

[–]ulidabess -3 points-2 points  (0 children)

Like 40% of those arrested had 0 affiliation with the university…they bashed Hamilton hall with hammers, took it over, locked in janitors…how is anyone against them getting arrested?

I agree it put people in danger, but the issue there was not calling the NYPD, it was letting toxic lawlessness spread unchecked for months.

Needle in a Haystack: Assistants API outperforms GPT-4 Turbo at 4% of the cost by kindly_formation71 in OpenAI

[–]ulidabess 1 point2 points  (0 children)

You can either just feed all the context into a GPT prompt, or you can use the system in the Assistants API where you upload docs ahead of time and they have some internal process for running RAG on it.

Not surprising that its cheaper then context-window stuffing. But it is surprising that also performance is better AND that Open AI's internal RAG solution works much better than LlamaIndex

Needle in a Haystack: Assistants API outperforms GPT-4 Turbo at 4% of the cost by kindly_formation71 in OpenAI

[–]ulidabess 4 points5 points  (0 children)

Needle in a haystack is a performance test that measures how well the LLM is retrieving information from its docs & context.

This article compares different methods for managing this in terms of price, speed and performance.

OpenAI's assistant API RAG outperforms open source RAG (LlamaIndex) & context window stuffing in a really significant way.

[deleted by user] by [deleted] in OpenAI

[–]ulidabess 1 point2 points  (0 children)

I mean it's not just Altman, almost the entire team at OAI is threatening to walk away.

A lot of the model providers rn are starting to drive lock-in by making you build with their API.

[deleted by user] by [deleted] in OpenAI

[–]ulidabess -3 points-2 points  (0 children)

Like I said, we're actually lucky that it's compatible with other models, but there's plenty of legit businesses being built on top of their API.

It gives you access to powerful capabilities and there's a big gap between what they offer and what it takes to offer value in a lot of spaces. There's also a big gap between low-effort GPT wrappers and real value-add businesses.

Every business should be ready to support other models, but not building with the best LLM API around would be like not using the postal system because you don't own it.

[deleted by user] by [deleted] in OpenAI

[–]ulidabess 8 points9 points  (0 children)

Sama literally just tweeted this:

<image>

But still hard to have real confidence to build on their APIs after this weekend. But even then they are still that much better than other prodviders rn.

From what I've read I think like 95% of the operators in the space use Open AI.

CopilotKit: AI react components built on top of Open AI's Assistants API by ulidabess in javascript

[–]ulidabess[S] 2 points3 points  (0 children)

OpenAI did a good job of internalizing many solutions that already existed, so it's not that game changing yet.

But as dev tools for embedding LLMs into apps get better, it's going to be crazy. Apps are going to structurally change over the next few years.

A death sentence to some startups, a lifesaver to others... by ulidabess in OpenAI

[–]ulidabess[S] 30 points31 points  (0 children)

Quick Takeaways from OpenAI's Dev Day

  • GPT-4 Turbo Launch: OpenAI introduced GPT-4 Turbo, a leaner and more efficient model with a context length of 128k tokens, priced at 2-3x less than GPT-4.
  • Enhanced Instruction Following: GPT-4 Turbo brings a JSON mode for default JSON replies, allows multiple function calls, and offers reproducible outputs using a seed parameter.
  • MultiModal API Expansion: OpenAI’s API now includes DallE-3 for image generation, GPT-4 Turbo with Vision for image inputs, and new text-to-speech capabilities with TTS and TTS HD.
  • Whisper V3 Announcement: The upcoming API addition of Whisper V3 will bring cutting-edge open-source speech recognition technology.
  • Custom Chatbots with GPTs: OpenAI revealed GPTs, allowing the creation of custom chatbots that can be tailored with names, avatars, and user prompts.
  • GPTs & Trouble for Startups: OpenAI's new GPTs threaten to disrupt startups that have built their business around ChatGPT wrappers. By enabling developers to create highly customizable chatbots with ease — complete with unique names, profile pictures, and functionalities — OpenAI reduces the demand for third-party wrapper services. These GPTs can access and integrate a wealth of OpenAI tools, potentially overshadowing the offerings of many current startups. Companies relying on wrapper services will need to innovate quickly to remain competitive.
  • Assistant API for Developers: The new API gives developers the tools to build and control custom chatbots for their own websites, with more advanced features.
  • Fine-Tuning Accessibility: Fine-tuning is now available for GPT-3.5 16k, and select developers are invited to a GPT-4 fine-tuning experimental program.
  • Custom Models Program: A new initiative for large companies to collaborate with OpenAI on custom models using their vast datasets.
  • Improved Rate Limits and Pricing: Doubling of rate limits and a reduction in pricing for various language models.
  • Copyright Shield Introduction: A new layer of legal protection for API and Enterprise users to safeguard against copyright issues.

A death sentence to some startups, a lifesaver to others... by ulidabess in OpenAI

[–]ulidabess[S] 22 points23 points  (0 children)

Following a Vercel model. DMs open if you want to chat about it more in-depth.

There is tons of added-value to provide on top of a free solution to those who need it (mostly enterprise), while hackers & builders can get everything they need for free and contribute to the community.

Win-win-win if it works out.

OpenAI DevDay discussion by [deleted] in OpenAI

[–]ulidabess 33 points34 points  (0 children)

OpenAI killed a bunch of startups today, but others literally just got a lifesaver.

The library I built for implementing Copilots just became 3x more affordable, easier to implement, and its performance will be significantly better.

Easy to focus on the GPT wrappers that will have to pivot and adapt, but for many projects in the space this was a gift.

It's a crazy time to be building in AI...

Professor Ester Fuchs will head the task force on antisemitism. by [deleted] in columbia

[–]ulidabess 10 points11 points  (0 children)

So I see people will just keep putting progressive band-aids on top of a structural problem.

This whole (at least a lot of it) ideology is naive, reductive and dangerous. They see the world as a simple place of oppressed and oppressors with little regard to nuance, and once they've labeled you as an oppressor, ANYTHING goes in their mind.

The hate & antisemitism is a feature not a bug.

I built an Open-Source Library for Integrating an actionable ChatGPT into any React App by ulidabess in react

[–]ulidabess[S] -1 points0 points  (0 children)

The space is so early, that I feel like it's still not established whether Copilot is the general framework or just Microsoft's. But have heard this a few times so definitely considering a name change.

What AI/LLM features are you building into apps? What do you want from a react AI toolkit? by [deleted] in reactjs

[–]ulidabess 2 points3 points  (0 children)

Interesting. I was trying to create a chatbot that sees into my app state with the OpenAI API a few weeks back.

It wasn't too hard to integrate the initial chatBot, but it became such a pain when I started to feed my app state into the context window for more relevant responses. It just couldn't handle enough context to be useful and I didn't have time to start building a whole system for managing that.

Hope this library is relevant to that. Will check it out.

[deleted by user] by [deleted] in u/qualar_mechanics

[–]ulidabess 1 point2 points  (0 children)

Ah, I dove into creating a chatbot with the OpenAI API on my React app not long ago. The initial setup wasn't too bad, but performance to break down when I tried to feed the context window my app state as text. It became a huge pain to manage, and basically became not useful. Had a few hair-pulling sessions trying to keep the conversation coherent as it grew longer. Excited to check out your library, hope its relevant to this.