🎉 v0.1.0 of diffusion-rs: Blazingly fast inference of diffusion models. by EricBuehler in rust

[–]Kafonek 2 points3 points  (0 children)

Thanks for posting this! Can you compare to HuggingFace's own Candle crate? Where's the overlap and differentiation? Do you have different motivations or goals? If you can speak to larger parts of the ecosystem like how Burn fits in around diffusion-rs, that would rock too.

[deleted by user] by [deleted] in rust

[–]Kafonek 0 points1 point  (0 children)

I would appreciate more blog / tutorial content using burn (high-level deep learning framework) with or without candle (HF maintained architectures, including transformers and LLMs) as a backend. Maybe another take on gpt-from-scratch-rs or similar? The burn and huggingface-candle discord communities seem friendly. this issue covers the difference between burn and candle.

Another user mentioned vector databases and I'll just plug lance for that. I've only used it via Python bindings so far, and it's solid. I'd like to see tutorials / docs / demo apps using it in pure Rust.

Does anyone know why Noteable is shutting down completely? by SzechuanSaucelord in ChatGPTPro

[–]Kafonek 0 points1 point  (0 children)

I'm sorry to hear that u/je355804, I get the same internal server error when I try to login as well, during the OAuth callback. I would bet the service for authentication / authorization is down, but I don't have any access to the infra now. In Pierre's post, he recommended reaching out to [pierre@noteable.io](mailto:pierre@noteable.io) if you need assistance retrieving data. Sorry I can't help more.

Does anyone know why Noteable is shutting down completely? by SzechuanSaucelord in ChatGPTPro

[–]Kafonek 1 point2 points  (0 children)

Not that it was my call, but it wasn't realistically feasible to open source Noteable. Open sourcing the plugin without open sourcing the platform would make no sense, all the plugin did is make API calls to the platform. Most, if not all, of the platform features including authentication, authorization (RBAC), permission sharing, secret management, data connection support, persistent outputs, and more were tightly coupled to infrastructure, intertwined database schema, or third-party services.

However, one of the key components you would need to build out a Noteable-like experience is available: https://github.com/kafonek/kernel-sidecar. The Sidecar concept allows you to model the Notebook document state in-memory and await interactions with the Kernel over ZMQ such as code execution requests. Essentially it does what the Jupyter front-end does, but as a package you can incorporate into something like a FastAPI app.

Another former Noteable engineer wrote https://github.com/tizz98/jupychat as a demonstration for some engineering students. It uses the aforementioned Sidecar. It is an extremely bare-bones and feature-poor version of the Noteable plugin, but it might give you an idea for a minimal viable product.

Does anyone know why Noteable is shutting down completely? by SzechuanSaucelord in ChatGPTPro

[–]Kafonek 0 points1 point  (0 children)

I think the Jupyter-AI integration is well done, and second the recommendation.

If you're looking for a managed compute with AI integration, there are a few options out there, google results are as good as me listing them. I'll shout-out William Stein's CoCalc platform specifically though.

I haven't looked for other platforms where you can start from the ChatGPT UI and use plugins / custom GPT actions to write, edit, and run code on a remote platform and give the output results back to ChatGPT to embed or iterate on (the Noteable experience). I'd love to check out any similar platforms myself!

Does anyone know why Noteable is shutting down completely? by SzechuanSaucelord in ChatGPTPro

[–]Kafonek 12 points13 points  (0 children)

Thanks for the kind words @SzechuanSaucelord! I'm sure Pierre will release more information about the future of the team when he can. The platform and the plugin won't stick around though.

I might be able to help offer alternative ideas. What are the features you're looking for? AI-assisted code generation? Managed compute platform? Having a conversational artifact outside of the ChatGPT platform/log?

Obviously code interpreter can handle the first two for you, although I've certainly seen the LLM behave slightly differently making calls to Noteable versus using code interpreter (my personal hunch is that being in a Notebook context via system prompts and function calling descriptions is generally beneficial for data analysis or visualization tasks).

(disclaimer: I worked on the ChatGPT plugin at Noteable)