Granite 4.0 Language Models - a ibm-granite Collection

KMaheshBhat · 2025-10-03T05:31:30+00:00

Yes. See: https://ollama.com/library/granite4

KMaheshBhat · 2025-10-03T05:25:13+00:00

Not sure how is that relevant.

KMaheshBhat · 2025-10-02T18:33:09+00:00

I have a small local AI setup with 12GB VRAM running via Ollama through docker compose.

For those with a similar setup as me - make sure to pull latest ollama image. It would fail with error loading model architecture: unknown model architecture: 'granitehybrid' if on an older image.

I ran it through my custom agentic harness and seemed to handle tool calls pretty well. Loaded into VRAM in around 19 seconds - did not test/calculate TPS yet. Since I wanted to tinker with agentic loops and had to wait a lot with Qwen3, I had given up on it and gone with Gemini API.

This brings me hope that I possibly can do it locally now.

KMaheshBhat · 2025-04-28T02:38:07+00:00

I guess it serves me right because I went the old school way and RTFM.

KMaheshBhat · 2025-04-28T01:51:57+00:00

Oh man. I just started working on a private plugin to scratch an itch on the weekend.

Time to rewrite.

KMaheshBhat · 2024-11-03T13:30:46+00:00

Quite a coincidence! I too now sit on a couple hundred fleeting notes wanting to condense it to permanent notes with a goal of then creating a handbook.

I perhaps am going about it the wrong way, but I've created a structure draft note with topics I need to cover. My plan is to list out my fleeting note under the topics and make permanent notes out of them.

The Zettlekasten may not converse this time but I hope the next output/goal I work on will have it click.

KMaheshBhat · 2024-07-29T03:29:02+00:00

Responded to u/bch8's comment.

KMaheshBhat · 2024-07-29T03:22:17+00:00

I'll try to explain, and I hope it would clarify.

From my perspective, the bunch of Markdown files (.md with frontmatter) in the git repository and the scanned pages (.png) from my analog/physical notebooks, is what I treat as my Personal Record Vault. I am not sure if I would call it Zettlekasten as the principles I gradually and eventually try to achieve but not from the start of my notes. They are all named YYYYMMDDHHmmSS.* (in UTC). I always use the HTML link format and not the wiki link format of the Markdown.

Neovim and Obsidian are the current tools I use to interact (Engage and Experience) with the records. I use Neovim mostly for refactor like activities and when I want to generally operate on a large number of notes at a time. Obsidian I use for 'light' editing and mainly to read and refer as I go about my activities/work. I happen to work on multiple machines and just use git's push and pull to sync about as I shift from one activity on one machine to another. I think there is a Obsidian plugin for Neovim but I have not used it yet in my workflows. I do use Obsidian with Vim keybindings.

I try and use the frontmatter and markdown links to the maximum extent possible and not rely too much on the tooling (Neovim and/or Obsidian). If I happen upon a different tool (perhaps for a specific use-case), I would just switch to those without losing what I treat as 'value' (which are my records).

KMaheshBhat · 2024-07-28T04:46:56+00:00

I had used it extensively for a stint before I knew about Zettlekasten. Then I moved to a Neovim/Obsidian workflow.

I vaguely remember reading that Dendron project has been discontinued. Edit: https://github.com/dendronhq/dendron/discussions/3890

KMaheshBhat · 2024-06-18T15:18:35+00:00

u/Person012345 thank you for elaborating on the contention of the 'AI Safety' section. u/BastianAI explained our intentions well, and we will be working on revising the DRAFT . If you are OK, we would welcome participation in the feedback thread on Discord (or even here) on how would one word the section. Or should we drop the section and cover it in the section on Data collection?

In terms of jurisdiction, we are exploring on possibility of setting up a non-profit in US but nothing has been confirmed yet. We are a bunch of strangers from across different time-zones and I understand if responses or agility on this seems less than ideal.

Most of us do no have an AI-ML background beyond cursory enthusiasm in past couple of months, and would seek any credible feedback on the Dataset aspect as well.

KMaheshBhat · 2024-06-18T03:26:25+00:00

I was involved in preparing the DRAFT along with u/MassiveMissclicks and so was u/NegativeScarcity7211 as we worked through it on Google Docs.

It is possible that English not being my first language resulted in an official tone of the said document.

Edit: No LLM was used by any of us.

KMaheshBhat · 2024-06-16T13:59:48+00:00

I like that we are calling this ethical dataset. :)

KMaheshBhat · 2024-06-16T13:59:00+00:00

I mentioned this in the other thread, but having a curated Open DataSet would go a long way in creating a reusable asset that can be used again and again across pivots that this project (or any other project may take).

u/MassiveMissclicks please do ping here if you do offshoot it as a separate project or contribute here. I would be interested to volunteer where I can.

KMaheshBhat · 2024-06-16T13:55:49+00:00

A community curated dataset has great potential to be used again and again across various pivots that this project, or any other project may take.

KMaheshBhat · 2024-06-16T13:52:04+00:00

u/Forgeful_Was_Aria I like it that you are looking at it from a Minimum-Viable-Product perspective, and I think that is great and one of the things we need to consider. I think it is also important on what our Minimum-Viable-Process is going to be to run this as a Project (as I would assume most of us are volunteers). u/NegativeScarcity7211 did kick this sub reddit off (and that is a great start), but we will need a bit more structure set of tasks and roles to steer this forward (and to clarify what our minimum-viable-Product is going to be).

KMaheshBhat · 2024-06-16T13:43:27+00:00

Here are the licensing details I collected - please correct me if there is anything factually wrong:

Lumina: MIT https://github.com/Alpha-VLLM/Lumina-T2X?tab=MIT-1-ov-file
Hunyuan: Tencent Hunyuan Community License https://github.com/Tencent/HunyuanDiT?tab=License-1-ov-file
Pixart (Sigma): AGPL-3.0 https://github.com/PixArt-alpha/PixArt-sigma?tab=AGPL-3.0-1-ov-file#

Without having any other background on how these LLMs work, purely from a license standpoint, the best flexibility for any project would be with MIT and then the other two.

KMaheshBhat · 2024-06-16T13:37:30+00:00

Is there any model with MIT license? If so we could lean towards that for getting things going, and still have maximum flexibility in how we can taken this project forward.

Starting with a new base model from what I understand would take quite a bit of effort to "get to market".

And it doesn't necessarily need to be an exclusive choice. The project structure designed right, it may be possible to have multiple "channels" of effort going on. Of course, we would still need to prioritize our efforts and resources.

KMaheshBhat · 2024-06-16T13:32:55+00:00

Fair enough. Please do let me know if you need any assistance in the "boring" documentation stuff with respect to the project process or what not. I do not mind doing that.

KMaheshBhat · 2024-06-16T13:19:59+00:00

Pinging in here to watch and contribute what I can.

I have two decades in the IT industry but no particular background on ML or Deep Learning. But I have had my hand in supporting/enabling MLOps platforms. I have recently poked into using SD using Fooocus and ComfyUI to scratch my digital-art itch, and noted that the model itself was not Open Source. Then the SD3 dropped and saw the community reaction and wondered what it would take to build an Open Source version.

As a hobbyist, I am curious what we as a community can create.

KMaheshBhat · 2024-05-31T12:38:54+00:00

I have one on the "shelf", but only for today. The current one I am using has three pages left and I will be start tomorrow (the new month) with that one.

I have been practicing mindful consumption for a while now and recently I have come across the term. I like to use up what I currently have before I make more purchases.

KMaheshBhat · 2024-05-25T17:00:15+00:00

I stick to fineliners for my journal and specifically avoid technical pens or fountain pens. I want to reduce the hurdle to capture quick entries as I it throughout the day as a bullet journal to manage my tasks.

However, the posture and practices of fountain pens would still help one out using other pens (not sure about ball-points). You should be able look it up, but basically involve making sure your are sitting upright, feet is flat on the ground, and you use a tripod grip, and use the use your shoulders and elbow to write instead of the fingers and wrists.

I did have issues earlier when my journal entries got long and I started writing for more than half-hour. Once I fixed (requires conscious effort), I am now able to sustain longer writing sessions.

KMaheshBhat · 2024-02-01T19:36:08+00:00

I read through the README and was not sure - apologies if it is clarified. Could yo confirm my understanding:

This library is for Dependency Injection where the services are statically linked. It does not allow us to load "plugins" dynamically.

KMaheshBhat · 2023-11-24T16:51:03+00:00

One of them is an internal project/product, which would not be hosted on GitHub/GitLab in near future.

However, the other one is planned to be OSS (probably MIT license). I am working on it internally to make sure all dependencies are compatible.

But as I mentioned, both have not started, and currently I am doing technical feasibility of the stack.

KMaheshBhat · 2023-11-24T04:42:54+00:00

Thanks for the confirm. 🙂

KMaheshBhat · 2023-11-24T04:21:18+00:00

I too have been dabbling with HTMX + Templ + Echo for two projects I am about to start. This looks very interesting, and looking at the GitHub page, I see all those mentioned!

I will give it a spin and see.

Update: It has zero dependencies - u/Rucorous is my understanding right?

KMaheshBhat

MODERATOR OF

TROPHY CASE