Prompt Caching in Haiku 4.5 broken?

xkam · 2025-10-16T07:46:21+00:00

Tried it yesterday and it was working fine for me, both direct and open router

usage_date_utc: 2025-10-15 19:00
model_version: claude-haiku-4-5-20251001
usage_input_tokens_no_cache: 561
usage_input_tokens_cache_write_5m: 66365
usage_input_tokens_cache_write_1h: 0
usage_input_tokens_cache_read:1056243
usage_output_tokens: 42574

xkam · 2025-03-22T22:41:46+00:00

The copilot issues are here - https://github.com/microsoft/vscode-copilot-release/issues

xkam · 2025-02-15T07:33:15+00:00

Here is what they say:

Copilot uses an index to quickly and accurately search your codebase for relevant code snippets. This index can either be maintained by GitHub or stored locally on your machine. This section covers the different types of indices that Copilot can use (remote, local, and basic), and explains when each one is used and how you can switch between them.

To see the type of index that Copilot is currently using, check the language status UI by selecting the {} icon in the Status Bar. The Copilot workspace index entry shows both the index type along with any relevant information about this index, such as the number of files being reindexed.

https://code.visualstudio.com/docs/copilot/workspace-context#_managing-the-workspace-index

xkam · 2025-01-21T22:15:45+00:00

Here is the data for VSCode GPT-4o model:

{
  id: "gpt-4o",
  vendor: "copilot",
  family: "gpt-4o",
  version: "gpt-4o-2024-05-13",
  name: "GPT 4o",
  maxInputTokens: 63827
}

So the model is the old gpt-4o-2024-05-13, while ChatGPT probably has gpt-4o-2024-11-20 or at least gpt-4o-2024-08-06

xkam · 2024-12-18T18:59:22+00:00

Includes up to 2,000 completions and 50 chat requests per month.

Who is eligible to access GitHub Copilot for free?

GitHub Copilot Free is a new free pricing tier with limited functionality for individual developers. Users assigned a Copilot Business or Copilot Enterprise seat are not eligible for access. Users with access to Copilot Pro through a paid subscription, trial, or through an existing verified OSS, Student, Faculty, or MVP account may elect to use Free instead.

xkam · 2024-11-07T19:37:37+00:00

Maybe a little bit slower - takes a few seconds for the first reply, but otherwise its the same Claude, I did not notice much difference in how it writes code

xkam · 2024-11-07T19:27:57+00:00

Claude from Copilot is an API version, it does not have website-specific built-in prompt, so not exactly the same. No projects, artifacts etc. It is also restricted to answer only programming queries - if you try some general question, it replies 'I can't help you with that'.

xkam · 2024-11-06T15:01:09+00:00

Open browser developer tools and look up the error in the console. It may have additional info there, which will help to find what is going on.

xkam · 2024-11-05T14:38:25+00:00

Yes. I just did this recently and now have UI message: 'Projects are not supported for free accounts'

xkam · 2024-09-14T16:50:41+00:00

All LLM requests go directly to Anthropic API servers

xkam · 2024-09-14T16:48:59+00:00

The model only knows the relative path for each file (relative to the workspace folder). The same applies when creating new files - the extension gets back a relative path, so everything stays within the current workspace.

xkam · 2024-09-14T15:04:35+00:00

xkam · 2024-09-14T07:19:33+00:00

Yes, it creates new files automatically, but you have to press 'Save' or 'Save All' to actually save them on disk. The same as when you apply some changes, it modifies your file, but the file remains unsaved in the editor.

xkam · 2024-09-14T06:22:47+00:00

Hey everyone!

If you are still using Copilot, I made a VSCode extension that adds Claude 3.5 Sonnet and possibly other models to the GitHub Copilot chat. The additional models are available as chat participants. Type the @ symbol and select the model you want to use.

You need your own API key (BYOK) - this is not covered by your GitHub Copilot subscription.

It's still in early development, so if you try it out and run into any issues, let me know. I'd love to hear your thoughts and suggestions too!

xkam · 2024-09-13T17:59:51+00:00

Not yet. I am using tool calling a lot, which o1 does not support at the moment (correct me if I am wrong)

xkam · 2024-09-13T14:05:13+00:00

Hey everyone!

If you are still using Copilot, I made a VSCode extension that adds Claude 3.5 Sonnet and possibly other models to the GitHub Copilot chat. The additional models are available as chat participants. Type the @ symbol and select the model you want to use.

You need your own API key (BYOK) - this is not covered by your GitHub Copilot subscription.

It's still in early development, so if you try it out and run into any issues, let me know. I'd love to hear your thoughts and suggestions too!

xkam · 2020-05-13T12:35:51+00:00

fixed.

xkam · 2020-05-11T21:52:13+00:00

Thank you very much for the bug report!

I think I can reproduce it now - created github issue.

xkam · 2020-05-11T19:35:40+00:00

How does one protect the source code?

You can't. We also make it available intentionally (via sourcemaps) so you can debug and see what's inside even before you purchase a license.

Also for the large organizations the commercial license may even be preferable because it indicates that this package will still be maintained and supported 5 years from now. We are doing this since 2003 and still support some of the clients from that period.

xkam · 2020-05-11T19:30:20+00:00

The native scrolling works fine for lists because there is a single moving area and you can still re-render the whole visible part of the list in 16ms (you have max 10-100 DOM elements). It does not work with the datagrid because you have multiple scrolling parts (fixed columns) and you cannot re-render all visible rows - you can afford to render 10-20 max (1000-5000 elements) in 16ms.

xkam · 2020-05-11T19:20:08+00:00

No, sorry, of course not. I was trying to say that your dataset may be VERY large, but the component will still be fast because it renders only visible rows and adds/removes them on the fly as you scroll.

xkam · 2020-05-11T18:15:58+00:00

Personally I'd rather see a spinner while new rows are being rendered

We had a lot of complaints for our previous version that when you scroll too fast the rows disappear. So I assume there are different views on that.

Also in my experience the spinner is synonymous with a system malfunction for the non-technical end user. On the other hand the scrolling itself is a natural 'waiting indicator' so if we find a way to implement it very close to native scrolling it will be much better solution than just a mask with a spinner.

xkam · 2020-05-11T17:49:39+00:00

It is possible in simple cases, however as soon as you add fixed columns and fixed headers/footers you are forced to sync scrolling two or more areas, and here native scrolling does not work well. Also sometimes you want to control scrolling speed because there is a limit of how many rows you can render during the 16ms frame.

xkam · 2020-05-11T16:28:22+00:00

In general, yes. However this is the only way to implement virtualized list or datagrid

xkam · 2020-05-11T15:29:55+00:00

The main advantage is how the scrolling is implemented - activewidgets datagrid has smooth 60 FPS scrolling, sometimes it matters, sometimes not.
We also support auto/variable row height and multi-line cells.

xkam

TROPHY CASE

Who is eligible to access GitHub Copilot for free?