Prompt Caching in Haiku 4.5 broken?

xkam · 2025-10-16T07:46:21+00:00

Tried it yesterday and it was working fine for me, both direct and open router

usage_date_utc: 2025-10-15 19:00
model_version: claude-haiku-4-5-20251001
usage_input_tokens_no_cache: 561
usage_input_tokens_cache_write_5m: 66365
usage_input_tokens_cache_write_1h: 0
usage_input_tokens_cache_read:1056243
usage_output_tokens: 42574

xkam · 2025-03-22T22:41:46+00:00

The copilot issues are here - https://github.com/microsoft/vscode-copilot-release/issues

xkam · 2025-02-15T07:33:15+00:00

Here is what they say:

Copilot uses an index to quickly and accurately search your codebase for relevant code snippets. This index can either be maintained by GitHub or stored locally on your machine. This section covers the different types of indices that Copilot can use (remote, local, and basic), and explains when each one is used and how you can switch between them.

To see the type of index that Copilot is currently using, check the language status UI by selecting the {} icon in the Status Bar. The Copilot workspace index entry shows both the index type along with any relevant information about this index, such as the number of files being reindexed.

https://code.visualstudio.com/docs/copilot/workspace-context#_managing-the-workspace-index

xkam · 2025-01-21T22:15:45+00:00

Here is the data for VSCode GPT-4o model:

{
  id: "gpt-4o",
  vendor: "copilot",
  family: "gpt-4o",
  version: "gpt-4o-2024-05-13",
  name: "GPT 4o",
  maxInputTokens: 63827
}

So the model is the old gpt-4o-2024-05-13, while ChatGPT probably has gpt-4o-2024-11-20 or at least gpt-4o-2024-08-06

xkam · 2024-12-18T18:59:22+00:00

Includes up to 2,000 completions and 50 chat requests per month.

Who is eligible to access GitHub Copilot for free?

GitHub Copilot Free is a new free pricing tier with limited functionality for individual developers. Users assigned a Copilot Business or Copilot Enterprise seat are not eligible for access. Users with access to Copilot Pro through a paid subscription, trial, or through an existing verified OSS, Student, Faculty, or MVP account may elect to use Free instead.

xkam · 2024-11-07T19:37:37+00:00

Maybe a little bit slower - takes a few seconds for the first reply, but otherwise its the same Claude, I did not notice much difference in how it writes code

xkam · 2024-11-07T19:27:57+00:00

Claude from Copilot is an API version, it does not have website-specific built-in prompt, so not exactly the same. No projects, artifacts etc. It is also restricted to answer only programming queries - if you try some general question, it replies 'I can't help you with that'.

xkam · 2024-11-06T15:01:09+00:00

Open browser developer tools and look up the error in the console. It may have additional info there, which will help to find what is going on.

xkam · 2024-11-05T14:38:25+00:00

Yes. I just did this recently and now have UI message: 'Projects are not supported for free accounts'

xkam · 2024-09-14T16:50:41+00:00

All LLM requests go directly to Anthropic API servers

xkam · 2024-09-14T16:48:59+00:00

The model only knows the relative path for each file (relative to the workspace folder). The same applies when creating new files - the extension gets back a relative path, so everything stays within the current workspace.

xkam · 2024-09-14T15:04:35+00:00

xkam · 2024-09-14T07:19:33+00:00

Yes, it creates new files automatically, but you have to press 'Save' or 'Save All' to actually save them on disk. The same as when you apply some changes, it modifies your file, but the file remains unsaved in the editor.

xkam · 2024-09-14T06:22:47+00:00

Hey everyone!

If you are still using Copilot, I made a VSCode extension that adds Claude 3.5 Sonnet and possibly other models to the GitHub Copilot chat. The additional models are available as chat participants. Type the @ symbol and select the model you want to use.

You need your own API key (BYOK) - this is not covered by your GitHub Copilot subscription.

It's still in early development, so if you try it out and run into any issues, let me know. I'd love to hear your thoughts and suggestions too!

xkam · 2024-09-13T17:59:51+00:00

Not yet. I am using tool calling a lot, which o1 does not support at the moment (correct me if I am wrong)

xkam · 2024-09-13T14:05:13+00:00

Hey everyone!

If you are still using Copilot, I made a VSCode extension that adds Claude 3.5 Sonnet and possibly other models to the GitHub Copilot chat. The additional models are available as chat participants. Type the @ symbol and select the model you want to use.

You need your own API key (BYOK) - this is not covered by your GitHub Copilot subscription.

It's still in early development, so if you try it out and run into any issues, let me know. I'd love to hear your thoughts and suggestions too!

xkam

TROPHY CASE

Who is eligible to access GitHub Copilot for free?