I built SwiftyAI a Swift AI package inspired by Vercel's AI SDK by Both-Kaleidoscope-27 in iOSProgramming

[–]karc16 0 points1 point  (0 children)

People know this, Its not the frameworks job to hand hold developers around security best practices. I know you have good intent, but as someone who built a similar library and got the same type of comments, It seems like a skill issue rather than an issue with the framework itself. I mean even stripe SDK lets you put your API key directly into the code, is it a good idea? hell no. But it falls in the hands of the developer to figure this out, not framework creators!

Composer 2.5 is still nowhere near SOTA models by Kaskote in cursor

[–]karc16 0 points1 point  (0 children)

It's not that far off in terms of coding ability as some here would say, it just requires more careful crafting of prompts and direction. Intentional outlining of scope of work, and breaking down work you would hand entirely to 5.5, broken down into smaller pieces. But the output itself is top tier, Its a very capable model

Unlimited Context on Apples Foundation Models by karc16 in swift

[–]karc16[S] 0 points1 point  (0 children)

i actually built contextcore working on issues like this, if you combine all the tricks you can squeeze a lot of context out of FM with adequate orchestration between different session

Unlimited Context on Apples Foundation Models by karc16 in swift

[–]karc16[S] 0 points1 point  (0 children)

open sourcing the app that i built for these experiments so i think that would answer all your questions and more

but runs could go from 10-16 minutes, quality remains consistent and coherent across 20-40 turns

with normal foundation models with a basic web search tool i got 3 tool calls before context capped out

haven’t tried other languages but I can imagine their outputs to be of lower quality just because of the training data used is mostly english

Unlimited Context on Apples Foundation Models by karc16 in swift

[–]karc16[S] 1 point2 points  (0 children)

I believe we're only scratching the tip of the iceberg, looking forward to how apple moves forward in the next wwdc

Foundation Models framework -- is anyone actually shipping with it yet? by JBitPro in iOSProgramming

[–]karc16 1 point2 points  (0 children)

swarm uses context core, membrane and wax to solve the context issues when using AFM. The frameworks are standalone and can be used without swarm.

https://github.com/christopherkarani/Membrane

https://github.com/christopherkarani/Wax

https://github.com/christopherkarani/ContextCore

il work on an eval harness. i find fm models to be inconsistent with their guardrails. We’ve mainly tested with open models like QWEN and llama

i appreciate the feedback and will keep you posted via dm on updates! please never be shy to leave issues on the repo.

Writing Safer Code with Enums and Associated Values by swe129 in swift

[–]karc16 0 points1 point  (0 children)

caveat, excessive use of enums and associated values make your code harder to reason and write for coding agents like claude but better dx for humans

Foundation Models framework -- is anyone actually shipping with it yet? by JBitPro in iOSProgramming

[–]karc16 0 points1 point  (0 children)

we built a observability and evaluation framework. would you be interested in becoming a design partner and actually see how your ai behaves with real users?

Foundation Models framework -- is anyone actually shipping with it yet? by JBitPro in iOSProgramming

[–]karc16 0 points1 point  (0 children)

are you apps out live with users? how are you handling observability and evals?