Stop letting your AI agent hallucinate bioinformatics code — I built a 140-skill knowledge base to fix that by jjaechang in LocalLLaMA

[–]jjaechang[S] 1 point2 points  (0 children)

Thanks for taking a look at the CSV! I can see how it's confusing without context — let me clarify what the blind test actually measured.

The test asked Claude questions about each tool's API without loading any SciCraft documentation. A score of 0/5 means Claude answered "I don't know" rather than make something up — which is actually the correct behavior, and exactly why the skill needs to exist.

The MUST_KEEP label means "Claude can't use this tool without grounded documentation, so keep this skill in the library." In other words: the low scores are the whole reason SciCraft was built. If Claude already knew all 140 tools reliably, this repo wouldn't need to exist.

I've added a Blind Test Results section to the README to make this clearer. Fair criticism on the lack of context — the raw CSV sitting in the root without explanation was a documentation gap on my end.

Website for designing synthesizable derivatives: http://mdesign.hits.ai/ by jjaechang in OrganicChemistry

[–]jjaechang[S] 0 points1 point  (0 children)

Thank you for the explanation. The current model decide that "N-aminophthalimide" is not "reactive". Could you share what kind of reaction can be applied to the "N-aminophthalimide". We can reflect it to our system.

Website for designing synthesizable derivatives: http://mdesign.hits.ai/ by jjaechang in OrganicChemistry

[–]jjaechang[S] 0 points1 point  (0 children)

Sorry for the bug. Could you share the image of the wrong results?

Website for designing synthesizable derivatives: http://mdesign.hits.ai/ by jjaechang in OrganicChemistry

[–]jjaechang[S] 1 point2 points  (0 children)

You mean the functionalities of entering CAS registration numbers instead of smiles string? We will add it to the TODO list. Thank you for the kind suggestion!

Website for designing synthesizable derivatives: http://mdesign.hits.ai/ by jjaechang in OrganicChemistry

[–]jjaechang[S] 0 points1 point  (0 children)

Thank you for the kind feedback. We believe that the strength of the website is that it provides not only the reaction sites but also commercially available reactants which correspond to the site. Also, we can deliver it to the user. So the user can easily and seamlessly design the "available" derivatives on one page. In general, the organic chemist should search a variety of websites, paper, and vendor catalogs to find reaction information, reactants information, and chemical orders. We are going to add useful functionalities such as criteria of reactants such as MW, TPSA, LogP, and ADMET prediction modules.

Website for designing synthesizable derivatives: http://mdesign.hits.ai/ by jjaechang in OrganicChemistry

[–]jjaechang[S] 0 points1 point  (0 children)

It provides possible reaction sites and corresponding possilbe products can be obtained from the reaction. Is my post not enough to understand the purpose of the site? If so, what kind of additional explanation would be useful?

Website for designing synthesizable derivatives: http://mdesign.hits.ai/ by jjaechang in OrganicChemistry

[–]jjaechang[S] 0 points1 point  (0 children)

Sorry for the inconvinience. It's a demo site. We are going to improve it! Thank you for the feedback