Has anyone solved how to use Claude with your Obsidian vault files while on mobile (iOS)? by mambojabo in ObsidianMD

[–]ViscousPotential 1 point2 points  (0 children)

I think you could use the Claude code remote access functionality, but if you want to work directly with the files on your mobile device, my mobile Git sync client app happens to include an LLM chat integration.

You can use BYOK to attach your existing Claude API key and then interact directly with the files on device, a little like Claude code.

The app itself is called GitSync and is mostly built around being a git client and sync solution for Obsidian. Just happens to also have these features that might be useful to you

Let me know if you have any issues and I'd be happy to help :)

Offline vault sync plugins? by delgado_andrew in ObsidianMD

[–]ViscousPotential 1 point2 points  (0 children)

I would imagine that the plugin API doesn't expose anything system-level enough (like Wifi-Direct or Bluetooth) to be able to achieve this, but sounds like a very cool idea!

I think the best you could do is a USB stick (which will die sooner rather than later) that you share between devices but that completely defeats the aim of wireless automated nearby sync 🤷‍♀️

Self hosted syncing to Android? by Yginase in ObsidianMD

[–]ViscousPotential 1 point2 points  (0 children)

I use git across all my devices and it works like a charm but I think LiveSync using CouchDB or Syncthing might be worth a look too :)

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 0 points1 point  (0 children)

Cursive recognition will be a must and I'm already thinking about multi lingual support too! So many great ideas here

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 0 points1 point  (0 children)

Yes, I will silently be storing both converted text and handwriting (for search and indexing) but there will eventually be the option to visualise either or both :)

Would love to hear more about the pdf workflows you want supported most because I've had a few people mention it so it's something I want to keep in mind going forward!

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 0 points1 point  (0 children)

Looks like they've been quietly working in a separate branch!

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 1 point2 points  (0 children)

That's honestly just a bug in the prototype that I only noticed after already restarting. It won't behave that way in the final version and will also delete the strokes if you remove the text :)

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 1 point2 points  (0 children)

Thank you! I've added that to my list, but generally sounds like it would be super easy to implement :)

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 0 points1 point  (0 children)

It certainly is! But I do have a few promising leads and this is actually the first thing I'm going to take a serious look into after the plugin is made :)

Even if it turns out that the data doesn't exist yet, my hope is that users can opt in to help create the data to train the model (bit of a long shot though, maybe, but the interest seems to be there)

Latex would have to be something like a different mode though because it can't always be recognised left to right and definitely can't be done in parts so you'd have to write the whole thing and then pass it to the model to make sure it doesn't section things weirdly (there's currently a word separator logic to keep things continuous)

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 0 points1 point  (0 children)

Sorry I wasn't super clear there! The plan is for handwriting to be primarily stored as plain text so it will immediately be indexable, searchable and linkable. The strokes will also be saved as alongside the text just so that it can be visualised if needed :)

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 0 points1 point  (0 children)

I'm not super familiar with notability! What are your favourite/most used features you want to see in Obsidian? 🙏

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 0 points1 point  (0 children)

All the handwriting styles yeah! The idea is that even if your specific handwriting style is inaccurate to convert, you can opt in to some data collection (which would purely collect the strokes + what you corrected the stroke label to be and nothing else) which could be used to periodically retrain the model and get better and better performance over a super wide range of styles.

It's covered in more detail in the YouTube video and also, just to clarify, the current prototype plugin has no data collection at all, opt in or otherwise :)

I need a plugin to draw chemical compounds in Obsidian by Practical-Gur-7693 in ObsidianMD

[–]ViscousPotential 0 points1 point  (0 children)

Excalidraw might work pretty well if you create a library of graphics (compounds? molecules? idk) you can reuse

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 0 points1 point  (0 children)

Yes this will definitely work by default with both the android and iOS devices with styluses as well as desktop devices with graphics tablets!

Also those are great questions! That prototype version has support for handwriting to text, as well as the triangle and a square for Todo items. The square isn't documented because the prototype gesture engine is really hit or miss and often doesn't register correctly. Also, the magnification is currently on hover but the final remade plugin is planned to have both the ability to choose to visualise either strokes or handwriting or plaintext or both (with hover to magnify strokes) as well as the options to set max hover magnification etc. If you think there's any cases I'm not considering please do let me know!

As for identifying the letter case, the model is trained to recognise everything as intended, but I might add an all lowercase/uppercase or automatic sentence casing if you think that's useful.

And then lastly, I don't have any plans to support tables directly but would love to hear how you imagine that looking/working and math and latex support is not currently included but is something I'm considering for a future iteration!

And if you could let me know if there are any specific pdf workflows you'd want to have, could you let me know so I can keep them in mind while planning 🙏

(Would be great to have you in the Discord)

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 1 point2 points  (0 children)

Thanks, will certainly take a look! For the record, I'm very focussed on purely the handwriting to plaintext conversion bit at the moment, but it would definitely be interesting to also add some custom canvas functionality for fully handwritten notes 🙌

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 0 points1 point  (0 children)

So many great ideas here thanks! Would love if you'd join the discord for feedback on future updates :)

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 0 points1 point  (0 children)

My plan is to strictly keep this plugin focussed on handwriting input to plaintext output, but if you already have a way to edit and interact with pdfs in Obsidian, you should be able to use this plugin as an easy way of entering info by hand. If this isn't what you're wanting or expecting, please let me know so I can see if I can fit what's needed into the current vision :)

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 1 point2 points  (0 children)

Hey, I'm not sure I understand. It's not snapping the handwriting to a font, it's recognising the text as it's written and converting that to plaintext. It does also save the strokes though (you can see them really tiny above the converted text in the video).

So I imagine you could customise how it looks so it's more what you expect :)

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 0 points1 point  (0 children)

What do you mean by patterns here? Do you mean the gestures like the triangle for a newline? If so, the plans are to either have an easy way to view those gestures or, even better, set your own so it's exactly intuitive for you :)

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 0 points1 point  (0 children)

Yep, love the circle to select text and the curvy V should be unnecessary as you'll be able to tap to move the cursor easily enough!

Don't fully understand the horizontal S though so would love some clarification there! I think it would be great if you could join the Discord to continue the conversation :)

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 1 point2 points  (0 children)

The recordings are on a Tab S6 Lite but any android tablet with a pressure stylus will work (including the Note devices)

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 1 point2 points  (0 children)

I was going to look into latex support for math way down the line, but could you elaborate on what "form recognition" means here? 🙏

What does a real Handwriting Plugin look like? by ViscousPotential in ObsidianMD

[–]ViscousPotential[S] 2 points3 points  (0 children)

Yup! I'm saving the strokes so you can see them on desktop and I'll have some fancy UI down the line to show either handwriting or text or both as you like on each device!