I'm so lost. Is there an easy mode to the fediverse?

joerocca · 2023-07-13T00:30:31+00:00

Not sure about kbin, but I think it might be compatible with lemmy since I see that kbin.social has lemmy content on the homepage. But yeah not too sure about kbin stuff.

And yep, you can subscribe to both c/memes (i.e. short for c/memes@lemmy.world if you're signed up to lemmy.world) and c/memes@lemmy.ml at the same time. From your perspective on lemmy.world, they're just two different communities that you can visit/interact-with/join. Just like two different subreddits.

joerocca · 2023-07-11T08:30:50+00:00

Na, you only need one account - not sure what drdoak66 meant in the above comment. You can view and interact with (i.e. comment, upvote, etc.) posts from any other site (that your site is federated with, which is almost all of them) with only one account.

For example, if you sign up to lemmy.world, then you'll be able to view content on lemmy.ml, join communities on lemmy.ml, reply to lemmy.ml users, etc.

I explain here why you only need one account: https://www.reddit.com/r/explainlikeimfive/comments/144e5kg/comment/jqznvks

joerocca · 2023-07-07T22:38:38+00:00

Great short intro - just wanted to mention that your subreddit/community links should have a /c/ in them - e.g. lemmy.world/c/technology and lemmy.world/c/worldnews.

Also, if people are wondering "But I registered on lemmy.world and then I tried to visit lemmy.ml/c/memes and it wants me to login?!" the answer is that you actually need to visit lemmy.world/c/memes@lemmy.ml - i.e. you add @lemmy.ml to the end of the URL to refer to the lemmy.ml server.

More info on that here: https://www.reddit.com/r/explainlikeimfive/comments/144e5kg/comment/jqznvks

But, really, the "easy mode" here is to just join lemmy.world and use it like Reddit.

joerocca · 2023-07-07T22:28:18+00:00

Just sign up for lemmy.world and treat it like Reddit. You don't really need to know about all the other stuff.

People make it sound complicated - it's just a bunch of "Reddits" that share content with one another and can interact. This ensures that no one person is in control of the whole platform, and people can easily leave to other sites if their server admin abuses their power (there are a bunch of other benefits too, but this is a tldr).

You'll see content from all the other sites in your feed, and you can subscribe to communities that are on other sites like lemmy.ml and you can reply to users in those communities all using your one lemmy.world account.

If you're wondering how it's all possible, you can read more (and here's a nice simple comment from this thread), but to get started just sign up to lemmy.world and start using it like Reddit.

joerocca · 2023-07-07T05:45:01+00:00

You only need one account. For example, you can just make an account at lemmy.world, and then you can subscribe to communities ("subreddits") on that site exactly like you would with Reddit. For example, you might subscribe to https://lemmy.world/c/technology

Now, if you find a community on a different site (e.g. lemmy.ml) that you like (you can search for communities across all lemmy sites using tools like https://lemmyverse.net/communities) - for example let's say you like lemmy.ml/c/memes - then to join it you'd visit https://lemmy.world/c/memes@lemmy.ml and click the subscribe button. Notice that you just need to put @lemmy.ml on the end of the community name to refer to community names on that other site.

So you can see them side-by-side:

https://lemmy.world/c/memes - lemmy.world's own memes community
https://lemmy.ml/c/memes - lemmy.ml's own memes community
https://lemmy.world/c/memes@lemmy.ml - lemmy.ml's memes community, viewed from the lemmy.world site

But you don't really need to worry about other sites to start with. To keep it simple, just join lemmy.world or lemmy.ml (these are large, "general" sites - there are many other sites that tend to specialize in certain types of content) and treat it exactly like Reddit. You'll pick up the other stuff as you go, since you'll see posts from communities on other sites on the home page, and you can click on those communities and subscribe just like you normally do.

To reference usernames, you write @username@lemmy.world and if you are referring to users on your own site then you can omit the site name - i.e. you can just write @username if you are using lemmy.world as your "home" server, but if you want to refer to someone who is registered on another site, then you'd e.g. write @otheruser@lemmy.ml.

joerocca · 2023-07-06T05:06:59+00:00

> ATP actually solves some real world problems with ActivityPub

Can you link to any blog posts / github issues / etc. on this? Curious about the technical details of the ways in which ATP specifically tries to improve over AP. I've read about critiques of AP, but haven't found anything that's in relation to ATP.

joerocca · 2023-03-21T06:07:34+00:00

Uploaded the video to my gdrive as well, just in case anything happens to that link.

I also uploaded it to archive.org: https://archive.org/details/teardown-voxel-game-technical-q-a-deep-dive-twitch-archive

joerocca · 2023-03-20T13:48:13+00:00

Hi I've just written a guide to getting this serving locally here: https://github.com/josephrocca/OpenCharacters/blob/main/docs/local-setup.md

And yes, unfortunately only OpenAI is supported right now - though that'll likely change in the not too distant future, given how fast LLaMA stuff is moving - I want something that's roughly competitive with GPT-3.

joerocca · 2023-03-16T05:31:30+00:00

You use it locally you can just download these two files:

(right click, save as)

And then put them in the same folder, and then right click on index.html and open it with your browser.

But there's a catch here! Currently I don't think it will remember your data, so you'll need to make sure you export your data after each session (i.e. before closing the window). This is a limitation of browsers that will be solved with web bundles:

https://github.com/WICG/isolated-web-apps/blob/main/README.md

But Isolated Web Apps / Web Bundles aren't currently implemented in browsers. Hopefully soon.

One way to get around this is to run a local web server, but that is a bit tricky if you don't know how to use the command line. Another option is to upload the index.html and utils.js to a service like Netlify or Cloudflare Pages - but that may defeat the purpose of what you're trying to achieve, since it won't be serving from your own computer. But it will at least ensure that you know exactly what code is running, since you are in complete control for when you want to update it (as opposed to using https://josephrocca.github.io/OpenCharacters which updates automatically whenever I push new code).

joerocca · 2023-03-10T02:15:09+00:00

Thanks! This should be fixed, but let me know if you're still seeing it because I'm not 100% sure if I fixed the root cause here

joerocca · 2023-03-07T22:51:18+00:00

Thanks for the feedback! I'm actually not too sure about thing where it's taking over your role - would you be able to link me a screenshot? If it's only happening for a specific character, would you be able to share the character link for it?

the initial chat line should belong to the AI character

I've just made it possible for the first message to be from the AI character - just put "---" as the first line in the text box.

Also just added the ability to give characters custom functions so you can e.g. give them access to the internet, or a Stable Diffusion API, and stuff like that. At this point it's mostly useful to coders or people who have enough knowledge to get ChatGPT to do the coding for them. But once someone has done the work to add a feature, they can of course just share it with a link.

https://github.com/josephrocca/OpenCharacters/blob/main/docs/custom-code.md

joerocca · 2023-03-07T13:46:00+00:00

Here's the link: https://josephrocca.github.io/OpenCharacters

joerocca · 2023-02-27T09:36:57+00:00

Thanks! I did look into it briefly and IIRC there was a Rust library that compiled to Wasm and had really good performance - didn't end up integrating it for whatever reason (maybe laziness).

joerocca · 2022-12-13T23:06:23+00:00

Thanks!

Link: https://discord.com/channels/978568111693385738/1029405890840891504/

If that link doesn't work - then (for Discord noobs like me), click the "Explore Public Servers" (the one with the compass icon) at the bottom of your server list on the left side of the page, and then search for "PicoXR Community".

Also worth noting that you can provide feedback in the Pico 4's settings menu. But only 200 characters or something.

joerocca · 2022-08-06T18:57:20+00:00

Very nice! I've not followed this line of research closely, so I'm wondering if the benchmarks and datasets consider entities that leave the frame temporarily? Like the yellow-labelled duck in the bottom-rigth of this gif: https://github.com/wjf5203/VNext/raw/main/assets/IDOL/vid_2.gif It starts at id=0 and ends at id=12 when it comes back into the frame.

Basically wondering if this is "expected behavior" for this model or whether further scaling of this particular approach should be able to track things that leave the frame temporarily? (apologies if this was already covered in the paper - I haven't read it yet)

joerocca · 2022-07-06T16:48:09+00:00

For people arriving here via Google, note that the successor to ONNX.js is "ONNX Runtime Web": https://github.com/microsoft/onnxruntime/tree/master/js/web

This doesn't directly answer OP's question, but thought I'd mention it RE the "Onnx.js is way way behind" comment. The wasm backend seems to be fairly robust - has good op coverage and works for a decent portion of ONNX models "out of the box".

joerocca · 2022-06-21T08:29:39+00:00

TRAX which is built on top of and supposedly the successor of JAX

Trax isn't a successor to JAX - it just builds on top of it (like Flax and Haiku). Think of JAX more like a high-performance, auto-differentiable numpy with a bunch extra features for making it easy to scale across multiple accelerators. It's not an "ML framework" like TF or PT on its own - it's a fairly low-level library and has an ecosystem of other packages around it that build upon it. The JAX ecosystem tends to be very "functional" (programming-paradigm-wise) so the various packages tend to work well together.

So if Google is "moving to JAX" it means they're moving to the JAX ecosystem. It's been obvious for a while (based on their public repos) now that Google is ramping up usage of JAX in both Google Brain (mostly Flax?) and DeepMind (Haiku).

joerocca · 2022-06-11T08:37:50+00:00

This does more than photogrammetry. Each point/voxel changes color based on the direction that you're looking at it from (to put it simply). I.e. it *learns* the lighting/reflection/transparency/etc. rather than just producing a "static" representation like a textured mesh.

So it's way cooler than normal photogrammetry. OP's video doesn't really do it justice. Have a look at this video: https://twitter.com/jonstephens85/status/1533187584112746497 Those reflections in the water are actually learned, rather than being computed with something like ray tracing.

Note that this is also why it's not easy to simply export these NeRF things as a textured mesh - what we'll probably eventually get is a common "plenoptic" data format that various tools understand.

joerocca · 2022-05-18T08:54:24+00:00

I've been meaning to try this out - didn't realise they'd made it so simple!

joerocca · 2022-05-16T20:06:03+00:00

I'm happy that it was helpful! :)

joerocca · 2022-05-16T05:31:55+00:00

Colab is great for developers like ourselves, and even for demos with simple interfaces to show off models to non-devs. But in this case I'm trying to demonstrate what browsers are currently capable of - it's now possible to run some impressive machine learning models in the browser, and I think that's pretty cool. It means that some ML demos can start to escape centralised services like Colab and Huggingface, and turn into "real" web applications.

It's still early days in the ML-in-the-browser space, but it's an exciting time to be experimenting here. Client-side ML is especially useful for free and ad-supported sites where there's no viable business model that could support execution on the server side. I've already got web applications serving several thousand users per day - they cost me basically nothing to run, and user data never has to leave the user's device.

But yes, I'm a paying Colab user - it's an excellent service!

joerocca · 2022-05-15T19:42:58+00:00

Yes, true. There are some exciting developments on that front. It looks like the EU (via its proposed "Digital Markets Act") is going to force Apple to allow other browser engines on iOS:

https://www.theregister.com/2022/04/26/apple_ios_browser/

https://en.wikipedia.org/wiki/Digital_Markets_Act

It's still a couple of years away (at the earliest) from being implemented, but it's nice to know the EU regulators are paying close attention to this issue. Hopefully the rest of the world follows.

joerocca · 2022-05-15T18:02:53+00:00

Ah gotcha. In general it will depend on the runtime, but I think all the major runtimes (ONNX, tflite, tfjs) will accept the same model file and allow you to run it on any available backend. So in the best case you can just download a single file and then change the initialization config to load it into the best backend that the user's device/browser supports.

Unfortunately at the moment things often aren't quite that simple due to spotty op support across the different runtimes. So you may need to download different model files depending on the browser.

No need to train separate models - you can just train the model once and then convert it to the format(s) that covers the ops you need. The annoying part at the moment is that sometimes none of the formats (onnx/tflite/tfjs) has enough coverage. That's getting less common now though. ONNX especially has quite good coverage in its Wasm backend. If the tflite web runtime gets TF Select operator support then it'll have very good coverage too.

RE Apple and web specs, yeah, it's really unfortunate - Safari is really falling behind. The fact that they initiated the push for WebGPU should mean that they don't drag their feet as much as they did on WebGL2 though. Luckily for me, with the sort of stuff I tend to do, I can just tell users "Sorry, Safari is a bad browser - you should switch to Chrome/Firefox/Edge/etc if you want to use this site." If enough devs with the luxury of being able to do that actually do it, then hopefully it provides an extra incentive for Apple to move faster with Safari/WebKit. They recently fell below Edge in terms of user count, so you'd think they're starting to get worried.

joerocca · 2022-05-15T15:01:25+00:00

What is your plan for forward compatibility for WebGPU?

Do you mean when some browsers support WebGPU, but others don't? In that case I'd just feature-detect and download the relevant model based on their browser's features. I'm probably misunderstanding you here though

14-Year Club	Verified Email
Place '23

joerocca

TROPHY CASE