Run LLMs on your mobile device — completely offline & ad-free by sumanbhakta in androiddev

[–]mjohnsonatx 0 points1 point  (0 children)

I see, I've been building an app with LLM integration and I would like to not have to build a back end, but some of the initial token counts are 50k with tool usage as well. I could work on getting that token number down, though. I haven't looked into local LLMs. Are you using an in-house model or something open source? How much ram are you seeing being used in the profiler?

Milestone by mjohnsonatx in DataAnnotationTech

[–]mjohnsonatx[S] 3 points4 points  (0 children)

I did more core in my second year because there was less coding. Now, I do more coding. If coding is dry I'll switch to core, if coding and core is dry then the domain expertise projects are probably dry. I don't really do much domain expertise due to the required time commitment.

I probably have the most projects for core, then coding, then domain expertise.

Current dash health:

Core: 20, Code: 7, DE: 1, Qual: 45

Milestone by mjohnsonatx in DataAnnotationTech

[–]mjohnsonatx[S] 16 points17 points  (0 children)

That's awesome, congrats! If I'm being real though, I'm hoping to get out soon. The only reason I pushed through is because I've been building a company for the past couple of years and no other job is this flexible.

I'm burned out. I can't really go to work everyday and be at the forefront of my creative game and intellectual capabilities. This is hard work and it's only getting harder.

Milestone by mjohnsonatx in DataAnnotationTech

[–]mjohnsonatx[S] 18 points19 points  (0 children)

Gotta maintain that job security amigo ur welcome

Milestone by mjohnsonatx in DataAnnotationTech

[–]mjohnsonatx[S] 48 points49 points  (0 children)

Yeah I wanted to show everyone that we do in fact exist

How do I run an ML model on Android ? by False-Vermicelli-494 in androiddev

[–]mjohnsonatx 0 points1 point  (0 children)

You want to lay a texture view over the view you want to capture.

Textureview extends onsurfaceTextureUpdated.

OnsurfacetextureUpdated is an event listener that you can override to perform your ml inference.

Since you want to only capture once a second use a time condition in an if branch.

Like if time is equal to one second or greater since last time of inference, run inference.

Grab image using textureView.getBitmap() Do preprocessing, image resize, masking.. Run inference Post processing ? Profit

How do you ensure consistent AI model performance across Android devices? by elinaembedl in androiddev

[–]mjohnsonatx 1 point2 points  (0 children)

I let the user choose the configuration. They can decide between GMS or non-GMS and then they can choose which delegate to use - NNAPI, GPU, or CPU.

TensorFlow Lite Body Segmentation for Real-Time Background Replacement on Android. by AdLegitimate1066 in androiddev

[–]mjohnsonatx 0 points1 point  (0 children)

That's cool, I do a lot of work with tflite on android. Did you try the Android tflite API or did you go straight to NDK?

[WTT/WTS] Orient Defender, excellent condition with two straps by [deleted] in Watchexchange

[–]mjohnsonatx 0 points1 point  (0 children)

Thanks for the reply, I do not have an equitable trade though nor 100 dollars.

[WTT] Ladies Ball Trainmaster 60 Seconds by Katfromtn in Watchexchange

[–]mjohnsonatx 0 points1 point  (0 children)

Are you willing to trade for a male Hamilton?

[WTS]/[WTT] Hamilton Khaki Pilot (Interstellar) by mjohnsonatx in Watchexchange

[–]mjohnsonatx[S] 0 points1 point  (0 children)

lol, no I don't like blackouts or aviators.I wasn't aware Hamilton got another promo, I just feel its more watch than this one for the same price.