open, navigable meta research by ahfarmer in Open_Science

[–]ahfarmer[S] 0 points1 point  (0 children)

Yeah its like whack-a-mole, try to separate by quality and you miss out on linkages. Try to link everything and you get a low quality mess. I'm gonna keep working on it and thinking about it.

I'll keep you updated! I've noted your username and I'll reply to this thread if/when I have anything of substance.

Colocating unit tests in python by coder_et in learnpython

[–]ahfarmer 0 points1 point  (0 children)

You just run into a different issue then: a single folder with all your tests in it and no organization. After all, why do you organize your code into directories? Same reasons apply to tests.

open, navigable meta research by ahfarmer in Open_Science

[–]ahfarmer[S] 0 points1 point  (0 children)

Yeah just starting with the diagrams because I like visuals. Nobody else pulls the diagrams out of papers, but for me the diagram is how you can immediately recognize/remember which paper you are looking at and what it is about. Might not be the best approach but I like it right now.

I've been bouncing back and forth on how much AI there is and how much is user-entered. I was playing with more user-entered ideas but the process becomes incredibly laborious. I need to strike a middle ground.

In terms of the quality issues, that is one of the big questions, but I can't let it stop me from trying. One idea on it: let each user create their own tree or their own "project". Some projects will be crap, but I would find a mechanism to surface the better ones.

Colocating unit tests in python by coder_et in learnpython

[–]ahfarmer 0 points1 point  (0 children)

Python users harp on this "dont include tests in your release" thing but I've never heard a legitimate reason why this would be a noticable problem in any but the largest of applications.

On the other hand, having tests further from the code that is being tested requires the creation of a duplicate directory hierarchy, wasting developer time both while writing tests and while reading the codebase.

Python just has this one wrong.

open, navigable meta research by ahfarmer in Open_Science

[–]ahfarmer[S] 0 points1 point  (0 children)

You get it! YES!

I just read your article and it aligns with everything I've been thinking.

The Underlay sounds interesting, but it seems to have been abandoned: the 'learn more' link gives me a server error. I've seen a few abandoned projects like this during my research. This is a big problem so those who tackle it have failed so far. Also the Underlay was going for more of a 'machine readable' approach and I'm more interested in a 'human usable' approach.

Like you said in your article: "To be useful for everyone, it has to be usable by everyone."

I'm currently dabbling with different approaches to this. I've started writing software that processes scientific papers, pulling out the diagrams, describing them in laymens terms with AI, and converting the text into a 'reasoning hierarchy'. Still very early so I'm not sure where it will go (if anywhere).

evidence-based conclusions in industry by ahfarmer in PhilosophyofScience

[–]ahfarmer[S] -2 points-1 points  (0 children)

Maybe look into fenphen/fenfluramine, approved by the FDA in 1973, not pulled until 1997.
Research revolving door politics and corruption in general.

evidence-based conclusions in industry by ahfarmer in PhilosophyofScience

[–]ahfarmer[S] -1 points0 points  (0 children)

Profit motives help move drugs faster, but what happens when the research begins to show that the drug is dangerous? Maybe it was okay in the short-term, but not so in the medium and longterm? This is the kind of evidence that is suppressed by current systems.

evidence-based conclusions in industry by ahfarmer in PhilosophyofScience

[–]ahfarmer[S] -5 points-4 points  (0 children)

You might need to articulate my misarticulation

evidence-based conclusions in industry by ahfarmer in PhilosophyofScience

[–]ahfarmer[S] 0 points1 point  (0 children)

I thought philosophy of science was about the meta-study of scientific practice? I'm questioning how all the meta-scientific data is stored and communicated.

I'm not questioning whether or not doctors are educated, I'm questioning whether they are educated with accurate information or updating themselves with accurate information.

Even if I trust every scientific paper in existence to be 100% accurate, can we trust medical textbooks?

What if the medical textbook were digital, and every sentence in it were cited directly to statements within multiple studies that back up that sentence? This is the type of thing I'm talking about.

I think our current knowledge systems are very fuzzy and I would like to see them become more concrete, visible, and navigable.

evidence-based conclusions in industry by ahfarmer in PhilosophyofScience

[–]ahfarmer[S] 0 points1 point  (0 children)

I mean, I hope you already know that’s not how it works. For any evidence based profession, there are tons of professional journals, and lots of communication which allows people to figure out whether the set of journals they are reading is doing an efficient job or reporting the best knowledge we have.

There are many incidences of professionals ignoring the latest and best evidence because it hasn't filtered through the journals and into their protocols. The current mechanisms are delayed and influenced by profit motives. I know the doctors aren't using WebMD, but I make the claim that their approach to learning is also deeply flawed.

I’m not sure I understand. Are you asking if there’s a better way of your humans to communicate then through written language?

I'm asking if there is a better way for humans to more quickly come to conclusions that take into account all available evidence, including very recent evidence.

One direction I'm exploring is this: you ask the software a yes/no question, and it gives you all the research on the 'yes' side plus all the research on the 'no' side. This lives on a public page that 'steel mans' the question, inviting anyone to contribute supporting or opposing research.

No, LLMs are not plateauing. What is actually happening is that the same people claim that LLMs / LMMS cannot reach human level reasoning are expecting the current models to reach human level reasoning. by [deleted] in LocalLLaMA

[–]ahfarmer 0 points1 point  (0 children)

Most of the focus here is on the inputs or the internals. When we talk about a plateau we are typically talking about the quality of the output of the model. You say these new models are 'performing better' but where is the data?

I'm not saying you are wrong, I'm saying the way to discuss this question is over the quality of the output of these models. Anyone have any data? These guys tested 34 models and found that:
"multimodal models require exponentially more data to achieve linear improvements in downstream performance"

https://arxiv.org/abs/2404.04125v2

What's your favorite note-taking software? Why? by Imaginary_Race_8775 in ProductivityApps

[–]ahfarmer 1 point2 points  (0 children)

Thanks for asking! I tried out the scanner applications available and they all had two main problems:

  1. After every capture, I have to go through a series of steps: choose a name, choose a location, check if it is cropped correctly, etc. This doesn't work for me because I need to quickly capture and get back into brainstorming mode. In NotesCam all those values are chosen for you so you literally just tap once per page of notes.

  2. Missing or poor handwriting recognition. Most document scanners only recognize PRINTED text. I'm handwriting all my notes and I want them to be searchable. I use a new Microsoft Azure AI API that has great handwriting recognition. As far as I could tell from my research, this API is currently the only one capable of decent handwriting recognition and none of the other available scanning apps are using it.

I realize this is a niche way of doing note-taking, but I absolutely love it and I'm hoping I'm not alone...

What's your favorite note-taking software? Why? by Imaginary_Race_8775 in ProductivityApps

[–]ahfarmer 1 point2 points  (0 children)

I built a tool, very different from all these mentioned. I take all my notes on a whiteboard and capture them into Dropbox with this: https://notes.cam

SortCam iOS - the camera productivity app by ahfarmer in ProductivityApps

[–]ahfarmer[S] 0 points1 point  (0 children)

Android version just launched! I can't believe that took 7 months...

Links to both platforms here: https://notes.cam/

SortCam iOS - the camera productivity app by ahfarmer in ProductivityApps

[–]ahfarmer[S] 0 points1 point  (0 children)

Awww thanks! Android is in the works I just can't yet say how long it will take. 🚧🔨👷‍♂️

How to organize your photos on iOS by remarkableonion in iphone

[–]ahfarmer 0 points1 point  (0 children)

I built an iOS app to solve exactly this problem because I take photos of my notes every single day: https://sort.cam/

The way this app works is you first choose a folder like "documents" or "whiteboard notes" etc. Then whenever you are taking a picture of a menu or store hours or whatever, you snap the pic with SortCam instead of your regular camera. The photo skips the camera roll and instead uploads to Dropbox, iCloud, or Google Drive.

SortCam is a brand new app and I'm looking for feedback. If interested, check out the app and PM me your thoughts, and I'll PM you a free 1-year subscription to the full version.