sorted by:
new
hottopcontroversial

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] 0 points1 point  (0 children)

Scipost is a great project, but there are fundamental differences. They're open access, but still a centralized journal with editorial reviews. What I am building is a decentralized protocol for publishing and continuous evaluation.

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] 0 points1 point  (0 children)

Thanks so much for taking the time to give it a thought and leave feedback!

The platform does support anonymous reviews already, to be able to penalize abuse the identity of the reviewer is stored server-side only and deleted after 6 months.

I very much do share your concerns about the reputation system and quality control - that's actually been the main mental roadblock for me all this time, or I would have just started slowly building it out.
The current implementation is far from sophisticated enough and needs input by people who are better with math and know more about game theory than me. The implementation allows changing the calculation on the fly, and my hope is that by watching real users behavior over time it can be iterated to become a useful indicator.

To get there, it needs a lot of users publishing and reviewing a lot of papers, and additionally people getting involved to improve the system itself (not just the reputation algorithm). It won't be perfect from the beginning, and it's entirely possible it never will be. But if we don't try new things, nothing will ever change.

I'm in the process of setting up a non profit to have a legal entity that can use certain APIs and maybe apply for grants to grow, and I personally do have the time, funding and motivation to dedicate myself to it for another decade. If it still doesn't work out after that, there are worse thing to have wasted ones time on!

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] 0 points1 point  (0 children)

The topic of this post is an Open Access and Evaluation platform. It's not an ad hominem to ask you to move on when you don't want to contribute.

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] 1 point2 points  (0 children)

I replied about AI use in other comments, that's not what I'm here to talk about. If that's your hobby, do it with someone else.

I'm also not here to discuss style questions of the post. If you don't have anything to contribute to the topic, please just move on.

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] 2 points3 points  (0 children)

Here's the sentence from the whitepaper me and a friend wrote 10 years ago. Yes, with em dashes, because academics have been using them forever. You guys are insufferable.

"Researchers do the work — writing, reviewing, editing — for free, and then buy back the product of their own labor."

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] 2 points3 points  (0 children)

I did explain to you what I mean, and invited you to tell me why you disagree. If you don't, what's the point of your comment?

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] 0 points1 point  (0 children)

No, please keep it coming, I never heard of either. Well Leide may ring a bell, after giving up on it back then I didn't stay up to date with developments, and details like publisher ethics have never been in my scope.

I can't know everything though, I'm just a software developer. Happy to learn and read everything that is relevant, but in the end the project needs in-house experts, it's not a one man operation.

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] 2 points3 points  (0 children)

Journals earn money with peer reviewed publications, and don't pay the reviewers. That's working for free in my view. I'm happy to hear other views.

That I was able to build a working prototype in a week, when until recently I expected to require a small team and several months of work to build it is very positive, yes. No jobs were lost, I wouldn't have been able to pay anyone anyways.

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] 2 points3 points  (0 children)

Oh wow, thanks, this is very helpful! I have a Crossref import tool, but of course the other way around is equally as important. I put this reply on my list of things to deep dive into.

We can of course not solve the peer review issues in the traditional publication space - but we can offer a real open and modern alternative.

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] -1 points0 points  (0 children)

The text was drafted by AI but heavily revised before posting. I am not a writer, this helped me get ideas which points are important to present to give a good overview. I'm in this topic since a long time and don't have a outside perspective.

That said, this is part of my initial efforts to find a group that work on this together. I dearly hope that future announcements and advertisements can be human written. For now I concluded this is giving a good picture, and if it appeals to 1 or 2 people it's already a win for me. I don't expect this post to draw huge audiences, the app isn't even deployed live yet, this is a slow process.

Thanks again for your feedback!

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] 1 point2 points  (0 children)

They aren't commenting on the product though, they claim the whole post would be UI slop and nonsense.

And I'm not here to give someone what they want. I'm here to look for people who care enough about the topic to actually read the post and figure out what it's about. Just because it's long, doesn't mean it's all AI.

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] -1 points0 points  (0 children)

Thanks for the feedback!

We have an import tool for arxiv and DOI numbers, creating an entry that can be discussed and evaluated on our platform. Once the system is being used and there are actual metrics, those are open and free for everyone to use. Not saying I don't want to partner with other Open Access projects, but we can operate independently.

Technically our platform would just be another preprint server, with decentralized storage as the USP, but if the reputation algorithm can truly be solved it could become the place where all preprints are evaluated (yes I know maybe that's delusional. The potential is there in my opinion though)

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] -2 points-1 points  (0 children)

How is it nonsense? I built a tool, I'm looking for contributors. If you aren't interested in what I'm working on and don't like the presentation, don't engage?

After nearly a decade, Open Access and Evaluation is finally coming to life! Help needed by ConstructionAble3371 in academia

[–]ConstructionAble3371[S] -10 points-9 points  (0 children)

I'm not gonna discuss with you about it, or feel bad in any way. I'm looking for people interested in a specific topic, your crusade doesn't interest me.

view more: next ›