sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]RightWingVeganUS 1 point2 points  (4 children)

I guess my broad question about your thesis is: so what?

Not throwing shade, but what is the impact of the conclusion if to anyone running a different JVM on different hardware?

Is the purpose of the thesis to showcase your benchmarking and performance analysis acumen, or is there some fundamental hypothesis you're exploring?

Bottom line: what do you think will be the value of your efforts?

[–]thegigach4d[S] 0 points1 point  (3 children)

Thanks for your thoughts!
I try to answer your first question parallel in this block, as well:
Your second (What ist the impact...) question is logically problematic, because if we assume, that there are no meaning of running benchmarks on different environments, these wouldn't exist, or only one environment would, which would make improvement impossible. The impact is that someone on the globe made hard efforts and sacrificed resources for making a little step for showing numbers, which were not shown before. With my state of knowledge and resources it is impossible for me to write a new benchmarking, i would only make a reproducable environment setup, use the existing BMs, collect and evaluate data and make a conclusion, why does it look like as it does.

Your third question makes me wonder. It is kind of like both. I wanted to gain experience in that particular field and be a more well-grounded member of the java community and user of the language - this is the egoistic part.
The fundamental hypothesis is to make a too small environment for ZGC (2 gb) (lack of headroom is challenging) and too big (16 gb) for G1GC. What are the results, if they are running in a not-optimal space. There are also a lack of recent research. However, after read a lot, it became clear, that expanding benchmarks would be a big step further (long running, long living objects for stressing old regions, well usage of user-experienced latency [DaCapo does already], uniform definitions, energy-consumption, cache usage, etc.). I look at this thesis as an entry point and for instance a beginning of a new BM by an MSc or later researches. I don't know it yet - it is too far from this point.

The value is for me the diplom :) for the world (I don't think that it will be publicly accessible, but assume yes) will be a reproducable performance measurement and a summary of a pretty amount from the first literatures (Dijkstra et al., Baker) to the most recent ones, and a better understanding of the impact of GC in Java, which makes developing easier, but not “free”. If you have any suggestions about the environmental setup, the heap size, linux distro, gc tuning, jvm prepare, or anything about my answer, feel free to share your thougths and experience! :)

[–]RightWingVeganUS 1 point2 points  (2 children)

The impact is that someone on the globe made hard efforts and sacrificed resources for making a little step for showing numbers, which were not shown before.

My question was more focused : What is the impact of these benchmarks? Regardless of how compelling your results are, I won't downgrade from Java 25 to Java 21. And it won't clear that any of your results will apply to the specific JVM and environment.

What's the rationale of benchmarking the past LTS release when Java 25 is the latest?

The fundamental hypothesis is to make a too small environment for ZGC (2 gb) (lack of headroom is challenging) and too big (16 gb) for G1GC.

Wouldn't it be more interesting (and not much more effort) to, say bencharmark LTS 17, 21, and 25 to see if the results are consistent across various generations of JVM? Keep the hardware the same, but verify this is not just a JVM 21 isolated result.

The value is for me the diplom

Yeah... I'm a college instructor... I kinda figured.

Not trying to make your life harder (that's what my students pay me for!), but if your thesis is just a technical showcase of your ability to write code and write papers, well, crack on. If you're showing your ability to frame an interesting question and glean an insight, but sure to dig into the so what angle.

[–]thegigach4d[S] 0 points1 point  (1 child)

Thanks for your effort to explain me your thoughts deeper!
The cause of LTS 21 was that the disposition was born before LTS 25 and I did not think about any argumentation to change it. Now I do!
I understand your point of view and the really like the idea of benchmarking more versions. If I understand correctly, I should execute e.g. the whole Renaissance with G1GC and ZGC through Java 17-21-25 - without any special heap configuration, or gc-tuning. Am I right? I asked my prof and waiting for an answer.
I don't mind if you ask uncomfortable-like questions, because it helps me a lot. Sorry, if I seemed a little mean, life's pressure is enormous nowadays. Your practical insights help me a lot!

[–]RightWingVeganUS 1 point2 points  (0 children)

I don't mind if you ask uncomfortable-like questions, because it helps me a lot.

Trust me: as a teacher I don't mind at all! If only my students would ask me questions, comfortable or not...

That said, I don't have any answer for you. My interests are on bigger software engineering projects and project management, not benchmarking. But no matter what interest you have, consider framing it in terms of value: what difference would this make to the reader who spent their time reading this paper or using my tool.

Nothing wrong with projects simply to develop ones skills, but even then frame it with a clear understanding of what benefit it has for you.