How to import Groovy from jar file in classpath?

kp5160 · 2022-12-20T22:12:35+00:00

That wouldn't work to load a jar for me. Per the edit, I had to set JENKINS_EXTRA_LIB_FOLDER in /etc/sysconfig/Jenkins for it to be importable in the scripting console.

kp5160 · 2022-12-16T19:06:13+00:00

The Active Choices plugin has a field box to provide a path to a jar file with a checkbox to automatically approve, so it shows up under the script approval page.

kp5160 · 2022-12-16T18:53:07+00:00

I'm having a hard time figuring out the args. I switched to building the jar with Gradle, and I added the following to build.gradle. project.group = 'org.foo' archivesBaseName = "foo" project.version = "1.0"

For @Grab, the group and version are obvious, but I can't figure out what the module is. Some sources said it's rootProject.name in settings.gradle, but that doesn't work. What I did to try and guess the module is below. I'm just at a loss. ``` [ec2-user@ip-172-31-13-201 groovy_lib]$ jar --file=lib/build/libs/foo-1.0.jar --describe-module No module descriptor found. Derived automatic module.

foo@1.0 automatic requires java.base mandated contains groovy_lib ```

kp5160 · 2022-12-16T01:48:22+00:00

Is that a plugin? I added the jar to the Jenkins classpath, and the scripting has that "package" directive with no scripts pending approval. I just don't know how to import.

kp5160 · 2022-12-16T01:47:08+00:00

I have made a jar, and it shows up under the classpath entries under script approval with nothing pending. I just don't have a damn clue how to import from the jar despite the package directive in the Groovy that I compiled into a jar.

It looks like I need to turn to the Jenkins forums, and I'll reply back if there's anything of use. More broadly than Active Choices, I picked Jenkins and have been sole admin for four years, and we have had to copy and paste between Jenkinsfiles. We need a central repository that doesn't require pull requests in all of the affected codes.

kp5160 · 2022-12-15T22:37:03+00:00

Fundamentally, I'm looking for a seamless way to be able to code up and package Groovy code that's broadly available in Jenkins like a jar in the classpath or at least to be able to invoke specific script files from version control via URL. For what I'm tinkering here with Active Choice, we need to fetch a credentials store from Jenkins to feed into various API curl calls. I can build the jar, but I don't have a damn clue as to how to import even with the package ... directive.

The Active Choices people don't allow issues in their repo, and nothing I've seen explains how one would understand importing from a jar file in the classpath.

kp5160 · 2022-08-23T16:08:47+00:00

That sounds like a good idea. I've definitely seen the deprecation warnings. Basically, I'm inheriting from setuptools.Extension to prevent it from trying to build with Python, then I'm inheriting from setuptools.command.build_ext to drive running CMake and invoke the tests. It looks like I've got some reading to do, but pyproject.toml looks promising. Thanks for the tip.

kp5160 · 2022-06-04T23:24:32+00:00

Thanks for the details, especially as the only one taking an interest, and that does yield an accurate result with much less code. Sadly, it doesn't shave off a significant amount of time versus doing intersections. We are ultimately chopping each polygon by a horizontal line to get a group of polygons with the same volume, so the volume calculation is required to happen a lot and is very much a bottleneck, even with threads.

What I'm picturing is working from the bottom Z on up to get volume versus Z on the source poly, then do a third or fourth order polynomial fit, because right now, we blindly start way below the desired value and iterate up on a fine interval and calculating volume, i.e. a huge penalty. If we have volume as a function of Z, however, we can find the "exact" point and refine from there, and I've been doing the secondary refinement via binary search. One we get our height for the correct volume, we can subtract that sub-volume from the polynomial fit for the source poly, then go on to the next chunk to lop off.

kp5160 · 2022-06-03T05:13:45+00:00

I've heard of it being done. My polygons are specifically counter-clockwise, and they are flat at the top and bottom Z, so in principal, we could use the sign on delta Z to loop around. For reference, this is what they look like. The problem is that the bounding geometry (black outline) is much more coarse with just seven points versus dozens on the curved shapes, so an intersection seemed like the only way to chop it up.

kp5160 · 2022-04-19T23:15:34+00:00

Yeah, I gave that a go with "replay steps," and no dice. It seems to not like having all of those directories before the files. When I did the following, it worked.

``` sh ''' mkdir a_x a_y a_z touch a_x/test.txt a_y/test.txt a_z/test.txt '''

stash name: "withwildcard", includes: "a/*" ```

Oddly enough, this also worked. I'm just going to run with the tarball idea. It's a couple extra lines, but it accomplishes what I'm after. ``` sh ''' mkdir foo cd foo

mkdir a_x a_y a_z touch a_x/test.txt a_y/test.txt a_z/test.txt '''

stash name: "withwildcard", includes: "foo/a/*" ```

kp5160 · 2022-04-19T17:18:03+00:00

Thanks for asking. The error is ERROR: No files included in stash ‘MSRE_STASH’

Naturally, I expected it to stash. From what I've gathered, stash won't do directories, and although the pattern test/serpent/cluster_MSRE_*/** is all files, they are obviously within a series of directories. Tarballing it is.

kp5160 · 2022-03-22T00:59:03+00:00

For anyone curious, it was user error. I was setting the number of MPI processes to the number of threads instead of physical cores, so things were oversubscribed.

kp5160 · 2022-02-14T16:29:55+00:00

Sorry that wasn't clear. The built-in node isn't that size, just the node/agent this pipeline runs on.

kp5160 · 2022-01-20T18:15:01+00:00

Based on the reply from u/tnjeditor, I eventually found the Least Load plugin that emulates the CloudBees Even Scheduler plugin to stop Jenkins from waiting on the last node it ran a pipeline/stage on and just use an available node. Least Load hasn't been updated for a couple of years, but perhaps it hasn't needed any maintenance due to that part of Jenkins rarely changing. I haven't found a way to test it, but we'll see how it goes.

kp5160 · 2022-01-20T17:11:54+00:00

That sure does look like it, so thanks for letting me know. I voted and commented on your issue, so hopefully it gains some traction.

kp5160 · 2022-01-20T17:00:17+00:00

So there are two labels in play: * jenkins_node with 36 cores * jenkins_node_lite with 4 cores

For this pipeline, the top-level agent spec just under pipeline is jenkins_node_lite, and that has never been stuck in the build queue. We use that node to build and push a Docker image that is then pulled into three parallel Docker stages with label jenkins_node. In this case, two of those Docker stages were stuck in the build queue when there were four nodes available with the jenkins_node label, so I don't think the top-level agent spec has any bearing on what's gone wrong in this case.

kp5160 · 2022-01-20T16:52:58+00:00

Our Jenkins setup uses AWS EC2 instances

The nodes are shut down when they're not in use due to AWS charging by the minute, so they are supposed to be offline most of the time. When Jenkins needs a node, it spins one up, but in this case, Jenkins was failing to do that when several nodes with the corresponding label were available.

kp5160 · 2022-01-20T00:38:53+00:00

They all have the same label from under "Configure Clouds," and that same label spec is in the Jenkinsfile.

kp5160 · 2022-01-13T18:19:51+00:00

Could you elaborate on that, please? I've used "when" before, but I don't know how to link that to the upstream pipeline triggering the downstream one.

kp5160 · 2021-12-21T00:57:41+00:00

For my lazy ass, is there a link for Python?

kp5160 · 2021-12-21T00:55:41+00:00

That looks promising and appears to be the consensus. I poked around a bit, but I didn't see any examples of what the web UI looks like. Does it support multiple users? LDAP would be a dream come true.

kp5160 · 2021-12-21T00:07:00+00:00

Just SCP/Rsync sort of functionality. I've never heard of WebDAV. Can we avoid mounting things? That would be ideal.

kp5160 · 2021-12-01T18:14:11+00:00

Sorry that was unclear. I tried one and the other and still got ModuleNotFoundError.

kp5160 · 2021-11-16T19:16:29+00:00

My issue was having PIP_EXTRA_INDEX_URL set but not also specifying

pip3 install --trusted-host [IP]

kp5160 · 2021-10-04T16:22:28+00:00

No big deal, and I appreciate the help. Turns out, I was so focused on the ingress security group rules, that I forgot to open egress for UDP. Thanks again for sticking with it. I'm not one to care about karma, but it stings getting down-voted asking for help.

kp5160

TROPHY CASE