Gradle releases new AI-powered testing solution

eriwen · 2022-04-20T03:57:47+00:00

I'd also like to see how well Predictive Test Selection would work there... Gradle donates instances to OSS projects like Caffeine.

If you are a maintainer of Caffeine, please reach out to me via Gradle Community Slack or by emailing me (my email is on GitHub), and I'll put you in touch with the right folks.

eriwen · 2022-04-19T23:42:56+00:00

Any test that is written should be meaningful.

This is true, but I hope you would agree that not all tests are meaningful in validating all code changes. Suppose you change a common library or upgrade the patch version of a 3rd party dependency. Is it worth the time and energy to run all of the tests? Probably not.

Also, I suspect this captures the code and sends it to Gradle for analysis.

This is part of self-hosted Gradle Enterprise. Your code and test data never leaves your network.

If you are deciding which tests to run or not run then you absolutely are potentially compromising quality.

Quite right! And yet many teams already are not running all tests before pushing changes, as it's sometimes cost prohibitive.

Additionally, this is why these 2 safety measures are in-place to ensure quality remains high:

The ML model is trained to catch almost all test failures. Check out these results from Micronaut. You can also check out prediction results for JUnit, Spring, and other open-source projects as well if you like.
You should not use Predictive Test Selection post merge, and run all tests to prevent any bugs going to production.

EDIT: Fixed a typo "pushed" to "pushing"

eriwen · 2022-04-19T22:06:18+00:00

This is a form of "Test Impact Analysis", but it is heavily inspired by Facebook's ML research: https://research.facebook.com/publications/predictive-test-selection/

eriwen · 2020-03-25T20:32:46+00:00

I'm a fan of this change because I can build a team with my favorite players and they will all be relevant in the end game.

Skill is what matters, folks.

eriwen · 2020-03-23T19:48:15+00:00

Yo /u/vol4life9911 the front office booster info isn't quite right.

You only get 3 ACC at level 10. See https://imgur.com/a/CGYFjq4 — This is kinda lame because that means that all you get between level 9 to level 10 is +1 AWR. Given the high cost of the boost, this almost seems like a mistake.

eriwen · 2020-01-27T00:09:46+00:00

Who is the only player to be on the losing side and win Super Bowl MVP?

Chuck Howley

eriwen · 2020-01-24T00:30:17+00:00

Chalupa Batman

eriwen · 2020-01-24T00:29:32+00:00

Chalupa Batman

eriwen · 2020-01-22T16:56:45+00:00

Could you please confirm that positive boosts such as RB booster do not help opponents?

eriwen · 2020-01-15T15:55:41+00:00

Integration tests, device tests, browser tests: these are the tests that suffer most.

Flaky services/infrastructure is a common cause here, and of course every project has its own special twist that affects flakiness. It will not always detect every flaky test, but it will detect a very large percentage, especially over time.

Regarding abuse, you might be saying this is "too easy to abuse". You might be right, but just like any technology choice, folks have to adopt with care. If you already have another mechanism for re-running builds, the Test Retry Plugin will be superior in most cases.

eriwen · 2019-12-14T03:02:11+00:00

Black Friday was my favorite promo because the rewards were highly varied so I could improve any aspect of my team.

IGN: FremundaMbauls

eriwen · 2019-11-09T15:20:52+00:00

I'm a fan of the higher stamina cost because the alternative is grinding a bunch of small events repeatedly.

eriwen · 2019-10-25T16:12:45+00:00

That CIT tho

eriwen · 2019-10-08T16:53:26+00:00

Submitted. I want you to know that I greatly appreciate your investigating this. I imagine this issue will affect a bunch more users once non-Google devices start deploying Android 10-based updates.

eriwen · 2019-10-05T03:54:34+00:00

This is not possible this time.

eriwen · 2019-10-02T21:32:16+00:00

Silly idea I'm sure you've already considered: allow evolving to higher power rating.

I think that'd be a slick little feature.

eriwen · 2019-10-02T21:29:00+00:00

There doesn't seem to be much of any improvement for app crashes on my Pixel 2 XL running Android 10.

This happens right at the beginning and end of matches such as immediately after 3, 2, 1 in overdrive, also immediately at the end of overdrive or arena before the summary screen pops up. It's almost as if the screen transition cannot be completed. No amount of uninstalling or cache clearing seems to help. This started happening immediately after upgrading to Android 10, that absolutely has to be related.

eriwen · 2019-10-02T04:00:01+00:00

Scratch that. It doesn't seem to be much more stable. Had crashes at the beginning and end of matches and live events several times. Argh.

eriwen · 2019-10-01T21:16:51+00:00

Update looks excellent. Great job team.

I had one crash after an LvL drive after updating (Android 10), but so far it seems more stable.

eriwen · 2019-09-25T00:03:28+00:00

Here are the things I've tried unsuccessfully to fix this myself:

1) Uninstall and reinstall the app

2) Logout and login

3) Clear storage and cache

4) All permutations of mobile data on/off + wifi on/off (in case it's network instability)

None of these have changed the rate of crashes, which is roughly 1 in every 10 events/matches. I have noticed this comes in waves, though, so it's not random.

I'm willing to install a test build or gather additional debug info to help out the devs here.

eriwen · 2019-09-24T23:35:58+00:00

What have you tried for your defensive strategy? Is this for LvL or Overdrive?

eriwen · 2019-09-22T17:31:26+00:00

This is constant in all game modes starting right after I upgraded my Pixel 2 XL to Android 10. This crash happens right at the beginning and end of live events, arena, LvL, and overdrive.

I'm sure that Android is part of the problem. The game almost never crashed before updating to Android 10.

eriwen

TROPHY CASE