Test policy follow-up, third testing tier
Joseph D. Darcy
joe.darcy at oracle.com
Thu Jun 25 22:29:56 UTC 2015
On 6/25/2015 2:31 PM, Mani Sarkar wrote:
> Thanks Martijn, Joe for your updates.
> Out of curiosity how do I run these tests from the command line:
> $ jtreg [runTier1 params]
> $ jtreg [runTier2 params]
$ jtreg [jtreg options] :tier1
More generally, the tiered test definitions are test groups and any test
group can be specified for jtreg using ":$GROUP_NAME". For example, tier
1 for the jdk repo is itself composed of several other test groups,
jdk_lang, jdk_util, and jdk_math; see the TEST.groups file in jdk/test
As discussed earlier in the thread, for "official" kinds of test runs, I
would always recommend including the jtreg options
-ea -esa -agentvm
(enable assertions, enable system assertions, use agent vm mode) and
probably also -conc:$N thrown in too.
If nothing else, this is how we run the tests internally, so if a new
test doesn't pass when run this way, it will get noticed :-)
> I mean whats the format to do so?
> When we do this:
> $ make test
> Are tests run in the same priority, tier1 tests, tier2 tests, etc... ?
> Any references to this will be appreciated - thanks guys.
I have a change in progress to all the tiered targets to be issued via make:
JDK-8075571: Support tiered testing make targets
For this in-progress fix, if issued via make the tiered tests in
different repos will *not* be run concurrently. If you want run them
concurrently, jtreg supports invoking test from different repos in a
single test run.
More information about the jdk9-dev