jtreg testing integrated
martinrb at google.com
Tue May 20 05:36:23 PDT 2008
Wait, now I remember, I used to wear the integrator hat too,
and I wanted the ability to data-mine a long series of javatest runs.
I never tackled that problem.
The general problem is really hard.
You want a report that says things like
Test FOO has been failing intermittently since the Ides of March,
but only on 64-bit x86 platforms.
On Mon, May 19, 2008 at 4:07 PM, Jonathan Gibbons
<Jonathan.Gibbons at sun.com> wrote:
> (removed compiler-dev)
> Your comments about unsymmetric runs are interesting. jtdiff performs an
> comparison, and I'd want to keep that functionality.
> The two use cases I had in mind were:
> -- Given a set of nightly builds on a set of platforms, compare the results
> all the platforms, and report differences
> -- Given the same set of nightly builds on a set of platforms, for each
> perform a pair-wise comparison against the corresponding results last
> I'll see about adding an option to specify a reference set of results, for
> "developer time" use case.
More information about the jtreg-use