From: Jeff Squyres (jsquyres_at_[hidden])
Date: 2006-11-05 08:55:42
This summary page is horrible; don't use it. There are significant
shortcomings of the present reporter. The best way to get at the
results is to look at the detailed output. We do not yet have a good
summary/rollup, paired with the fact that there has been considerable
flux in some people's testing setups over the last week (e.g., IU was
changing a bunch to test several different new things, so a bunch of
tests artificially failed).
On Nov 4, 2006, at 11:50 PM, Richard L. Graham wrote:
> I am sure I am not hitting all the relevant folks, but I am not
> sure who these are,
> so ...
> I am looking at the mtt summary page, and when I look at the
> executive summary,
> it looks like we are doing terrible - we pass most installs and
> builds, but very few
> of the tests. However, when I look at the test suite summary,
> looks like we are passing
> a very large number of tests, and failing a relatively small
> fraction of the tests.
>
> I would like to use this page as one measure for tracking progress
> towards completion of the
> 1.2 release, but there seems to be something here that I am missing
> (I can guess what
> is happening, but if my guess is correct, this is not how I would
> display the data - especially
> if we are going to open this to the public). Any comments ? I
> know this is a work in
> progress, so this may also be part of the issue.
>
> thanks,
> Rich
-- Jeff Squyres Server Virtualization Business Unit Cisco Systems