Svadev mailing list

[Will Dietz <willdtz AT gmail.com>]

Hi all,

I'm forwarding a sample of a nightly email test I configured for my
own use/sanity, and was debating sending it to the list.

It's based on the nightly test John commited a while back, running
Olden and SPEC2k.

Additionally it runs the lit tests, and the whole thing is modified to
be a bit more email-friendly (only send build logs that fail, etc).

FWIW While I'm sending results:

--Olden has some curious failures we should look into.  In particular,
tsp now goes into an infinite loop :( (there's a timelimit of 500
seconds, you can see it cuts it off at 499 and change).
--Lit tests are failing because I updated them for the external -/->
incomplete stuff, and haven't committed those changes because I'm
still working to ensure they're right.
--175.vpr, 176.gcc,252.eon fail from SPEC.

I haven't tried to find what changes caused these failures, I'll
report on that if I get around to that.  It's very possible I caused
these failures :), but I thought I'd point them out.

Anyway, the main point is --do you think sending this report to the
group would be useful?  If not I'll probably just be sending it to
myself/Arushi.
Oh and if it is sent to the group, is this the place to send it?

~Will


---------- Forwarded message ----------
From: Will Dietz 
<willdtz AT gmail.com>
Date: Thu, Sep 30, 2010 at 4:56 PM
Subject: PA Nightly Test
To: 
testing AT wdtz.org
====================
Pool Alloc Testing Report...
====================

Updating LLVM...
At revision 115207.

Building LLVM...
(Success)

Updating Poolalloc...
U    test/dsa/td/recur.ll
U    test/dsa/td/params.ll
U    test/dsa/td/call1.ll
U    test/dsa/td/call2.ll
U    test/dsa/td/params1.ll
Updated to revision 115207.

Building Poolalloc...
(Success)

Cleaning out old test files...
====================
Testing Poolalloc...
====================
Testing complete. Results:
Name:               LOC  | GCC    NonPATime | OnlyOHTime OO run% | ReplTime 
MR run% | PA Time PA run%  | Basepa Base run% | NumPools Typesafe BumpPtr PFE 
NumArgs MaxArgs |
bh/bh               2073 |   2.12   1.72    |   2.36      137.21 |   1.72    
100.00 |   1.73   100.58  |   2.34  136.05   | 5        1        *       *   
4       2       | 
bisort/bisort       350  |   0.95   0.91    |   1.31      143.96 |   0.84     
92.31 |   0.40    43.96  |   0.68   74.73   | 5        *        1       *   4 
      1       | 
em3d/em3d           688  |   7.42   5.98    |   5.98      100.00 |   6.00    
100.33 |   5.86    97.99  |   5.86   97.99   | 6        *        4       *   
4       2       | 
health/health       502  |   0.57   0.57    |   0.63      110.53 |   0.56     
98.25 |   0.01     1.75  |   0.02    3.51   | 4        *        2       *   3 
      1       | 
mst/mst             428  |   0.30   0.31    |   0.29       93.55 |   0.29     
93.55 |   0.28    90.32  |   0.30   96.77   | 1        *        *       *   * 
      *       | 
perimeter/perimeter 484  |   0.30   0.28    |   0.43      153.57 |   0.30    
107.14 |   0.29   103.57  |   0.80  285.71   | 6        *        1       *   
5       1       | 
power/power         622  |   1.75   1.61    |   1.57       97.52 |   1.54     
95.65 |   0.00     0.00  |   0.00    0.00   | 5        *        3       *   4 
      1       | 
treeadd/treeadd     245  |   4.04   0.37    |   0.59      159.46 |   0.32     
86.49 |   0.37   100.00  |   0.60  162.16   | 4        *        2       *   2 
      1       | 
tsp/tsp             582  |   1.58   1.57    |   1.58      100.64 |   1.45     
92.36 | 499.84  31836.94 | 499.95 31843.95  | 4        *        1       *   3 
      1       | 
voronoi/voronoi     1129 |   0.44   0.45    |   0.00        0.00 |   0.00     
 0.00 |   0.00     0.00  |   0.00    0.00   | *        *        *       *   * 
      *       | 
Name:                   LOC    | GCC    NonPATime | OnlyOHTime OO run% | 
ReplTime MR run% | PA Time PA run% | Basepa Base run% | NumPools Typesafe 
BumpPtr PFE NumArgs MaxArgs |
164.gzip/164.gzip       8616   |   0.06   0.06    |   0.05       83.33 |   
0.06    100.00 |   0.06   100.00 |   0.05   83.33   | 5        2        *     
  *   4       3       | 
175.vpr/175.vpr         17728  |   4.58   5.45    |   8.69      159.45 |   
0.01      0.18 |   0.01     0.18 |   0.00    0.00   | 135      5        8     
  17  102     4       | 
176.gcc/176.gcc         222208 |   0.00   1.23    |   0.00        0.00 |   
0.00      0.00 |   0.00     0.00 |   0.00    0.00   | *        *        *     
  *   *       *       | 
181.mcf/181.mcf         2412   |  12.83  13.39    |  15.68      117.10 |  
15.69    117.18 |  15.82   118.15 |  15.79  117.92   | 4        3        *    
   *   *       *       | 
186.crafty/186.crafty   20650  |   6.47   5.92    |   6.62      111.82 |   
5.87     99.16 |   5.79    97.80 |   6.18  104.39   | 12       6        *     
  *   2       1       | 
197.parser/197.parser   11391  |   3.47   3.53    |   3.61      102.27 |   
3.59    101.70 |   3.60   101.98 |   3.61  102.27   | 6        5        *     
  *   7       1       | 
252.eon/252.eon         35819  |   0.00   0.30    |   0.00        0.00 |   
0.00      0.00 |   0.00     0.00 |   0.00    0.00   | *        *        *     
  *   *       *       | 
253.perlbmk/253.perlbmk 81569  |   5.13   4.95    |   5.09      102.83 |   
5.17    104.44 |   5.11   103.23 |   5.02  101.41   | 935      2        *     
  *   22      2       | 
254.gap/254.gap         71363  |   2.71   2.70    |   2.72      100.74 |   
2.70    100.00 |   2.73   101.11 |   0.07    2.59   | 202      37       *     
  *   303     2       | 
255.vortex/255.vortex   67220  |   3.41   2.53    |   2.56      101.19 |   
2.68    105.93 |   2.56   101.19 |   2.57  101.58   | 45       12       *     
  *   314     3       | 
256.bzip2/256.bzip2     4647   |  11.85  12.39    |  12.35       99.68 |  
12.21     98.55 |  12.38    99.92 |  12.38   99.92   | 6        1        *    
   *   *       *       | 
300.twolf/300.twolf     20461  |   0.00   5.40    |   5.94      110.00 |   
5.40    100.00 |   5.43   100.56 |   6.22  115.19   | 92       7        2     
  1   12      1       | 


====================
Lit test results:
====================
PATH=/store2/llvm/nightly/llvm-objects/Release/bin:/store2/llvm/nightly/llvm/test/Scripts:/home/will/llvm/llvm27/install/bin:/store2/llvm/nightly/llvm-objects/projects/poolalloc/test/tools:/bin:/usr/bin/:/usr/local/bin
 make -C /store2/llvm/nightly/llvm-objects/test check-local-lit 
TESTSUITE=/store2/llvm/nightly/llvm-objects/projects/poolalloc/test 
LIT_ARGS=-q
make[1]: Entering directory `/store2/llvm/nightly/llvm-objects/test'
Making a new site.exp file...
Making LLVM 'lit.site.cfg' file...
Making LLVM unittest 'lit.site.cfg' file...
( ulimit -t 600 ; ulimit -d 512000 ; ulimit -m 512000 ; ulimit -v 512000 ; \
  /store2/llvm/nightly/llvm/utils/lit/lit.py -q 
/store2/llvm/nightly/llvm-objects/projects/poolalloc/test )
FAIL: LLVM :: dsa/extern/extern_global.ll (1 of 79)
FAIL: LLVM :: dsa/extern/extern3.ll (2 of 79)
FAIL: LLVM :: dsa/extern/extern2.ll (3 of 79)
FAIL: LLVM :: dsa/extern/extern.ll (8 of 79)
FAIL: LLVM :: dsa/td/call1.ll (54 of 79)
FAIL: LLVM :: dsa/td/call2.ll (55 of 79)
FAIL: LLVM :: dsa/td/recur.ll (57 of 79)
FAIL: LLVM :: dsa/td/params1.ll (67 of 79)
FAIL: LLVM :: dsa/td/params.ll (68 of 79)
********************
Failing Tests (9):
    LLVM :: dsa/extern/extern.ll
    LLVM :: dsa/extern/extern2.ll
    LLVM :: dsa/extern/extern3.ll
    LLVM :: dsa/extern/extern_global.ll
    LLVM :: dsa/td/call1.ll
    LLVM :: dsa/td/call2.ll
    LLVM :: dsa/td/params.ll
    LLVM :: dsa/td/params1.ll
    LLVM :: dsa/td/recur.ll

  Unexpected Failures: 9
make[1]: *** [check-local-lit] Error 1
make[1]: Leaving directory `/store2/llvm/nightly/llvm-objects/test'
make: *** [lit-report] Error 2