OLD | NEW |
1 # Copyright (c) 2012, the Dart project authors. Please see the AUTHORS file | 1 # Copyright (c) 2012, the Dart project authors. Please see the AUTHORS file |
2 # for details. All rights reserved. Use of this source code is governed by a | 2 # for details. All rights reserved. Use of this source code is governed by a |
3 # BSD-style license that can be found in the LICENSE file. | 3 # BSD-style license that can be found in the LICENSE file. |
4 | 4 |
5 # This directory contains tests that are intended to show the | 5 # This directory contains tests that are intended to show the |
6 # current state of the language. | 6 # current state of the language. |
7 | 7 |
8 # In order to maintain maximum test coverage for all builds, | 8 # In order to maintain maximum test coverage for all builds, |
9 # please use the following procedure to mark a test | 9 # please use the following procedure to mark a test |
10 # failed on architectures other than the one you are working on. | 10 # failed on architectures other than the one you are working on. |
11 # | 11 # |
12 # 1) Copy the old version of the test to | 12 # 1) Copy the old version of the test to |
13 # tests/language/src/TestName[Dartc|VM|Frog]Test.dart. | 13 # tests/language/src/TestName[Dartc|VM|Frog]Test.dart. |
14 # to maintain coverage. | 14 # to maintain coverage. |
15 # 2) File a bug on each architecture for the failure due to the language change. | 15 # 2) File a bug on each architecture for the failure due to the language change. |
16 # 3) Update the language/src directory with the updated test. | 16 # 3) Update the language/src directory with the updated test. |
17 | 17 |
18 [ $component == vm || $component == dartium ] | 18 [ $compiler == none ] |
19 GCTest: Fail # Issue 1487 | 19 GCTest: Fail # Issue 1487 |
20 ImpliedInterfaceTest: Fail # Bug 5349944 | 20 ImpliedInterfaceTest: Fail # Bug 5349944 |
21 FBoundedQuantificationTest: Skip # Issue 439 | 21 FBoundedQuantificationTest: Skip # Issue 439 |
22 FieldOverrideTest/none: Fail # Issue 742: field shadowing now allowed | 22 FieldOverrideTest/none: Fail # Issue 742: field shadowing now allowed |
23 FieldOverrideTest/01: Fail # Issue 742: field shadowing now allowed | 23 FieldOverrideTest/01: Fail # Issue 742: field shadowing now allowed |
24 FieldOverrideTest/02: Fail # Issue 742: field shadowing now allowed | 24 FieldOverrideTest/02: Fail # Issue 742: field shadowing now allowed |
25 SuperFieldAccessTest: Fail # Issue 742: field shadowing now allowed | 25 SuperFieldAccessTest: Fail # Issue 742: field shadowing now allowed |
26 PseudoKWIllegalTest/03: Fail # Issue 356 | 26 PseudoKWIllegalTest/03: Fail # Issue 356 |
27 PseudoKWIllegalTest/08: Fail # Issue 356 | 27 PseudoKWIllegalTest/08: Fail # Issue 356 |
28 PseudoKWIllegalTest/10: Fail # Issue 356 | 28 PseudoKWIllegalTest/10: Fail # Issue 356 |
(...skipping 59 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
88 AssignStaticTypeTest/02: Skip # Issue 2070 (fails only in checked mode) | 88 AssignStaticTypeTest/02: Skip # Issue 2070 (fails only in checked mode) |
89 | 89 |
90 ConstructorRedirectTest/01: Fail # Issue 2103. | 90 ConstructorRedirectTest/01: Fail # Issue 2103. |
91 | 91 |
92 # DartC or Frog specific tests that should not be run by the VM | 92 # DartC or Frog specific tests that should not be run by the VM |
93 *DartcTest: Skip | 93 *DartcTest: Skip |
94 *DartcNegativeTest: Skip | 94 *DartcNegativeTest: Skip |
95 *FrogTest: Skip | 95 *FrogTest: Skip |
96 *FrogNegativeTest: Skip | 96 *FrogNegativeTest: Skip |
97 | 97 |
98 [ ($component == vm || $component == dartium) && $unchecked ] | 98 [ $compiler == none && $unchecked ] |
99 | 99 |
100 IsNotClass3NegativeTest: Fail # Spec unclear. | 100 IsNotClass3NegativeTest: Fail # Spec unclear. |
101 Prefix16NegativeTest: Fail # Bug 5532534 | 101 Prefix16NegativeTest: Fail # Bug 5532534 |
102 | 102 |
103 [ ($component == vm || $component == dartium) && $mode == debug ] | 103 [ $compiler == none && $mode == debug ] |
104 GCTest: Skip # Takes too long. | 104 GCTest: Skip # Takes too long. |
105 | 105 |
106 [ $component == vm && $mode == release ] | 106 [ $compiler == dartc ] |
107 | |
108 [ $component == dartc || $component == chromium ] | |
109 AbstractSyntaxTest/01: Fail | 107 AbstractSyntaxTest/01: Fail |
110 ApplicationNegativeTest: Fail | 108 ApplicationNegativeTest: Fail |
111 AssertKeywordNegativeTest: Fail | 109 AssertKeywordNegativeTest: Fail |
112 AssertTest: Fail # Uses AssertError class. Bug 4385894. | 110 AssertTest: Fail # Uses AssertError class. Bug 4385894. |
113 AssignInstanceMethodNegativeTest: Fail | 111 AssignInstanceMethodNegativeTest: Fail |
114 BadNamedParametersTest: Fail # Issue 1941 | 112 BadNamedParametersTest: Fail # Issue 1941 |
115 BadNamedParameters2Test: Fail # Issue 1941 | 113 BadNamedParameters2Test: Fail # Issue 1941 |
116 BodyLessConstructorWrongArgNegativeTest: Fail | 114 BodyLessConstructorWrongArgNegativeTest: Fail |
117 CallOperatorTest: Pass # Issue 1355 | 115 CallOperatorTest: Pass # Issue 1355 |
118 CharEscapeTest: Pass # Issue 1654 | 116 CharEscapeTest: Pass # Issue 1654 |
(...skipping 74 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
193 # Add new dartc annotations above in alphabetical order | 191 # Add new dartc annotations above in alphabetical order |
194 # | 192 # |
195 | 193 |
196 # VM or Frog specific tests that should not be run by DartC. | 194 # VM or Frog specific tests that should not be run by DartC. |
197 *VMTest: Skip | 195 *VMTest: Skip |
198 *VMNegativeTest: Skip | 196 *VMNegativeTest: Skip |
199 *FrogTest: Skip | 197 *FrogTest: Skip |
200 *FrogNegativeTest: Skip | 198 *FrogNegativeTest: Skip |
201 | 199 |
202 | 200 |
203 [ $component == dartium ] | 201 [ $compiler == none && $runtime == drt ] |
204 # TODO: These need to be retriaged. | 202 # TODO: These need to be retriaged. |
205 DisablePrivacyTest: Skip | 203 DisablePrivacyTest: Skip |
206 RichardsTest: Fail | 204 RichardsTest: Fail |
207 StringEscape1NegativeTest: Skip | 205 StringEscape1NegativeTest: Skip |
208 GCTest: Skip # Issue 1487 | 206 GCTest: Skip # Issue 1487 |
209 | 207 |
210 | 208 [ $compiler == frogsh ] |
211 [ $component == frogsh ] | |
212 ArithmeticTest: Fail # Issue 1470 | 209 ArithmeticTest: Fail # Issue 1470 |
213 IntrinsifiedMethodsTest: Fail # Issue 1470 | 210 IntrinsifiedMethodsTest: Fail # Issue 1470 |
214 | 211 |
215 # This set of four test components (frog, frogsh, frogium, and webdriver) all | 212 [ ($compiler == frog || $compiler == frogsh) && $unchecked ] |
216 # consume frog output, so if frog is generating the incorrect code, chances are | |
217 # it will fail on all of these components. | |
218 # | |
219 # Further explanation: | |
220 # frog: frog compiler, run using the VM | |
221 # frogsh: self-hosted frog compiler | |
222 # frogium: Dart code compiled with frog VM running under DumpRenderTree | |
223 # webdriver: Dart code compiled with frog VM running on an actual browser | |
224 # (Chrome, IE, Firefox, Safari, etc). If a test is only failing on a particular | |
225 # browser, you can be more specific about the failure by using $browser: | |
226 # [ $component == webdriver && $browser == chrome ] for example. | |
227 [ ($component == frog || $component == frogsh || $component == frogium || $compo
nent == webdriver) && $unchecked ] | |
228 BoolTest: Fail # Issue 2092 | 213 BoolTest: Fail # Issue 2092 |
229 CompileTimeConstantCTest/01: Fail # integers as keys in literal maps. | 214 CompileTimeConstantCTest/01: Fail # integers as keys in literal maps. |
230 | 215 |
231 [ $component == frog || $component == frogsh || $component == frogium || $compon
ent == webdriver] | 216 [ $component == frog || $compiler == frogsh ] |
232 ExceptionTest: Fail # Issue 1785 | 217 ExceptionTest: Fail # Issue 1785 |
233 Factory3Test: Fail # Issue 417 | 218 Factory3Test: Fail # Issue 417 |
234 Factory2NegativeTest: Fail | 219 Factory2NegativeTest: Fail |
235 CallThroughNullGetterTest: Fail # Throw ObjectNotClosure instead of NullPointerE
xception. | 220 CallThroughNullGetterTest: Fail # Throw ObjectNotClosure instead of NullPointerE
xception. |
236 CompileTimeConstantCTest/02: Fail # string-concatenated (+) keys in literal maps
. | 221 CompileTimeConstantCTest/02: Fail # string-concatenated (+) keys in literal maps
. |
237 CompileTimeConstantDTest: Fail # doesn't recognize 400 + z (with z parameter of
constructor) as compile-time constant. | 222 CompileTimeConstantDTest: Fail # doesn't recognize 400 + z (with z parameter of
constructor) as compile-time constant. |
238 CompileTimeConstantETest: Fail | 223 CompileTimeConstantETest: Fail |
239 CompileTimeConstantGTest: Fail # compile time constants with super calls to opti
onal arguments. | 224 CompileTimeConstantGTest: Fail # compile time constants with super calls to opti
onal arguments. |
240 DisablePrivacyTest: Skip # Issue 1882: Needs --disable_privacy support. | 225 DisablePrivacyTest: Skip # Issue 1882: Needs --disable_privacy support. |
241 DoubleToStringAsExponentialTest: Fail # fails due to -0.0. | 226 DoubleToStringAsExponentialTest: Fail # fails due to -0.0. |
242 # Once the -0.0 in DoubleToStringAsFixedTest is fixed it will probably need to | 227 # Once the -0.0 in DoubleToStringAsFixedTest is fixed it will probably need to |
243 # be moved to a | 228 # be moved to a |
244 # [ $component == frog || $component == frogium || $component == webdriver ] | 229 # [ $compiler == frog ] |
245 # section. | 230 # section. |
246 DoubleToStringAsFixedTest: Fail # fails due to -0.0 and due to rounding in const
ant propagation. | 231 DoubleToStringAsFixedTest: Fail # fails due to -0.0 and due to rounding in const
ant propagation. |
247 DoubleToStringAsPrecisionTest: Fail # fails due to -0.0. | 232 DoubleToStringAsPrecisionTest: Fail # fails due to -0.0. |
248 ExtendTypeParameterNegativeTest: Skip # Issue 886 | 233 ExtendTypeParameterNegativeTest: Skip # Issue 886 |
249 ExtendTypeParameter2NegativeTest: Skip # Issue 886 | 234 ExtendTypeParameter2NegativeTest: Skip # Issue 886 |
250 FinalSyntaxTest/none: Fail | 235 FinalSyntaxTest/none: Fail |
251 GetSetSyntaxTest/00: Fail # Issue 1571 | 236 GetSetSyntaxTest/00: Fail # Issue 1571 |
252 GetSetSyntaxTest/01: Fail # Issue 1571 | 237 GetSetSyntaxTest/01: Fail # Issue 1571 |
253 GetSetSyntaxTest/02: Fail # Issue 1571 | 238 GetSetSyntaxTest/02: Fail # Issue 1571 |
254 GetSetSyntaxTest/03: Fail # Issue 1571 | 239 GetSetSyntaxTest/03: Fail # Issue 1571 |
(...skipping 131 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... |
386 | 371 |
387 #Issue 1308 | 372 #Issue 1308 |
388 NamedParameters2Test: Fail | 373 NamedParameters2Test: Fail |
389 NamedParameters3Test: Fail | 374 NamedParameters3Test: Fail |
390 NamedParameters4Test: Fail | 375 NamedParameters4Test: Fail |
391 | 376 |
392 StringEscape4NegativeTest: Fail # Issue 1352 | 377 StringEscape4NegativeTest: Fail # Issue 1352 |
393 | 378 |
394 Issue4515170Test: Fail | 379 Issue4515170Test: Fail |
395 | 380 |
396 [ $component == webdriver && $browser == chrome ] | 381 [ $runtime == chrome ] |
397 StringEscape1NegativeTest: Skip | 382 StringEscape1NegativeTest: Skip |
398 | 383 |
399 [ $component == webdriver && ($browser == ff || $browser == safari || $browser =
= ie) ] | 384 [ $runtime == ff || $runtime == safari || $runtime == ie) ] |
400 Closure3Test: Fail | 385 Closure3Test: Fail |
401 MethodInvocationTest: Fail | 386 MethodInvocationTest: Fail |
402 Private3Test: Fail | 387 Private3Test: Fail |
403 StackTraceTest: Fail | 388 StackTraceTest: Fail |
404 StringInterpolateNPETest: Fail | 389 StringInterpolateNPETest: Fail |
405 | 390 |
406 # For these tests Frog generates invalid JS. Chrome throws a SyntaxError, but | 391 # For these tests Frog generates invalid JS. Chrome throws a SyntaxError, but |
407 # other browsers don't, so they eventually timeout. See issue 1515. | 392 # other browsers don't, so they eventually timeout. See issue 1515. |
408 # In any case, we shouldn't be relying on SyntaxError. | 393 # In any case, we shouldn't be relying on SyntaxError. |
409 Label2NegativeTest: Skip | 394 Label2NegativeTest: Skip |
410 Label3NegativeTest: Skip | 395 Label3NegativeTest: Skip |
411 Label5NegativeTest: Skip | 396 Label5NegativeTest: Skip |
412 Label6NegativeTest: Skip | 397 Label6NegativeTest: Skip |
413 LabelTest: Skip | 398 LabelTest: Skip |
414 StringEscape1NegativeTest: Skip | 399 StringEscape1NegativeTest: Skip |
415 Switch3NegativeTest: Skip | 400 Switch3NegativeTest: Skip |
416 Switch4NegativeTest: Skip | 401 Switch4NegativeTest: Skip |
417 ExecuteFinally6Test: Skip | 402 ExecuteFinally6Test: Skip |
418 | 403 |
419 # TODO(jmesserly): now that we have a bot, we need to set up Opera testing. | 404 # TODO(jmesserly): now that we have a bot, we need to set up Opera testing. |
420 [ $component == webdriver && $browser == opera ] | 405 [ $runtime == opera ] |
421 *: Skip | 406 *: Skip |
422 | 407 |
423 [ $component == webdriver && $browser == ff ] | 408 [ $runtime == ff ] |
424 NamingTest: Fail | 409 NamingTest: Fail |
425 StackOverflowTest: Fail | 410 StackOverflowTest: Fail |
426 ExecuteFinally7Test: Skip | 411 ExecuteFinally7Test: Skip |
427 StaticFinalField2NegativeTest: Skip | 412 StaticFinalField2NegativeTest: Skip |
428 | 413 |
429 [ $component == webdriver && $browser == ff && $system == windows ] | 414 [ $runtime == ff && $system == windows ] |
430 CTConst2Test: Pass,Fail # Issue 2101 | 415 CTConst2Test: Pass,Fail # Issue 2101 |
431 | 416 |
432 [ $component == webdriver && $browser == ie ] | 417 [ $runtime == ie ] |
433 StackOverflowTest: Fail | 418 StackOverflowTest: Fail |
434 ObjectDynamicMethodTest: Fail | 419 ObjectDynamicMethodTest: Fail |
435 NumberSyntaxTest: Fail | 420 NumberSyntaxTest: Fail |
436 | 421 |
437 [ $component == webdriver && $browser == ie && ($system == linux || $system == m
ac) ] | 422 [ $runtime == ie && ($system == linux || $system == mac) ] |
438 *: Skip | 423 *: Skip |
439 | 424 |
440 [ $component == webdriver && $browser == safari && ($system == linux || $system
== windows) ] | 425 [ $runtime == safari && ($system == linux || $system == windows) ] |
441 *: Skip | 426 *: Skip |
442 | 427 |
443 | 428 [ ($compiler == frog || $compiler == frogsh) && $unchecked ] |
444 [ ($component == frogsh || $component == frog || $component == frogium) && $unc
hecked ] | |
445 PrivateMemberTest/01: Fail # test seems bad - see issue #353 | 429 PrivateMemberTest/01: Fail # test seems bad - see issue #353 |
446 PrivateMemberTest/02: Fail # test seems bad - see issue #353 | 430 PrivateMemberTest/02: Fail # test seems bad - see issue #353 |
447 PrivateMemberTest/03: Fail # test seems bad - see issue #353 | 431 PrivateMemberTest/03: Fail # test seems bad - see issue #353 |
448 PrivateMemberTest/04: Fail # test seems bad - see issue #353 | 432 PrivateMemberTest/04: Fail # test seems bad - see issue #353 |
449 | 433 |
450 [ ($component == frogsh || $component == frog || $component == frogium) && $che
cked ] | 434 [ ($compiler == frog || $compiler == frogsh) && $checked ] |
451 PrivateMemberTest/none: Fail # test seems bad - see issue #353 | 435 PrivateMemberTest/none: Fail # test seems bad - see issue #353 |
452 AssignStaticTypeTest/01: Fail # Unrecognized option: --no-enable-type-checks. | 436 AssignStaticTypeTest/01: Fail # Unrecognized option: --no-enable-type-checks. |
453 AssignStaticTypeTest/02: Fail # Unrecognized option: --no-enable-type-checks. | 437 AssignStaticTypeTest/02: Fail # Unrecognized option: --no-enable-type-checks. |
454 AssignStaticTypeTest/03: Fail # Unrecognized option: --no-enable-type-checks. | 438 AssignStaticTypeTest/03: Fail # Unrecognized option: --no-enable-type-checks. |
455 AssignStaticTypeTest/04: Fail # Unrecognized option: --no-enable-type-checks. | 439 AssignStaticTypeTest/04: Fail # Unrecognized option: --no-enable-type-checks. |
456 TypeVariableBoundsTest/01: Fail # Issue 2135 | 440 TypeVariableBoundsTest/01: Fail # Issue 2135 |
457 TypeVariableBoundsTest/02: Fail # Issue 2135 | 441 TypeVariableBoundsTest/02: Fail # Issue 2135 |
458 TypeVariableBoundsTest/05: Fail # Issue 2135 | 442 TypeVariableBoundsTest/05: Fail # Issue 2135 |
459 TypeVariableBounds2Test/00: Fail # Issue 2135 | 443 TypeVariableBounds2Test/00: Fail # Issue 2135 |
460 TypeVariableBounds2Test/03: Fail # Issue 2135 | 444 TypeVariableBounds2Test/03: Fail # Issue 2135 |
461 TypeVariableBounds2Test/05: Fail # Issue 2135 | 445 TypeVariableBounds2Test/05: Fail # Issue 2135 |
462 | 446 |
463 [ $component == frog || $component == frogsh ] | 447 [ ($compiler == frog || $compiler == frogsh) && $runtime == d8 ] |
464 # these tests are inconsistent in frogium and frogsh-node, investigate | 448 # these tests are inconsistent in frogium and frogsh-node, investigate |
465 StaticField1RunNegativeTest: Pass | 449 StaticField1RunNegativeTest: Pass |
466 StaticField2RunNegativeTest: Pass | 450 StaticField2RunNegativeTest: Pass |
467 SyntaxTest/28: Fail # Issue 1109 | 451 SyntaxTest/28: Fail # Issue 1109 |
468 SyntaxTest/29: Fail # Issue 1109 | 452 SyntaxTest/29: Fail # Issue 1109 |
469 SyntaxTest/31: Fail # Issue 1109 | 453 SyntaxTest/31: Fail # Issue 1109 |
470 SyntaxTest/32: Fail # Issue 1109 | 454 SyntaxTest/32: Fail # Issue 1109 |
471 SyntaxTest/33: Fail # Issue 1109 | 455 SyntaxTest/33: Fail # Issue 1109 |
472 LiteralUnaryPlusTest/01: Fail # Issue 1400 | 456 LiteralUnaryPlusTest/01: Fail # Issue 1400 |
473 | 457 |
474 [ $component == frog || $component == frogsh || $component == frogium || $compon
ent == webdriver ] | 458 [ $compiler == frog || $compiler == frogsh ] |
475 StringEscape3NegativeTest: Fail # Issue 1352 | 459 StringEscape3NegativeTest: Fail # Issue 1352 |
476 | 460 |
477 [ $component == frogium ] | 461 [ $compiler == frog && $runtime == drt ] |
478 # these tests are inconsistent in frogium and frogsh-node, investigate | 462 # these tests are inconsistent in frogium and frogsh-node, investigate |
479 StaticField1RunNegativeTest: Pass # but error is not correct | 463 StaticField1RunNegativeTest: Pass # but error is not correct |
480 StaticField2RunNegativeTest: Pass # but error is not correct | 464 StaticField2RunNegativeTest: Pass # but error is not correct |
481 | 465 |
482 [ $component == frog && $mode == debug ] | 466 [ $compiler == frog && $mode == debug ] |
483 ConstructorRedirect1NegativeTest: Skip # Undiagnosed infinite loop. | 467 ConstructorRedirect1NegativeTest: Skip # Undiagnosed infinite loop. |
484 ConstructorRedirect2NegativeTest: Skip # Undiagnosed infinite loop. | 468 ConstructorRedirect2NegativeTest: Skip # Undiagnosed infinite loop. |
485 | 469 |
486 [ $arch == simarm ] | 470 [ $arch == simarm ] |
487 *: Skip | 471 *: Skip |
488 | 472 |
489 [ $arch == arm ] | 473 [ $arch == arm ] |
490 *: Skip | 474 *: Skip |
491 | 475 |
OLD | NEW |