Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(510)

Issue 10910256: Mark flaky test as such. (Closed)

Created:
8 years, 3 months ago by ahe
Modified:
8 years, 3 months ago
CC:
reviews_dartlang.org
Visibility:
Public.

Description

Mark flaky test as such. Committed: https://code.google.com/p/dart/source/detail?r=12341

Patch Set 1 #

Unified diffs Side-by-side diffs Delta from patch set Stats (+2 lines, -0 lines) Patch
M dart/tests/html/html.status View 1 chunk +2 lines, -0 lines 0 comments Download

Messages

Total messages: 6 (0 generated)
ahe
TBR'ed
8 years, 3 months ago (2012-09-13 17:40:51 UTC) #1
Bob Nystrom
LGTM
8 years, 3 months ago (2012-09-13 17:42:28 UTC) #2
Emily Fortuna
please don't commit. Please see Issue http://code.google.com/p/dart/issues/detail?id=5152 first.
8 years, 3 months ago (2012-09-13 17:43:40 UTC) #3
ahe
On 2012/09/13 17:43:40, Emily Fortuna wrote: > please don't commit. Please see Issue > http://code.google.com/p/dart/issues/detail?id=5152 ...
8 years, 3 months ago (2012-09-13 17:47:47 UTC) #4
ricow1
On 2012/09/13 17:47:47, ahe wrote: > On 2012/09/13 17:43:40, Emily Fortuna wrote: > > please ...
8 years, 3 months ago (2012-09-13 17:52:42 UTC) #5
ahe
8 years, 3 months ago (2012-09-13 18:33:18 UTC) #6
On 2012/09/13 17:52:42, ricow1 wrote:
> On 2012/09/13 17:47:47, ahe wrote:
> > On 2012/09/13 17:43:40, Emily Fortuna wrote:
> > > please don't commit. Please see Issue
> > > http://code.google.com/p/dart/issues/detail?id=5152 first.
> > 
> > I did already commit. I'll investigate further.
> 
> Emily: Just currious here: Any guesses as to why this particular test is
flaking
> so much? If this specific test is really this flaky I assume that we would
often
> get a false negative even when rerunning it? Since we don't have a flakiness
> dashboard like chromium we have to catch these by hand I guess (I am not
> implying that I would like a flakiness dashboard :-) )

As far as I can tell, html/window_open is really flaky. The problem is that it
tries to inject some JS code:

  evaluateJavaScript('(testRunner ||
layoutTestController).setCanOpenWindows()');

This will lead to a call to setCanOpenWindows() on undefined in selenium where
testRunner and layoutTestController aren't defined.

I'm actually seeing this being a problem when I run this test in chrome and hit
reload: test_controller.js does write FAIL, but the unittest framework overrides
the output with document.body.innerHTML.

Powered by Google App Engine
This is Rietveld 408576698