Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(344)

Side by Side Diff: tools/testing/perf_testing/perf_README.txt

Issue 9252002: Make changes for Safari to run with webdriver on the bots. (Closed) Base URL: http://dart.googlecode.com/svn/branches/bleeding_edge/dart/
Patch Set: '' Created 8 years, 11 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View unified diff | Download patch | Annotate | Revision Log
OLDNEW
1 Setup to run all performance tests: 1 Setup to run all performance tests:
2 2
3 TODO(efortuna): run through these steps again on a clean machine to make sure I 3 TODO(efortuna): run through these steps again on a clean machine to make sure I
4 didn't leave anything out! 4 didn't leave anything out!
5 5
6 Overview: 6 Overview:
7 These are the instructions to run a wide variety of performance tests using 7 These are the instructions to run a wide variety of performance tests using
8 dart/tools/testing/perf_testing/create_graph.py. Currently the results are 8 dart/tools/testing/perf_testing/create_graph.py. Currently the results are
9 uploaded to https://dartperf.googleplex.com/. 9 uploaded to https://dartperf.googleplex.com/.
10 10
(...skipping 71 matching lines...) Expand 10 before | Expand all | Expand 10 after
82 8) Download selenium-server-standalone-2.15.0.jar (only to run Safari) 82 8) Download selenium-server-standalone-2.15.0.jar (only to run Safari)
83 http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar 83 http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar
84 and run it: 84 and run it:
85 $> java -jar selenium-server-standalone-2.15.0.jar 85 $> java -jar selenium-server-standalone-2.15.0.jar
86 86
87 9) Ensure that Chrome, Safari and IE (Windows only) are installed. 87 9) Ensure that Chrome, Safari and IE (Windows only) are installed.
88 88
89 10)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list 89 10)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list
90 and make sure it is in your path. 90 and make sure it is in your path.
91 91
92 10)Disable pop-up blocking in Safari: 92 11) a) Disable pop-up blocking in Safari:
93 Preferences -> Security -> (unselect) Block pop-up windows. 93 Preferences -> Security -> (unselect) Block pop-up windows.
94 b) copy the file in /Library/Preferences/com.apple.Safari.plist to $DARTDIR/ tools/testing/com.apple.Safari.plist
Emily Fortuna 2012/01/18 01:12:37 Yes, this is horribly hack-tastic. It's the best I
Siggi Cherem (dart-lang) 2012/01/18 01:35:16 yikes!, it's ok for now, feel free to add a TODO s
Jennifer Messerly 2012/01/18 01:35:51 we could try saving a copy of the plist file, and/
Emily Fortuna 2012/01/18 02:20:36 The plist file is some binary format from what I c
Siggi Cherem (dart-lang) 2012/01/18 02:27:09 I think it's ok, maybe we want to guard this in a
Emily Fortuna 2012/01/18 02:31:26 True. I was working under the [bad] assumption tha
95 (We do this because Safari deletes our preferences (on no pop-up
Jennifer Messerly 2012/01/18 01:35:51 mismatched parens ;)
Emily Fortuna 2012/01/18 02:20:36 Done.
96 blocking) if it crashes (aka times out) two times in a row.
94 97
95 11)TODO(efortuna): Deal with appengine check in! Run 98 12)TODO(efortuna): Deal with appengine check in! Run
96 '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' 99 '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/'
97 while standing in dart/tools/testing/perf_tests. 100 while standing in dart/tools/testing/perf_tests.
98 101
99 12)Install matplotlib http://matplotlib.sourceforge.net/ 102 13)Install matplotlib http://matplotlib.sourceforge.net/
100 103
101 13)Pull down benchmarks from internal repo (Google only): 104 14)Pull down benchmarks from internal repo (Google only):
102 http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/ README.txt?view=markup 105 http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/ README.txt?view=markup
103 106
104 14) Run the tests! While standing in dart/tools/testing/perf_testing, run 107 15) Run the tests! While standing in dart/tools/testing/perf_testing, run
105 $> python create_graph.py --forever --verbose --perfbot 108 $> python create_graph.py --forever --verbose --perfbot
106 to run all the tests (browser performance, language correctness in the 109 to run all the tests (browser performance, language correctness in the
107 browser, command line performance, and self-hosted compile time and compiled 110 browser, command line performance, and self-hosted compile time and compiled
108 code size). 111 code size).
109 112
110 You can run individual tests by adding the particular option (such as 113 You can run individual tests by adding the particular option (such as
111 --language) when running create_graph.py. Type "create_graph.py -h" for a 114 --language) when running create_graph.py. Type "create_graph.py -h" for a
112 full list of the options. 115 full list of the options.
OLDNEW

Powered by Google App Engine
This is Rietveld 408576698