OLD | NEW |
---|---|
1 Setup to run all performance tests: | 1 Setup to run all performance tests: |
2 | 2 |
3 TODO(efortuna): run through these steps again on a clean machine to make sure I | 3 TODO(efortuna): run through these steps again on a clean machine to make sure I |
4 didn't leave anything out! | 4 didn't leave anything out! |
5 | 5 |
6 Overview: | 6 Overview: |
7 These are the instructions to run a wide variety of performance tests using | 7 These are the instructions to run a wide variety of performance tests using |
8 dart/tools/testing/perf_testing/create_graph.py. Currently the results are | 8 dart/tools/testing/perf_testing/create_graph.py. Currently the results are |
9 uploaded to https://dartperf.googleplex.com/. | 9 uploaded to https://dartperf.googleplex.com/. |
10 | 10 |
(...skipping 71 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... | |
82 8) Download selenium-server-standalone-2.15.0.jar (only to run Safari) | 82 8) Download selenium-server-standalone-2.15.0.jar (only to run Safari) |
83 http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar | 83 http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar |
84 and run it: | 84 and run it: |
85 $> java -jar selenium-server-standalone-2.15.0.jar | 85 $> java -jar selenium-server-standalone-2.15.0.jar |
86 | 86 |
87 9) Ensure that Chrome, Safari and IE (Windows only) are installed. | 87 9) Ensure that Chrome, Safari and IE (Windows only) are installed. |
88 | 88 |
89 10)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list | 89 10)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list |
90 and make sure it is in your path. | 90 and make sure it is in your path. |
91 | 91 |
92 10)Disable pop-up blocking in Safari: | 92 11) a) Disable pop-up blocking in Safari: |
93 Preferences -> Security -> (unselect) Block pop-up windows. | 93 Preferences -> Security -> (unselect) Block pop-up windows. |
94 b) copy the file in /Library/Preferences/com.apple.Safari.plist to $DARTDIR/ tools/testing/com.apple.Safari.plist | |
Emily Fortuna
2012/01/18 01:12:37
Yes, this is horribly hack-tastic. It's the best I
Siggi Cherem (dart-lang)
2012/01/18 01:35:16
yikes!, it's ok for now, feel free to add a TODO s
Jennifer Messerly
2012/01/18 01:35:51
we could try saving a copy of the plist file, and/
Emily Fortuna
2012/01/18 02:20:36
The plist file is some binary format from what I c
Siggi Cherem (dart-lang)
2012/01/18 02:27:09
I think it's ok, maybe we want to guard this in a
Emily Fortuna
2012/01/18 02:31:26
True. I was working under the [bad] assumption tha
| |
95 (We do this because Safari deletes our preferences (on no pop-up | |
Jennifer Messerly
2012/01/18 01:35:51
mismatched parens ;)
Emily Fortuna
2012/01/18 02:20:36
Done.
| |
96 blocking) if it crashes (aka times out) two times in a row. | |
94 | 97 |
95 11)TODO(efortuna): Deal with appengine check in! Run | 98 12)TODO(efortuna): Deal with appengine check in! Run |
96 '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' | 99 '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' |
97 while standing in dart/tools/testing/perf_tests. | 100 while standing in dart/tools/testing/perf_tests. |
98 | 101 |
99 12)Install matplotlib http://matplotlib.sourceforge.net/ | 102 13)Install matplotlib http://matplotlib.sourceforge.net/ |
100 | 103 |
101 13)Pull down benchmarks from internal repo (Google only): | 104 14)Pull down benchmarks from internal repo (Google only): |
102 http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/ README.txt?view=markup | 105 http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/ README.txt?view=markup |
103 | 106 |
104 14) Run the tests! While standing in dart/tools/testing/perf_testing, run | 107 15) Run the tests! While standing in dart/tools/testing/perf_testing, run |
105 $> python create_graph.py --forever --verbose --perfbot | 108 $> python create_graph.py --forever --verbose --perfbot |
106 to run all the tests (browser performance, language correctness in the | 109 to run all the tests (browser performance, language correctness in the |
107 browser, command line performance, and self-hosted compile time and compiled | 110 browser, command line performance, and self-hosted compile time and compiled |
108 code size). | 111 code size). |
109 | 112 |
110 You can run individual tests by adding the particular option (such as | 113 You can run individual tests by adding the particular option (such as |
111 --language) when running create_graph.py. Type "create_graph.py -h" for a | 114 --language) when running create_graph.py. Type "create_graph.py -h" for a |
112 full list of the options. | 115 full list of the options. |
OLD | NEW |