OLD | NEW |
---|---|
1 Setup to run all performance tests: | 1 Setup to run all performance tests: |
2 | 2 |
3 TODO(efortuna): run through these steps again on a clean machine to make sure I | 3 TODO(efortuna): run through these steps again on a clean machine to make sure I |
4 didn't leave anything out! | 4 didn't leave anything out! |
5 | 5 |
6 Overview: | 6 Overview: |
7 These are the instructions to run a wide variety of performance tests using | 7 These are the instructions to run a wide variety of performance tests using |
8 dart/tools/testing/perf_testing/create_graph.py. Currently the results are | 8 dart/tools/testing/perf_testing/create_graph.py. Currently the results are |
9 uploaded to https://dartperf.googleplex.com/. | 9 uploaded to https://dartperf.googleplex.com/. |
10 | 10 |
(...skipping 74 matching lines...) Expand 10 before | Expand all | Expand 10 after Loading... | |
85 b) copy the file in /Library/Preferences/com.apple.Safari.plist to | 85 b) copy the file in /Library/Preferences/com.apple.Safari.plist to |
86 $DARTDIR/tools/testing/com.apple.Safari.plist | 86 $DARTDIR/tools/testing/com.apple.Safari.plist |
87 (We do this because Safari deletes our preferences (on no pop-up | 87 (We do this because Safari deletes our preferences (on no pop-up |
88 blocking) if it crashes (aka times out) two times in a row.) | 88 blocking) if it crashes (aka times out) two times in a row.) |
89 | 89 |
90 If you just want smoketests, you're done! Run them by typing: | 90 If you just want smoketests, you're done! Run them by typing: |
91 | 91 |
92 $> tools/testing/bin/$YOUR_OS_DIR/dart tools/test.dart --component=webdriver | 92 $> tools/testing/bin/$YOUR_OS_DIR/dart tools/test.dart --component=webdriver |
93 --report --timeout=20 --mode=release --browser=[ff | safari | chrome | ie] | 93 --report --timeout=20 --mode=release --browser=[ff | safari | chrome | ie] |
94 [--frog=path/to/frog/executable/like/Release_ia32/dart-sdk/frogc | 94 [--frog=path/to/frog/executable/like/Release_ia32/dart-sdk/frogc |
95 --froglib=path/to/frog/lib/like/dart/frog/lib] | 95 --froglib=path/to/frog/lib/like/dart/frog/lib] test_to_run(like "language" or |
Emily Fortuna
2012/01/23 23:04:46
I incorporated your comments from this CL: https:/
| |
96 "corelib") | |
96 | 97 |
97 (If you don't specify frog and froglib arguments, we default to using the frogsh | 98 (If you don't specify frog and froglib arguments, we default to using the frogsh |
98 living in your frog directory.) | 99 living in your frog directory.) |
99 | 100 |
100 ========= Proceed further only if you also want to run performance tests.====== | 101 ========= Proceed further only if you also want to run performance tests.====== |
101 | 102 |
102 10)Add the following to your DEPS file in all.deps in the "deps = {" section: | 103 10)Download appengine for Python and place it in third_party (http://code.google .com/appengine/downloads.html#Google_App_Engine_SDK_for_Python): |
103 # Copy of Python appengine latest release version | 104 "dart/third_party/appengine-python/" |
104 "dart/third_party/appengine-python/1.5.4": | |
105 "http://googleappengine.googlecode.com/svn/trunk/python@199", | |
106 | 105 |
107 11)Install matplotlib http://matplotlib.sourceforge.net/ | 106 11)Install matplotlib http://matplotlib.sourceforge.net/ |
108 | 107 |
109 12)Pull down benchmarks from internal repo (Google only): | 108 12)Pull down benchmarks from internal repo (Google only): |
110 http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/ README.txt?view=markup | 109 http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/ README.txt?view=markup |
111 | 110 |
112 13)TODO(efortuna): Deal with appengine check in! Run | 111 13)TODO(efortuna): Deal with appengine check in! Run |
113 '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' | 112 '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' |
114 while standing in dart/tools/testing/perf_tests. | 113 while standing in dart/tools/testing/perf_tests. |
115 | 114 |
116 14) Run the tests! While standing in dart/tools/testing/perf_testing, run | 115 14) Run the tests! While standing in dart/tools/testing/perf_testing, run |
117 $> python create_graph.py --forever --verbose | 116 $> python create_graph.py --forever --verbose |
118 to run all the tests (browser performance, language correctness in the | 117 to run all the tests (browser performance, language correctness in the |
119 browser, command line performance, and self-hosted compile time and compiled | 118 browser, command line performance, and self-hosted compile time and compiled |
120 code size). | 119 code size). |
121 | 120 |
122 You can run individual tests by adding the particular option (such as | 121 You can run individual tests by adding the particular option (such as |
123 --language) when running create_graph.py. Type "create_graph.py -h" for a | 122 --language) when running create_graph.py. Type "create_graph.py -h" for a |
124 full list of the options. | 123 full list of the options. |
OLD | NEW |