Chromium Code Reviews| Index: tools/testing/perf_testing/perf_README.txt |
| =================================================================== |
| --- tools/testing/perf_testing/perf_README.txt (revision 3470) |
| +++ tools/testing/perf_testing/perf_README.txt (working copy) |
| @@ -46,8 +46,13 @@ |
| 1) Ensure Python 2.7 is installed and in your path. |
| -2) Install selenium library python bindings |
| - (http://pypi.python.org/pypi/selenium) |
| +2) Run the following command while standing in this directory: |
| + $> sudo buildbot_browser_test_setup.sh |
| + |
| + If that doesn't work, or you're running Windows, here are the manual steps: |
| + a) Install selenium library python bindings |
| + (http://pypi.python.org/pypi/selenium) |
| + b) Ensure Firefox is installed. |
| 3) Mac only: |
| Download and install xcode 3.2: |
| @@ -62,51 +67,54 @@ |
| 4) (Mac OS Lion only) Install xcode 4.0 and then run: |
| $> xcode-select -switch /path/to/xcode3.2.6/ |
| -5) Ensure Firefox is installed. |
| - |
| -If you only want to run the smoketests, you're done! |
| -While standing in dart/tools/testing/perf_testing, run |
| -$> python create_graph.py -b |
| -If everything goes well, you'll see it print out "PASS" at the command line. |
| - |
| -To continue on to run the performance tests: |
| - |
| -6) Ensure Java is installed and in your path. If not, install the Java jdk |
| +5) Ensure Java is installed and in your path. If not, install the Java jdk |
| (so that we can run the webdriver server from its jar) |
| -7) Add the following to your DEPS file in all.deps in the "deps = {" section: |
| - # Copy of Python appengine latest release version |
| - "dart/third_party/appengine-python/1.5.4": |
| - "http://googleappengine.googlecode.com/svn/trunk/python@199", |
| - |
| -8) Download selenium-server-standalone-2.15.0.jar (only to run Safari) |
| +6) Download selenium-server-standalone-2.15.0.jar (only to run Safari) |
| http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar |
| and run it: |
| $> java -jar selenium-server-standalone-2.15.0.jar |
| -9) Ensure that Chrome, Safari and IE (Windows only) are installed. |
| +7) Ensure that Chrome, Safari and IE (Windows only) are installed. |
| -10)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list |
| +8)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list |
| and make sure it is in your path. |
| -11) a) Disable pop-up blocking in Safari: |
| +9) a) Disable pop-up blocking in Safari: |
| Preferences -> Security -> (unselect) Block pop-up windows. |
| b) copy the file in /Library/Preferences/com.apple.Safari.plist to |
| $DARTDIR/tools/testing/com.apple.Safari.plist |
| (We do this because Safari deletes our preferences (on no pop-up |
| blocking) if it crashes (aka times out) two times in a row.) |
| -12)TODO(efortuna): Deal with appengine check in! Run |
| - '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' |
| - while standing in dart/tools/testing/perf_tests. |
| +If you just want smoketests, you're done! Run them by typing: |
| -13)Install matplotlib http://matplotlib.sourceforge.net/ |
| +$> tools/testing/bin/$YOUR_OS_DIR/dart tools/test.dart --component=webdriver |
| +--report --timeout=20 --mode=release --browser=[ff | safari | chrome | ie] |
| +[--frog=path/to/frog/executable/like/Release_ia32/dart-sdk/frogc |
| +--froglib=path/to/frog/lib/like/dart/frog/lib] |
| -14)Pull down benchmarks from internal repo (Google only): |
| +(If you don't specify frog and froglib arguments, we default to using the frogsh |
| +living in your frog directory.) |
| + |
| +========= Proceed further only if you also want to run performance tests.====== |
| + |
| +10)Add the following to your DEPS file in all.deps in the "deps = {" section: |
| + # Copy of Python appengine latest release version |
| + "dart/third_party/appengine-python/1.5.4": |
| + "http://googleappengine.googlecode.com/svn/trunk/python@199", |
|
Siggi Cherem (dart-lang)
2012/01/23 00:15:03
could we instead just download the latest distribu
Emily Fortuna
2012/01/23 16:53:04
You're right. This was just as appengine was being
|
| + |
| +11)Install matplotlib http://matplotlib.sourceforge.net/ |
| + |
| +12)Pull down benchmarks from internal repo (Google only): |
| http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/README.txt?view=markup |
| -15) Run the tests! While standing in dart/tools/testing/perf_testing, run |
| - $> python create_graph.py --forever --verbose --perfbot |
| +13)TODO(efortuna): Deal with appengine check in! Run |
| + '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' |
| + while standing in dart/tools/testing/perf_tests. |
| + |
| +14) Run the tests! While standing in dart/tools/testing/perf_testing, run |
| + $> python create_graph.py --forever --verbose |
| to run all the tests (browser performance, language correctness in the |
| browser, command line performance, and self-hosted compile time and compiled |
| code size). |