Index: tools/testing/perf_testing/perf_README.txt |
=================================================================== |
--- tools/testing/perf_testing/perf_README.txt (revision 3470) |
+++ tools/testing/perf_testing/perf_README.txt (working copy) |
@@ -46,8 +46,13 @@ |
1) Ensure Python 2.7 is installed and in your path. |
-2) Install selenium library python bindings |
- (http://pypi.python.org/pypi/selenium) |
+2) Run the following command while standing in this directory: |
+ $> sudo buildbot_browser_test_setup.sh |
+ |
+ If that doesn't work, or you're running Windows, here are the manual steps: |
+ a) Install selenium library python bindings |
+ (http://pypi.python.org/pypi/selenium) |
+ b) Ensure Firefox is installed. |
3) Mac only: |
Download and install xcode 3.2: |
@@ -62,51 +67,54 @@ |
4) (Mac OS Lion only) Install xcode 4.0 and then run: |
$> xcode-select -switch /path/to/xcode3.2.6/ |
-5) Ensure Firefox is installed. |
- |
-If you only want to run the smoketests, you're done! |
-While standing in dart/tools/testing/perf_testing, run |
-$> python create_graph.py -b |
-If everything goes well, you'll see it print out "PASS" at the command line. |
- |
-To continue on to run the performance tests: |
- |
-6) Ensure Java is installed and in your path. If not, install the Java jdk |
+5) Ensure Java is installed and in your path. If not, install the Java jdk |
(so that we can run the webdriver server from its jar) |
-7) Add the following to your DEPS file in all.deps in the "deps = {" section: |
- # Copy of Python appengine latest release version |
- "dart/third_party/appengine-python/1.5.4": |
- "http://googleappengine.googlecode.com/svn/trunk/python@199", |
- |
-8) Download selenium-server-standalone-2.15.0.jar (only to run Safari) |
+6) Download selenium-server-standalone-2.15.0.jar (only to run Safari) |
http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar |
and run it: |
$> java -jar selenium-server-standalone-2.15.0.jar |
-9) Ensure that Chrome, Safari and IE (Windows only) are installed. |
+7) Ensure that Chrome, Safari and IE (Windows only) are installed. |
-10)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list |
+8)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list |
and make sure it is in your path. |
-11) a) Disable pop-up blocking in Safari: |
+9) a) Disable pop-up blocking in Safari: |
Preferences -> Security -> (unselect) Block pop-up windows. |
b) copy the file in /Library/Preferences/com.apple.Safari.plist to |
$DARTDIR/tools/testing/com.apple.Safari.plist |
(We do this because Safari deletes our preferences (on no pop-up |
blocking) if it crashes (aka times out) two times in a row.) |
-12)TODO(efortuna): Deal with appengine check in! Run |
- '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' |
- while standing in dart/tools/testing/perf_tests. |
+If you just want smoketests, you're done! Run them by typing: |
-13)Install matplotlib http://matplotlib.sourceforge.net/ |
+$> tools/testing/bin/$YOUR_OS_DIR/dart tools/test.dart --component=webdriver |
+--report --timeout=20 --mode=release --browser=[ff | safari | chrome | ie] |
+[--frog=path/to/frog/executable/like/Release_ia32/dart-sdk/frogc |
+--froglib=path/to/frog/lib/like/dart/frog/lib] |
-14)Pull down benchmarks from internal repo (Google only): |
+(If you don't specify frog and froglib arguments, we default to using the frogsh |
+living in your frog directory.) |
+ |
+========= Proceed further only if you also want to run performance tests.====== |
+ |
+10)Add the following to your DEPS file in all.deps in the "deps = {" section: |
+ # Copy of Python appengine latest release version |
+ "dart/third_party/appengine-python/1.5.4": |
+ "http://googleappengine.googlecode.com/svn/trunk/python@199", |
Siggi Cherem (dart-lang)
2012/01/23 00:15:03
could we instead just download the latest distribu
Emily Fortuna
2012/01/23 16:53:04
You're right. This was just as appengine was being
|
+ |
+11)Install matplotlib http://matplotlib.sourceforge.net/ |
+ |
+12)Pull down benchmarks from internal repo (Google only): |
http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/README.txt?view=markup |
-15) Run the tests! While standing in dart/tools/testing/perf_testing, run |
- $> python create_graph.py --forever --verbose --perfbot |
+13)TODO(efortuna): Deal with appengine check in! Run |
+ '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' |
+ while standing in dart/tools/testing/perf_tests. |
+ |
+14) Run the tests! While standing in dart/tools/testing/perf_testing, run |
+ $> python create_graph.py --forever --verbose |
to run all the tests (browser performance, language correctness in the |
browser, command line performance, and self-hosted compile time and compiled |
code size). |