Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(179)

Unified Diff: tools/testing/perf_testing/perf_README.txt

Issue 9272003: Update browser testing readme. (Closed) Base URL: http://dart.googlecode.com/svn/branches/bleeding_edge/dart/
Patch Set: '' Created 8 years, 11 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View side-by-side diff with in-line comments
Download patch
« no previous file with comments | « no previous file | no next file » | no next file with comments »
Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
Index: tools/testing/perf_testing/perf_README.txt
===================================================================
--- tools/testing/perf_testing/perf_README.txt (revision 3470)
+++ tools/testing/perf_testing/perf_README.txt (working copy)
@@ -46,8 +46,13 @@
1) Ensure Python 2.7 is installed and in your path.
-2) Install selenium library python bindings
- (http://pypi.python.org/pypi/selenium)
+2) Run the following command while standing in this directory:
+ $> sudo buildbot_browser_test_setup.sh
+
+ If that doesn't work, or you're running Windows, here are the manual steps:
+ a) Install selenium library python bindings
+ (http://pypi.python.org/pypi/selenium)
+ b) Ensure Firefox is installed.
3) Mac only:
Download and install xcode 3.2:
@@ -62,51 +67,54 @@
4) (Mac OS Lion only) Install xcode 4.0 and then run:
$> xcode-select -switch /path/to/xcode3.2.6/
-5) Ensure Firefox is installed.
-
-If you only want to run the smoketests, you're done!
-While standing in dart/tools/testing/perf_testing, run
-$> python create_graph.py -b
-If everything goes well, you'll see it print out "PASS" at the command line.
-
-To continue on to run the performance tests:
-
-6) Ensure Java is installed and in your path. If not, install the Java jdk
+5) Ensure Java is installed and in your path. If not, install the Java jdk
(so that we can run the webdriver server from its jar)
-7) Add the following to your DEPS file in all.deps in the "deps = {" section:
- # Copy of Python appengine latest release version
- "dart/third_party/appengine-python/1.5.4":
- "http://googleappengine.googlecode.com/svn/trunk/python@199",
-
-8) Download selenium-server-standalone-2.15.0.jar (only to run Safari)
+6) Download selenium-server-standalone-2.15.0.jar (only to run Safari)
http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar
and run it:
$> java -jar selenium-server-standalone-2.15.0.jar
-9) Ensure that Chrome, Safari and IE (Windows only) are installed.
+7) Ensure that Chrome, Safari and IE (Windows only) are installed.
-10)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list
+8)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list
and make sure it is in your path.
-11) a) Disable pop-up blocking in Safari:
+9) a) Disable pop-up blocking in Safari:
Preferences -> Security -> (unselect) Block pop-up windows.
b) copy the file in /Library/Preferences/com.apple.Safari.plist to
$DARTDIR/tools/testing/com.apple.Safari.plist
(We do this because Safari deletes our preferences (on no pop-up
blocking) if it crashes (aka times out) two times in a row.)
-12)TODO(efortuna): Deal with appengine check in! Run
- '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/'
- while standing in dart/tools/testing/perf_tests.
+If you just want smoketests, you're done! Run them by typing:
-13)Install matplotlib http://matplotlib.sourceforge.net/
+$> tools/testing/bin/$YOUR_OS_DIR/dart tools/test.dart --component=webdriver
+--report --timeout=20 --mode=release --browser=[ff | safari | chrome | ie]
+[--frog=path/to/frog/executable/like/Release_ia32/dart-sdk/frogc
+--froglib=path/to/frog/lib/like/dart/frog/lib]
-14)Pull down benchmarks from internal repo (Google only):
+(If you don't specify frog and froglib arguments, we default to using the frogsh
+living in your frog directory.)
+
+========= Proceed further only if you also want to run performance tests.======
+
+10)Add the following to your DEPS file in all.deps in the "deps = {" section:
+ # Copy of Python appengine latest release version
+ "dart/third_party/appengine-python/1.5.4":
+ "http://googleappengine.googlecode.com/svn/trunk/python@199",
Siggi Cherem (dart-lang) 2012/01/23 00:15:03 could we instead just download the latest distribu
Emily Fortuna 2012/01/23 16:53:04 You're right. This was just as appengine was being
+
+11)Install matplotlib http://matplotlib.sourceforge.net/
+
+12)Pull down benchmarks from internal repo (Google only):
http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/README.txt?view=markup
-15) Run the tests! While standing in dart/tools/testing/perf_testing, run
- $> python create_graph.py --forever --verbose --perfbot
+13)TODO(efortuna): Deal with appengine check in! Run
+ '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/'
+ while standing in dart/tools/testing/perf_tests.
+
+14) Run the tests! While standing in dart/tools/testing/perf_testing, run
+ $> python create_graph.py --forever --verbose
to run all the tests (browser performance, language correctness in the
browser, command line performance, and self-hosted compile time and compiled
code size).
« no previous file with comments | « no previous file | no next file » | no next file with comments »

Powered by Google App Engine
This is Rietveld 408576698