Update browser testing readme.

tools/testing/perf_testing/perf_README.txt

 Setup to run all performance tests:
 
 TODO(efortuna): run through these steps again on a clean machine to make sure I
 didn't leave anything out!
 
 Overview:
  These are the instructions to run a wide variety of performance tests using 
  dart/tools/testing/perf_testing/create_graph.py. Currently the results are 
  uploaded to https://dartperf.googleplex.com/. 
  
@@ skipping 28 matching lines @@
 2) Install OpenSSL
 3) Copy the directory OpenSSL-Win32/include/openssl to 
    C:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\include
 4) Copy the ***contents*** of the directory OpenSSL-Win32/lib/VC/static/ to 
    C:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\lib
 
 ============= All Platforms ================
 
 1) Ensure Python 2.7 is installed and in your path.
 
-2) Install selenium library python bindings
-     (http://pypi.python.org/pypi/selenium)
+2) Run the following command while standing in this directory:
+     $> sudo buildbot_browser_test_setup.sh
+     
+     If that doesn't work, or you're running Windows, here are the manual steps:
+     a) Install selenium library python bindings
+        (http://pypi.python.org/pypi/selenium)
+     b) Ensure Firefox is installed.
 
 3) Mac only:
      Download and install xcode 3.2: 
      https://developer.apple.com/devcenter/download.action?path=/Developer_Tools/xcode_3.2.6_and_ios_sdk_4.3__final/xcode_3.2.6_and_ios_sdk_4.3.dmg
        a) Mount dmg
        b) LION only: At a terminal type:
        TODO(efortuna): verify
           $> export COMMAND_LINE_INSTALL=1
           $> open "/Volumes/Xcode and iOS SDK/Xcode and iOS SDK.mpkg"
        c) Install.
 
 4) (Mac OS Lion only) Install xcode 4.0 and then run:
    $> xcode-select -switch /path/to/xcode3.2.6/
 
-5) Ensure Firefox is installed.
-
-If you only want to run the smoketests, you're done! 
-While standing in dart/tools/testing/perf_testing, run 
-$> python create_graph.py -b
-If everything goes well, you'll see it print out "PASS" at the command line.
-
-To continue on to run the performance tests:
-
-6) Ensure Java is installed and in your path. If not, install the  Java jdk 
+5) Ensure Java is installed and in your path. If not, install the  Java jdk 
    (so that we can run the webdriver server from its jar)
 
-7) Add the following to your DEPS file in all.deps in the "deps = {" section:
-  # Copy of Python appengine latest release version             
-  "dart/third_party/appengine-python/1.5.4":            
-    "http://googleappengine.googlecode.com/svn/trunk/python@199",
-
-8) Download selenium-server-standalone-2.15.0.jar (only to run Safari) 
+6) Download selenium-server-standalone-2.15.0.jar (only to run Safari) 
    http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar 
    and run it:
    $> java -jar selenium-server-standalone-2.15.0.jar
 
-9) Ensure that Chrome, Safari and IE (Windows only) are installed.
+7) Ensure that Chrome, Safari and IE (Windows only) are installed.
 
-10)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list
+8)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list
    and make sure it is in your path.
 
-11) a) Disable pop-up blocking in Safari: 
+9) a) Disable pop-up blocking in Safari: 
        Preferences -> Security -> (unselect) Block pop-up windows.
     b) copy the file in /Library/Preferences/com.apple.Safari.plist to 
        $DARTDIR/tools/testing/com.apple.Safari.plist
        (We do this because Safari deletes our preferences (on no pop-up 
        blocking) if it crashes (aka times out) two times in a row.)
 
-12)TODO(efortuna): Deal with appengine check in! Run 
+If you just want smoketests, you're done! Run them by typing:
+
+$> tools/testing/bin/$YOUR_OS_DIR/dart tools/test.dart --component=webdriver
+--report --timeout=20 --mode=release --browser=[ff | safari | chrome | ie]
+[--frog=path/to/frog/executable/like/Release_ia32/dart-sdk/frogc
+--froglib=path/to/frog/lib/like/dart/frog/lib]
+
+(If you don't specify frog and froglib arguments, we default to using the frogsh
+living in your frog directory.)
+
+========= Proceed further only if you also want to run performance tests.======
+
+10)Add the following to your DEPS file in all.deps in the "deps = {" section:
+  # Copy of Python appengine latest release version
+  "dart/third_party/appengine-python/1.5.4":
+    "http://googleappengine.googlecode.com/svn/trunk/python@199",

[Siggi Cherem (dart-lang), 2012/01/23 00:15:03]

could we instead just download the latest distribution package from appengine
(e.g. a tar ball), so that we don't have to edit the DEPS file? 

[Emily Fortuna, 2012/01/23 16:53:04]

You're right. This was just as appengine was being taken out of the repository.
I'll change this.


On 2012/01/23 00:15:03, sigmund wrote:

+
+11)Install matplotlib http://matplotlib.sourceforge.net/
+
+12)Pull down benchmarks from internal repo (Google only): 
+   http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/README.txt?view=markup
+
+13)TODO(efortuna): Deal with appengine check in! Run 
    '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' 
    while standing in dart/tools/testing/perf_tests.
 
-13)Install matplotlib http://matplotlib.sourceforge.net/
-
-14)Pull down benchmarks from internal repo (Google only): 
-   http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/README.txt?view=markup
-
-15) Run the tests! While standing in dart/tools/testing/perf_testing, run 
-    $> python create_graph.py --forever --verbose --perfbot 
+14) Run the tests! While standing in dart/tools/testing/perf_testing, run 
+    $> python create_graph.py --forever --verbose 
     to run all the tests (browser performance, language correctness in the
     browser, command line performance, and self-hosted compile time and compiled
     code size). 
     
     You can run individual tests by adding the particular option (such as 
     --language) when running create_graph.py. Type "create_graph.py -h" for a 
     full list of the options.