Index: tools/testing/perf_testing/perf_README.txt |
=================================================================== |
--- tools/testing/perf_testing/perf_README.txt (revision 4909) |
+++ tools/testing/perf_testing/perf_README.txt (working copy) |
@@ -1,123 +0,0 @@ |
-Setup to run all performance tests: |
- |
-TODO(efortuna): run through these steps again on a clean machine to make sure I |
-didn't leave anything out! |
- |
-Overview: |
- These are the instructions to run a wide variety of performance tests using |
- dart/tools/testing/perf_testing/create_graph.py. Currently the results are |
- uploaded to https://dartperf.googleplex.com/. |
- |
- A variant of these tests are running on our buildbots to test Chrome and |
- Firefox (since the buildbots are Linux) that simply ensure that no changes to |
- frog have broken updating the dom, but not for testing performance. |
- |
- This file details how to set up configurations for each setup. It is long, |
- because there are many variants depending on what platform you're on, and what |
- you want to set up. |
- |
-============ Windows Installation ============= |
- |
-Setting up Windows on Mac hardware: |
- If you need to install Windows 7 via dual-boot mac, use BootCamp to install |
- Windows 7 Professional. You can obtain a copy of Windows 7 (Google internal) |
- by getting an MSDN subscription via GUTS. When installing via BootCamp, don't |
- forget to also install the "WindowsSupport" drivers that are optional -- |
- you'll need them to be able to connect to any wireless network in Windows. |
- |
-Great! You have a shiny dual-booting machine! |
- |
-Use the following instructions to set up for Windows builds: |
-http://www.chromium.org/developers/how-tos/build-instructions-windows |
- |
-NOTE: DO NOT USE Visual Studio 2010 to try to build the project!! Right now Dart |
-only builds with VS2008 versions! |
- |
-Then: |
-1) Download installer for OpenSSL for Windows via |
- http://openssl.org/related/binaries.html |
-2) Install OpenSSL |
-3) Copy the directory OpenSSL-Win32/include/openssl to |
- C:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\include |
-4) Copy the ***contents*** of the directory OpenSSL-Win32/lib/VC/static/ to |
- C:\Program Files (x86)\Microsoft Visual Studio 9.0\VC\lib |
- |
-============= All Platforms ================ |
- |
-1) Ensure Python 2.7 is installed and in your path. |
- |
-2) Run the following command while standing in this directory: |
- $> sudo buildbot_browser_test_setup.sh |
- |
- If that doesn't work, or you're running Windows, here are the manual steps: |
- a) Install selenium library python bindings |
- (http://pypi.python.org/pypi/selenium) |
- b) Ensure Firefox is installed. |
- |
-3) Mac only: |
- Download and install xcode 3.2: |
- https://developer.apple.com/devcenter/download.action?path=/Developer_Tools/xcode_3.2.6_and_ios_sdk_4.3__final/xcode_3.2.6_and_ios_sdk_4.3.dmg |
- a) Mount dmg |
- b) LION only: At a terminal type: |
- TODO(efortuna): verify |
- $> export COMMAND_LINE_INSTALL=1 |
- $> open "/Volumes/Xcode and iOS SDK/Xcode and iOS SDK.mpkg" |
- c) Install. |
- |
-4) (Mac OS Lion only) Install xcode 4.0 and then run: |
- $> xcode-select -switch /path/to/xcode3.2.6/ |
- |
-5) Ensure Java is installed and in your path. If not, install the Java jdk |
- (so that we can run the webdriver server from its jar) |
- |
-6) Download selenium-server-standalone-2.15.0.jar (only to run Safari) |
- http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar |
- and run it: |
- $> java -jar selenium-server-standalone-2.15.0.jar |
- |
-7) Ensure that Chrome, Safari and IE (Windows only) are installed. |
- |
-8)Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list |
- and make sure it is in your path. |
- |
-9) a) Disable pop-up blocking in Safari: |
- Preferences -> Security -> (unselect) Block pop-up windows. |
- b) copy the file in /Library/Preferences/com.apple.Safari.plist to |
- $DARTDIR/tools/testing/com.apple.Safari.plist |
- (We do this because Safari deletes our preferences (on no pop-up |
- blocking) if it crashes (aka times out) two times in a row.) |
- |
-If you just want smoketests, you're done! Run them by typing: |
- |
-$> tools/testing/bin/$YOUR_OS_DIR/dart tools/test.dart --component=webdriver |
---report --timeout=20 --mode=release --browser=[ff | safari | chrome | ie] |
-[--frog=path/to/frog/executable/like/Release_ia32/dart-sdk/frogc |
---froglib=path/to/frog/lib/like/dart/frog/lib] test_to_run(like "language" or |
-"corelib") |
- |
-(If you don't specify frog and froglib arguments, we default to using the frogsh |
-living in your frog directory.) |
- |
-========= Proceed further only if you also want to run performance tests.====== |
- |
-10)Download appengine for Python and place it in third_party (http://code.google.com/appengine/downloads.html#Google_App_Engine_SDK_for_Python): |
- "dart/third_party/appengine-python/" |
- |
-11)Install matplotlib http://matplotlib.sourceforge.net/ |
- |
-12)Pull down benchmarks from internal repo (Google only): |
- http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/README.txt?view=markup |
- |
-13)TODO(efortuna): Deal with appengine check in! Run |
- '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' |
- while standing in dart/tools/testing/perf_tests. |
- |
-14) Run the tests! While standing in dart/tools/testing/perf_testing, run |
- $> python create_graph.py --forever --verbose |
- to run all the tests (browser performance, language correctness in the |
- browser, command line performance, and self-hosted compile time and compiled |
- code size). |
- |
- You can run individual tests by adding the particular option (such as |
- --language) when running create_graph.py. Type "create_graph.py -h" for a |
- full list of the options. |