| OLD | NEW |
| 1 Overview: | 1 Overview: |
| 2 These are the instructions to run a wide variety of browser tests using | 2 These are the instructions to run a wide variety of browser tests using |
| 3 test.dart --component=webdriver or | 3 test.dart or dart/tools/testing/perf_testing/run_perf_tests.py. Currently |
| 4 dart/tools/testing/perf_testing/run_perf_tests.py. Currently the results of | 4 the results of run_perf_tests are uploaded to |
| 5 run_perf_tests are uploaded to https://dartperf.googleplex.com/. | 5 https://dartperf.googleplex.com/. |
| 6 | 6 |
| 7 ============== Windows Setup ============== | 7 ========= General Browser Setup ========== |
| 8 | 8 |
| 9 Open Internet Explorer. Open the Internet Options dialog, and move to the | 9 See instructions on: |
| 10 "Security" tab. Click through Internet, Local Intranet, Trusted sites, and | 10 https://code.google.com/p/dart/wiki/BrowserTestSetup |
| 11 Restricted site and ensure the "Enable Protected Mode" is checked for all zones | |
| 12 or unchecked for all zones. Then click to the "Advanced" tab, scroll down to the | |
| 13 "Security" section, and check the checkbox "Allow active content to run in files | |
| 14 on My Computer." | |
| 15 | |
| 16 ================ Mac Setup ================ | |
| 17 | |
| 18 1) Ensure Java is installed and in your path (if you want to run Safari). If | |
| 19 not, install the Java jdk (so that we can run the webdriver server from its | |
| 20 jar) | |
| 21 | |
| 22 2) a) Disable pop-up blocking in Safari: | |
| 23 Preferences -> Security -> (unselect) Block pop-up windows. | |
| 24 b) copy the file in /Library/Preferences/com.apple.Safari.plist to | |
| 25 $DARTDIR/tools/testing/com.apple.Safari.plist | |
| 26 (We do this because Safari deletes our preferences (on no pop-up | |
| 27 blocking) if it crashes (aka times out) two times in a row.) | |
| 28 | |
| 29 ============= All Platforms ================ | |
| 30 | |
| 31 THE EASISET WAY: | |
| 32 1) Ensure Python 2.7 is installed and in your path. | |
| 33 2) Download and install Chrome in the default location if you haven't done so | |
| 34 already. | |
| 35 3) Run the following script as root/administrator while standing in this | |
| 36 directory: | |
| 37 $> [sudo] python dart/tools/testing/perf_testing/webdriver_test_setup.py | |
| 38 4) Profit! | |
| 39 | |
| 40 Example Run: | |
| 41 $> tools/test.py --component=webdriver --report --timeout=20 --mode=release | |
| 42 --browser=[ff | safari | chrome | ie] | |
| 43 [--frog=path/to/frog/executable/like/Release_ia32/dart-sdk/frogc | |
| 44 --froglib=path/to/frog/lib/like/dart/frog/lib] test_to_run(like "language" or | |
| 45 "corelib") | |
| 46 | |
| 47 (If you don't specify frog and froglib arguments, we default to using frog with | |
| 48 the VM.) | |
| 49 | |
| 50 | |
| 51 ============================================ | |
| 52 Okay, so you're still here? Here's the long version of what that script does if | |
| 53 it didn't work for you: | |
| 54 a) Install selenium library python bindings | |
| 55 (http://pypi.python.org/pypi/selenium) | |
| 56 | |
| 57 b) Ensure that Firefox is installed in the default location. | |
| 58 | |
| 59 c) Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list | |
| 60 and make sure it is in your path. | |
| 61 | |
| 62 d) Download the selenium server (version 2.15 or newer) and place it in this | |
| 63 directory: | |
| 64 http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar | |
| 65 | |
| 66 | 11 |
| 67 ========= Proceed further only if you also want to run performance tests.====== | 12 ========= Proceed further only if you also want to run performance tests.====== |
| 68 | 13 |
| 69 10)Download appengine for Python and place it in third_party (http://code.google
.com/appengine/downloads.html#Google_App_Engine_SDK_for_Python): | 14 1) Download appengine for Python and place it in third_party (http://code.google
.com/appengine/downloads.html#Google_App_Engine_SDK_for_Python): |
| 70 "dart/third_party/appengine-python/" | 15 "dart/third_party/appengine-python/" |
| 71 | 16 |
| 72 11)Install matplotlib http://matplotlib.sourceforge.net/ | 17 2) Install matplotlib http://matplotlib.sourceforge.net/ |
| 73 | 18 |
| 74 12)Pull down benchmarks from internal repo (Google only): | 19 3) Pull down benchmarks from internal repo (Google only): |
| 75 http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/
README.txt?view=markup | 20 http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/
README.txt?view=markup |
| 76 | 21 |
| 77 13)Create a directory in called appengine-python in third_party. Download and | 22 4) Create a directory in called appengine-python in third_party. Download and |
| 78 install App Engine in the directory you just created. | 23 install App Engine in the directory you just created. |
| 79 http://code.google.com/appengine/downloads.html | 24 http://code.google.com/appengine/downloads.html |
| 80 | 25 |
| 81 14) Run the tests! While standing in dart/tools/testing/perf_testing, run | 26 5) Run the tests! While standing in dart/tools/testing/perf_testing, run |
| 82 $> python run_perf_tests.py --forever --verbose | 27 $> python run_perf_tests.py --forever --verbose |
| 83 to run all the tests (browser performance, language correctness in the | 28 to run all the tests (browser performance, language correctness in the |
| 84 browser, command line performance, and self-hosted compile time and compiled | 29 browser, command line performance, and self-hosted compile time and compiled |
| 85 code size). | 30 code size). |
| 86 | 31 |
| 87 You can run individual tests by adding the particular option (such as | 32 You can run individual tests by adding the particular option (such as |
| 88 --language) when running create_graph.py. Type "create_graph.py -h" for a | 33 --language) when running create_graph.py. Type "create_graph.py -h" for a |
| 89 full list of the options. | 34 full list of the options. |
| OLD | NEW |