| OLD | NEW |
| (Empty) |
| 1 Overview: | |
| 2 These are the instructions to run a wide variety of browser tests using | |
| 3 test.dart --component=webdriver or | |
| 4 dart/tools/testing/perf_testing/create_graph.py. Currently the results of | |
| 5 create_graph are uploaded to https://dartperf.googleplex.com/. | |
| 6 | |
| 7 ============== Windows Setup ============== | |
| 8 | |
| 9 Open Internet Explorer. Open the Internet Options dialog, and move to the | |
| 10 "Security" tab. Click through Internet, Local Intranet, Trusted sites, and | |
| 11 Restricted site and ensure the "Enable Protected Mode" is checked for all zones | |
| 12 or unchecked for all zones. Then click to the "Advanced" tab, scroll down to the | |
| 13 "Security" section, and check the checkbox "Allow active content to run in files | |
| 14 on My Computer." | |
| 15 | |
| 16 ================ Mac Setup ================ | |
| 17 | |
| 18 1) Ensure Java is installed and in your path (if you want to run Safari). If | |
| 19 not, install the Java jdk (so that we can run the webdriver server from its | |
| 20 jar) | |
| 21 | |
| 22 2) a) Disable pop-up blocking in Safari: | |
| 23 Preferences -> Security -> (unselect) Block pop-up windows. | |
| 24 b) copy the file in /Library/Preferences/com.apple.Safari.plist to | |
| 25 $DARTDIR/tools/testing/com.apple.Safari.plist | |
| 26 (We do this because Safari deletes our preferences (on no pop-up | |
| 27 blocking) if it crashes (aka times out) two times in a row.) | |
| 28 | |
| 29 ============= All Platforms ================ | |
| 30 | |
| 31 THE EASISET WAY: | |
| 32 1) Ensure Python 2.7 is installed and in your path. | |
| 33 2) Download and install Chrome in the default location if you haven't done so | |
| 34 already. | |
| 35 3) Run the following script as root/administrator while standing in this | |
| 36 directory: | |
| 37 $> [sudo] python dart/tools/testing/perf_testing/webdriver_test_setup.py | |
| 38 4) Profit! | |
| 39 | |
| 40 Example Run: | |
| 41 $> tools/test.py --component=webdriver --report --timeout=20 --mode=release | |
| 42 --browser=[ff | safari | chrome | ie] | |
| 43 [--frog=path/to/frog/executable/like/Release_ia32/dart-sdk/frogc | |
| 44 --froglib=path/to/frog/lib/like/dart/frog/lib] test_to_run(like "language" or | |
| 45 "corelib") | |
| 46 | |
| 47 (If you don't specify frog and froglib arguments, we default to using frog with | |
| 48 the VM.) | |
| 49 | |
| 50 | |
| 51 ============================================ | |
| 52 Okay, so you're still here? Here's the long version of what that script does if | |
| 53 it didn't work for you: | |
| 54 a) Install selenium library python bindings | |
| 55 (http://pypi.python.org/pypi/selenium) | |
| 56 | |
| 57 b) Ensure that Firefox is installed in the default location. | |
| 58 | |
| 59 c) Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list | |
| 60 and make sure it is in your path. | |
| 61 | |
| 62 d) Download the selenium server (version 2.15 or newer) and place it in this | |
| 63 directory: | |
| 64 http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar | |
| 65 | |
| 66 | |
| 67 ========= Proceed further only if you also want to run performance tests.====== | |
| 68 | |
| 69 10)Download appengine for Python and place it in third_party (http://code.google
.com/appengine/downloads.html#Google_App_Engine_SDK_for_Python): | |
| 70 "dart/third_party/appengine-python/" | |
| 71 | |
| 72 11)Install matplotlib http://matplotlib.sourceforge.net/ | |
| 73 | |
| 74 12)Pull down benchmarks from internal repo (Google only): | |
| 75 http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/
README.txt?view=markup | |
| 76 | |
| 77 13)TODO(efortuna): Deal with appengine check in! Run | |
| 78 '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' | |
| 79 while standing in dart/tools/testing/perf_tests. | |
| 80 | |
| 81 14) Run the tests! While standing in dart/tools/testing/perf_testing, run | |
| 82 $> python create_graph.py --forever --verbose | |
| 83 to run all the tests (browser performance, language correctness in the | |
| 84 browser, command line performance, and self-hosted compile time and compiled | |
| 85 code size). | |
| 86 | |
| 87 You can run individual tests by adding the particular option (such as | |
| 88 --language) when running create_graph.py. Type "create_graph.py -h" for a | |
| 89 full list of the options. | |
| OLD | NEW |