OLD | NEW |
| (Empty) |
1 Overview: | |
2 These are the instructions to run a wide variety of browser tests using | |
3 test.dart --component=webdriver or | |
4 dart/tools/testing/perf_testing/create_graph.py. Currently the results of | |
5 create_graph are uploaded to https://dartperf.googleplex.com/. | |
6 | |
7 ============== Windows Setup ============== | |
8 | |
9 Open Internet Explorer. Open the Internet Options dialog, and move to the | |
10 "Security" tab. Click through Internet, Local Intranet, Trusted sites, and | |
11 Restricted site and ensure the "Enable Protected Mode" is checked for all zones | |
12 or unchecked for all zones. Then click to the "Advanced" tab, scroll down to the | |
13 "Security" section, and check the checkbox "Allow active content to run in files | |
14 on My Computer." | |
15 | |
16 ================ Mac Setup ================ | |
17 | |
18 1) Ensure Java is installed and in your path (if you want to run Safari). If | |
19 not, install the Java jdk (so that we can run the webdriver server from its | |
20 jar) | |
21 | |
22 2) a) Disable pop-up blocking in Safari: | |
23 Preferences -> Security -> (unselect) Block pop-up windows. | |
24 b) copy the file in /Library/Preferences/com.apple.Safari.plist to | |
25 $DARTDIR/tools/testing/com.apple.Safari.plist | |
26 (We do this because Safari deletes our preferences (on no pop-up | |
27 blocking) if it crashes (aka times out) two times in a row.) | |
28 | |
29 ============= All Platforms ================ | |
30 | |
31 THE EASISET WAY: | |
32 1) Ensure Python 2.7 is installed and in your path. | |
33 2) Download and install Chrome in the default location if you haven't done so | |
34 already. | |
35 3) Run the following script as root/administrator while standing in this | |
36 directory: | |
37 $> [sudo] python dart/tools/testing/perf_testing/webdriver_test_setup.py | |
38 4) Profit! | |
39 | |
40 Example Run: | |
41 $> tools/test.py --component=webdriver --report --timeout=20 --mode=release | |
42 --browser=[ff | safari | chrome | ie] | |
43 [--frog=path/to/frog/executable/like/Release_ia32/dart-sdk/frogc | |
44 --froglib=path/to/frog/lib/like/dart/frog/lib] test_to_run(like "language" or | |
45 "corelib") | |
46 | |
47 (If you don't specify frog and froglib arguments, we default to using frog with | |
48 the VM.) | |
49 | |
50 | |
51 ============================================ | |
52 Okay, so you're still here? Here's the long version of what that script does if | |
53 it didn't work for you: | |
54 a) Install selenium library python bindings | |
55 (http://pypi.python.org/pypi/selenium) | |
56 | |
57 b) Ensure that Firefox is installed in the default location. | |
58 | |
59 c) Download the Chrome Driver: http://code.google.com/p/chromium/downloads/list | |
60 and make sure it is in your path. | |
61 | |
62 d) Download the selenium server (version 2.15 or newer) and place it in this | |
63 directory: | |
64 http://selenium.googlecode.com/files/selenium-server-standalone-2.15.0.jar | |
65 | |
66 | |
67 ========= Proceed further only if you also want to run performance tests.====== | |
68 | |
69 10)Download appengine for Python and place it in third_party (http://code.google
.com/appengine/downloads.html#Google_App_Engine_SDK_for_Python): | |
70 "dart/third_party/appengine-python/" | |
71 | |
72 11)Install matplotlib http://matplotlib.sourceforge.net/ | |
73 | |
74 12)Pull down benchmarks from internal repo (Google only): | |
75 http://chromegw.corp.google.com/viewvc/dash/trunk/internal/browserBenchmarks/
README.txt?view=markup | |
76 | |
77 13)TODO(efortuna): Deal with appengine check in! Run | |
78 '../../../third_party/appengine-python/1.5.4/appcfg.py update appengine/' | |
79 while standing in dart/tools/testing/perf_tests. | |
80 | |
81 14) Run the tests! While standing in dart/tools/testing/perf_testing, run | |
82 $> python create_graph.py --forever --verbose | |
83 to run all the tests (browser performance, language correctness in the | |
84 browser, command line performance, and self-hosted compile time and compiled | |
85 code size). | |
86 | |
87 You can run individual tests by adding the particular option (such as | |
88 --language) when running create_graph.py. Type "create_graph.py -h" for a | |
89 full list of the options. | |
OLD | NEW |