Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(409)

Issue 25530003: Rename load_test to isolateserver_load_test, create swarming_load_test. (Closed)

Created:
7 years, 2 months ago by M-A Ruel
Modified:
7 years, 2 months ago
CC:
chromium-reviews, csharp+cc_chromium.org, vadimsh+cc_chromium.org, maruel+cc_chromium.org
Base URL:
https://chromium.googlesource.com/a/chromium/tools/swarm_client@2_exception
Visibility:
Public.

Description

Create swarming load test. swarming_load_test_bot.py creates fake Swarming bots that fake running tasks. swarming_load_test_client.py creates fake Swarming tasks and wait for them to complete. The goal here is to see how the server melts down, if it does, when a lot of concurrent pending tasks occur. R=csharp@chromium.org BUG= Committed: http://src.chromium.org/viewvc/chrome?view=rev&revision=227002

Patch Set 1 #

Patch Set 2 : better #

Patch Set 3 : Remove sig_handler #

Patch Set 4 : Now works #

Patch Set 5 : Remove broken code asserting progress.size #

Patch Set 6 : Use named columns #

Total comments: 23

Patch Set 7 : Address review comments #

Total comments: 24

Patch Set 8 : Address comments #

Patch Set 9 : Add unregister call #

Patch Set 10 : Use Comodore64 instead of AIX, do not force bot to run on same host as client #

Patch Set 11 : Rebase on HEAD #

Patch Set 12 : This CL will get in one way or another #

Unified diffs Side-by-side diffs Delta from patch set Stats (+556 lines, -2 lines) Patch
A tools/swarming_load_test_bot.py View 1 2 3 4 5 6 7 8 9 10 11 1 chunk +326 lines, -0 lines 0 comments Download
A tools/swarming_load_test_client.py View 1 2 3 4 5 6 7 8 9 1 chunk +226 lines, -0 lines 0 comments Download
M utils/threading_utils.py View 1 2 3 4 5 6 7 8 9 10 1 chunk +4 lines, -2 lines 0 comments Download

Messages

Total messages: 21 (0 generated)
Marc-Antoine Ruel (Google)
The CL is finally ready to go. It is dependent on: https://codereview.chromium.org/25478010 https://codereview.chromium.org/25478012 It does ...
7 years, 2 months ago (2013-10-02 15:31:57 UTC) #1
Vadim Sh.
> It does kill the canary swarming server deterministically... Good job! :D Can we setup ...
7 years, 2 months ago (2013-10-02 17:58:49 UTC) #2
csharp
On 2013/10/02 17:58:49, Vadim Sh. wrote: > > It does kill the canary swarming server ...
7 years, 2 months ago (2013-10-02 19:09:12 UTC) #3
Marc-Antoine Ruel (Google)
On 2013/10/02 19:09:12, csharp wrote: > On 2013/10/02 17:58:49, Vadim Sh. wrote: > > > ...
7 years, 2 months ago (2013-10-02 21:18:41 UTC) #4
Vadim Sh.
> When we kill it, it's only for a few tens of minutes > anyway. ...
7 years, 2 months ago (2013-10-02 21:46:13 UTC) #5
csharp
Didn't get a chance to look at the other file yet but I sent it ...
7 years, 2 months ago (2013-10-02 21:56:24 UTC) #6
M-A Ruel
https://codereview.chromium.org/25530003/diff/13001/tools/swarming_load_test_bot.py File tools/swarming_load_test_bot.py (right): https://codereview.chromium.org/25530003/diff/13001/tools/swarming_load_test_bot.py#newcode53 tools/swarming_load_test_bot.py:53: #print('Average overhead: %s' % graph.to_units(total_size / len(sizes))) On 2013/10/02 ...
7 years, 2 months ago (2013-10-02 23:44:25 UTC) #7
csharp
https://codereview.chromium.org/25530003/diff/13001/tools/swarming_load_test_bot.py File tools/swarming_load_test_bot.py (right): https://codereview.chromium.org/25530003/diff/13001/tools/swarming_load_test_bot.py#newcode166 tools/swarming_load_test_bot.py:166: time.sleep(manifest['come_back']) On 2013/10/02 23:44:25, M-A Ruel wrote: > On ...
7 years, 2 months ago (2013-10-03 16:08:04 UTC) #8
Marc-Antoine Ruel (Google)
https://codereview.chromium.org/25530003/diff/13001/tools/swarming_load_test_bot.py File tools/swarming_load_test_bot.py (right): https://codereview.chromium.org/25530003/diff/13001/tools/swarming_load_test_bot.py#newcode166 tools/swarming_load_test_bot.py:166: time.sleep(manifest['come_back']) On 2013/10/03 16:08:04, csharp wrote: > After thinking ...
7 years, 2 months ago (2013-10-03 16:47:11 UTC) #9
csharp
lgtm assuming you add a todo to call delete_machine_stats or just start calling it (even ...
7 years, 2 months ago (2013-10-03 19:00:33 UTC) #10
Marc-Antoine Ruel (Google)
https://codereview.chromium.org/25530003/diff/18001/tools/swarming_load_test_bot.py File tools/swarming_load_test_bot.py (right): https://codereview.chromium.org/25530003/diff/18001/tools/swarming_load_test_bot.py#newcode161 tools/swarming_load_test_bot.py:161: if commands == ['UpdateSlave']: On 2013/10/03 19:00:34, csharp wrote: ...
7 years, 2 months ago (2013-10-03 19:15:29 UTC) #11
csharp
https://codereview.chromium.org/25530003/diff/18001/tools/swarming_load_test_bot.py File tools/swarming_load_test_bot.py (right): https://codereview.chromium.org/25530003/diff/18001/tools/swarming_load_test_bot.py#newcode161 tools/swarming_load_test_bot.py:161: if commands == ['UpdateSlave']: On 2013/10/03 19:15:29, Marc-Antoine Ruel ...
7 years, 2 months ago (2013-10-04 13:43:13 UTC) #12
Marc-Antoine Ruel (Google)
On 2013/10/04 13:43:13, csharp wrote: > https://codereview.chromium.org/25530003/diff/18001/tools/swarming_load_test_bot.py > File tools/swarming_load_test_bot.py (right): > > https://codereview.chromium.org/25530003/diff/18001/tools/swarming_load_test_bot.py#newcode161 > ...
7 years, 2 months ago (2013-10-04 13:56:12 UTC) #13
csharp
On 2013/10/04 13:56:12, Marc-Antoine Ruel (Google) wrote: > On 2013/10/04 13:43:13, csharp wrote: > > ...
7 years, 2 months ago (2013-10-04 14:03:47 UTC) #14
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-status.appspot.com/cq/maruel@chromium.org/25530003/6002
7 years, 2 months ago (2013-10-04 14:06:30 UTC) #15
commit-bot: I haz the power
Failed to apply patch for swarm_client/googletest/run_test_cases.py: While running patch -p1 --forward --force --no-backup-if-mismatch; patching file ...
7 years, 2 months ago (2013-10-04 14:06:33 UTC) #16
Marc-Antoine Ruel (Google)
On 2013/10/04 14:06:33, I haz the power (commit-bot) wrote: > Failed to apply patch for ...
7 years, 2 months ago (2013-10-04 14:31:30 UTC) #17
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-status.appspot.com/cq/maruel@chromium.org/25530003/45001
7 years, 2 months ago (2013-10-04 14:31:40 UTC) #18
commit-bot: I haz the power
Presubmit check for 25530003-45001 failed and returned exit status 1. Running presubmit commit checks ...
7 years, 2 months ago (2013-10-04 14:33:00 UTC) #19
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-status.appspot.com/cq/maruel@chromium.org/25530003/14003
7 years, 2 months ago (2013-10-04 14:35:24 UTC) #20
commit-bot: I haz the power
7 years, 2 months ago (2013-10-04 14:36:48 UTC) #21
Message was sent while issue was closed.
Change committed as 227002

Powered by Google App Engine
This is Rietveld 408576698