Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(747)

Issue 211473006: Add GN (the build tool) to the chromium.linux buildbots and try jobs (Closed)

Created:
6 years, 9 months ago by Dirk Pranke
Modified:
6 years, 9 months ago
CC:
chromium-reviews, kjellander-cc_chromium.org, cmp-cc_chromium.org, stip+watch_chromium.org, ilevy-cc_chromium.org, brettw
Visibility:
Public.

Description

Add GN (the build tool) to the chromium.linux buildbots and try jobs This patch adds three things: 1. a recipe for building chromium w/ GN and running the gn_unittests 2. a new linux_gn bot to the chromium.linux waterfall that runs the above recipe 3. a few additional steps on the linux and linux_rel chromium trybots to run GN, put the output into a separate Debug_gn (or Release_gn) dir, compile in that dir as well, and run the gn_unittests from that dir. We do step 3 because at this time the cost of running GN + compiling the few targets and running the gn_uniitests is *way* smaller than the cost of setting up an entire new fleet of GN try bots that are part of the default set. When the GN build gets closer to building all of chrome, we will split it off into its own pool of bots and remove these steps from the chromium.recipe. R=iannucci@chromium.org, phajdan.jr@chromium.org BUG=353690, 353854, 353855, 353881 Committed: http://src.chromium.org/viewvc/chrome?view=rev&revision=260291

Patch Set 1 : initial patch for review #

Total comments: 26

Patch Set 2 : merge forward, update w/ review feedback, rename recipe and remove gn_unittests #

Patch Set 3 : make recipe actually work #

Total comments: 5

Patch Set 4 : tweak path handling for gn #

Patch Set 5 : merge to r260023 #

Total comments: 4

Patch Set 6 : update w/ review feedback #

Total comments: 10
Unified diffs Side-by-side diffs Delta from patch set Stats (+2957 lines, -5 lines) Patch
M masters/master.chromium.linux/master_linux_cfg.py View 1 2 chunks +3 lines, -1 line 0 comments Download
M masters/master.chromium.linux/slaves.cfg View 1 chunk +8 lines, -0 lines 0 comments Download
M scripts/slave/recipe_modules/chromium/api.py View 1 2 3 4 5 1 chunk +21 lines, -2 lines 4 comments Download
M scripts/slave/recipe_modules/chromium/config.py View 1 1 chunk +1 line, -0 lines 0 comments Download
A scripts/slave/recipes/chromium_gn.py View 1 2 3 4 5 1 chunk +51 lines, -0 lines 2 comments Download
A scripts/slave/recipes/chromium_gn.expected/full_chromium_linux_Linux_GN__dbg_.json View 1 2 3 5 1 chunk +102 lines, -0 lines 0 comments Download
A scripts/slave/recipes/chromium_gn.expected/unittest_basic.json View 1 2 3 5 1 chunk +102 lines, -0 lines 0 comments Download
M scripts/slave/recipes/chromium_trybot.py View 1 2 3 4 5 5 chunks +53 lines, -2 lines 4 comments Download
A scripts/slave/recipes/chromium_trybot.expected/unittest_should_run_gn.json View 1 2 3 4 5 1 chunk +1219 lines, -0 lines 0 comments Download
A scripts/slave/recipes/chromium_trybot.expected/unittest_should_run_gn_compile_failure.json View 1 2 3 4 5 1 chunk +1397 lines, -0 lines 0 comments Download

Messages

Total messages: 21 (0 generated)
Dirk Pranke
Please take a look. This is a single all-in-one patch with all of the changes ...
6 years, 9 months ago (2014-03-26 00:30:18 UTC) #1
iannucci
Probably needs a rebase on top of Paweł's latest patch https://chromiumcodereview.appspot.com/211473006/diff/50001/masters/master.chromium.linux/master_linux_cfg.py File masters/master.chromium.linux/master_linux_cfg.py (right): https://chromiumcodereview.appspot.com/211473006/diff/50001/masters/master.chromium.linux/master_linux_cfg.py#newcode57 ...
6 years, 9 months ago (2014-03-26 09:38:49 UTC) #2
Paweł Hajdan Jr.
"not lgtm" because of my comment about "gn_unittests" Otherwise looks good, generally minor comments. Feel ...
6 years, 9 months ago (2014-03-26 11:44:59 UTC) #3
Dirk Pranke
I have several questions about Paweł's comments, please take a look ... https://codereview.chromium.org/211473006/diff/50001/masters/master.chromium.linux/master_linux_cfg.py File masters/master.chromium.linux/master_linux_cfg.py ...
6 years, 9 months ago (2014-03-26 16:52:28 UTC) #4
Dirk Pranke
https://codereview.chromium.org/211473006/diff/50001/scripts/slave/recipes/chromium_trybot.py File scripts/slave/recipes/chromium_trybot.py (right): https://codereview.chromium.org/211473006/diff/50001/scripts/slave/recipes/chromium_trybot.py#newcode274 scripts/slave/recipes/chromium_trybot.py:274: gn_output_dir) Oh, I misread this. No, they should be ...
6 years, 9 months ago (2014-03-26 19:16:35 UTC) #5
Dirk Pranke
Okay, here's a new version of the patch. I've removed the gn_unittests steps, and incorporated ...
6 years, 9 months ago (2014-03-26 19:28:02 UTC) #6
iannucci
lgtm
6 years, 9 months ago (2014-03-26 22:19:02 UTC) #7
iannucci
down with relpaths (not lgtm in that regard). https://codereview.chromium.org/211473006/diff/180001/scripts/slave/recipes/chromium_gn.expected/full_chromium_linux_Linux_GN__dbg_.json File scripts/slave/recipes/chromium_gn.expected/full_chromium_linux_Linux_GN__dbg_.json (right): https://codereview.chromium.org/211473006/diff/180001/scripts/slave/recipes/chromium_gn.expected/full_chromium_linux_Linux_GN__dbg_.json#newcode89 scripts/slave/recipes/chromium_gn.expected/full_chromium_linux_Linux_GN__dbg_.json:89: "out/Debug", ...
6 years, 9 months ago (2014-03-27 01:33:57 UTC) #8
brettw
https://codereview.chromium.org/211473006/diff/180001/scripts/slave/recipes/chromium_gn.expected/full_chromium_linux_Linux_GN__dbg_.json File scripts/slave/recipes/chromium_gn.expected/full_chromium_linux_Linux_GN__dbg_.json (right): https://codereview.chromium.org/211473006/diff/180001/scripts/slave/recipes/chromium_gn.expected/full_chromium_linux_Linux_GN__dbg_.json#newcode88 scripts/slave/recipes/chromium_gn.expected/full_chromium_linux_Linux_GN__dbg_.json:88: "-o", Delete this. https://codereview.chromium.org/211473006/diff/180001/scripts/slave/recipes/chromium_gn.expected/full_chromium_linux_Linux_GN__dbg_.json#newcode89 scripts/slave/recipes/chromium_gn.expected/full_chromium_linux_Linux_GN__dbg_.json:89: "out/Debug", You can just ...
6 years, 9 months ago (2014-03-27 04:54:03 UTC) #9
Dirk Pranke
Okay, the latest patch resolves the relative path issues, and has been tested to work ...
6 years, 9 months ago (2014-03-27 22:13:12 UTC) #10
Dirk Pranke
Okay, I've tested the patch locally for both buildbot and trybot, and things seem happy. ...
6 years, 9 months ago (2014-03-28 01:57:14 UTC) #11
Paweł Hajdan Jr.
"not lgtm" for the chromium_trybot changes - I'm really sorry about that, but I'm convinced ...
6 years, 9 months ago (2014-03-28 09:45:04 UTC) #12
Dirk Pranke
https://codereview.chromium.org/211473006/diff/220001/scripts/slave/recipes/chromium_gn.py File scripts/slave/recipes/chromium_gn.py (right): https://codereview.chromium.org/211473006/diff/220001/scripts/slave/recipes/chromium_gn.py#newcode16 scripts/slave/recipes/chromium_gn.py:16: On 2014/03/28 09:45:04, Paweł Hajdan Jr. wrote: > nit: ...
6 years, 9 months ago (2014-03-28 15:59:43 UTC) #13
Dirk Pranke
Please take another look? Note that the large delta between patchsets 5 and 6 in ...
6 years, 9 months ago (2014-03-28 20:00:24 UTC) #14
Paweł Hajdan Jr.
LGTM. I appreciate your patience with me. Thank you for working on this.
6 years, 9 months ago (2014-03-28 20:56:20 UTC) #15
Dirk Pranke
The CQ bit was checked by dpranke@chromium.org
6 years, 9 months ago (2014-03-28 21:46:57 UTC) #16
commit-bot: I haz the power
CQ is trying da patch. Follow status at https://chromium-status.appspot.com/cq/dpranke@chromium.org/211473006/260001
6 years, 9 months ago (2014-03-28 21:47:06 UTC) #17
commit-bot: I haz the power
Change committed as 260291
6 years, 9 months ago (2014-03-28 21:48:27 UTC) #18
iannucci
some other comments https://codereview.chromium.org/211473006/diff/260001/scripts/slave/recipe_modules/chromium/api.py File scripts/slave/recipe_modules/chromium/api.py (right): https://codereview.chromium.org/211473006/diff/260001/scripts/slave/recipe_modules/chromium/api.py#newcode246 scripts/slave/recipe_modules/chromium/api.py:246: return self.m.step(name=name, cmd=[ninja_path, '-C', output_dir], **kwargs) ...
6 years, 9 months ago (2014-03-28 22:40:42 UTC) #19
Dirk Pranke
https://codereview.chromium.org/211473006/diff/260001/scripts/slave/recipe_modules/chromium/api.py File scripts/slave/recipe_modules/chromium/api.py (right): https://codereview.chromium.org/211473006/diff/260001/scripts/slave/recipe_modules/chromium/api.py#newcode246 scripts/slave/recipe_modules/chromium/api.py:246: return self.m.step(name=name, cmd=[ninja_path, '-C', output_dir], **kwargs) On 2014/03/28 22:40:42, ...
6 years, 9 months ago (2014-03-28 23:52:06 UTC) #20
Dirk Pranke
6 years, 9 months ago (2014-03-28 23:52:44 UTC) #21
Message was sent while issue was closed.
https://codereview.chromium.org/211473006/diff/260001/scripts/slave/recipes/c...
File scripts/slave/recipes/chromium_trybot.py (right):

https://codereview.chromium.org/211473006/diff/260001/scripts/slave/recipes/c...
scripts/slave/recipes/chromium_trybot.py:506: api.step_data('compile (gn with
patch)')
On 2014/03/28 22:40:42, iannucci wrote:
> can remove this empty step_data

okay.

Powered by Google App Engine
This is Rietveld 408576698