719859 - buildbot-custom changes for side by side staging of ignore_first numbers

Status: RESOLVED FIXED

(Release Engineering :: General, defect, P2)

Description

[Joel Maher ( :jmaher ) (UTC -8)]

as part of the signal_from_noise project we are changing the way we report numbers and will be ignoring the first value instead of the max value.  In addition for osx on tp5 we will be collecting the RSS value from inside of pageloader instead of from the python harness.

Comment 1

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: buildbot-config changes for ignore_first (1.0)

this is what I am thinking we need to do.  After this is successful, there is some other cleanup we can do to the config file as we didn't do it during the last m-c->aurora merge.

Comment 2

[Armen [:armenzg]]

Comment on attachment 590223 [details] [diff] [review]
buildbot-config changes for ignore_first (1.0)

This looks good.
I see that you had 5 new replacements with --ignoreFirst and a different sample.2.config.
I also see that you prepare v8 in case we enable it on mozilla-inbound on project_branches.
PLATFORMS and --activeTests seems to be the same as the originals.

jmaher, if you need to stage two different talos.zip then we should enable the tests on pine where we could land a talos.zip that should not yet go to mozilla-central. This is in case, you need to run two different talos.zip side by side. Not that it seem you need to in this bug.

Comment 3

[Joel Maher ( :jmaher ) (UTC -8)]

Attachment: buildbot-config changes for ignore_first (1.1)

small updates to change testnames to testname.2

Comment 4

[Armen [:armenzg]]

I will deploy this once bug 719169 is fixed and jmaher deploys a new talos.zip with the latest .config.

Comment 5

[Armen [:armenzg]]

Comment on attachment 590239 [details] [diff] [review]
buildbot-config changes for ignore_first (1.1)

Landed on "default":
http://hg.mozilla.org/build/buildbot-configs/rev/93012a94d687

Comment 6

[Armen [:armenzg]]

This is live on production as of 11:40 AM PDT.

Comment 7

[Armen [:armenzg]]

We're not really done in here, right? (what was my rush? :D)

I see "T" jobs showing up in:
https://tbpl.mozilla.org/?rev=dead9dc86cfa&jobname=talos&noignore=1

I've hidden svg.2.
I will do the rest once they appear. We don't want people to be confused.

Comment 8

[Armen [:armenzg]]

We just learned one new thing.

* If we are adding new talos jobs that require a newer talos.zip then land the talos.zip ahead of time

Some jobs prior to dead9dc86cfa (which points to a newer talos.zip) burned because they were pointing to the older talos.zip.

I will star them properly.

Comment 9

[Armen [:armenzg]]

Attachment: remove suites that we're double posting

We should land this ASAP so we don't double post for ts_paint and tpaint.

I can see it already happening:
http://graphs.mozilla.org/graph.html#tests=[[83,1,21],[83,1,1],[83,1,12],[83,1,15],[83,1,14],[83,1,13]]&sel=1327350431063.5234,1327357233079&displayrange=7&datatype=running

I'm afraid we could blame the wrong changeset after dead9dc86cfa.

Comment 10

[Joel Maher ( :jmaher ) (UTC -8)]

Comment on attachment 590872 [details] [diff] [review]
remove suites that we're double posting

Review of attachment 590872 [details] [diff] [review]:
-----------------------------------------------------------------

this looks good. we need to remember to disable only the duplicated tests and/or add back the ts stuff into the new suites.

Comment 11

[Armen [:armenzg]]

Comment on attachment 590872 [details] [diff] [review]
remove suites that we're double posting

Landed and live:
http://hg.mozilla.org/build/buildbot-configs/rev/25ccbf339b4f

Comment 12

[Armen [:armenzg]]

The follow up work to this bug is being done in bug 724561.