Well, it's finally come. Fedora 20 Heisenbug has been released. And with any release, we've got statistics! This time, however, I'm publishing the stats way sooner to the release in question than I have in the past. I mean, it did just release yesterday. A lot of work went into making F20 as well as testing it - thanks to everyone who contributed time and cycles to testing Fedora 20. Now we get to start preparing for Fedora 21 - which will be quite a departure from what we're used to. It's going to be interesting to see what comes in the Future of Fedora. Alright, enough of my rambling - time for some tables.
Wiki
This section is the list of all the contributors who filled in our release validation test matrices (Install, Desktop and Base). Each step of the process goes through these validation tests - which helps to show how thoroughly tested each of those three areas is.
Test period: Fedora 20 Beta - Fedora 20 Final
Testers: 26
Reports: 1327
Unique referenced bugs: 40
| Name | Reports submitted | Referenced bugs [1] |
|---|---|---|
| pwhalen | 287 | 1035462 1037767 1037789 1040922 892178 969524 (6) |
| satellit | 162 | 1030719 1032921 1033746 1036306 872652 973855 (6) |
| robatino | 162 | 1000891 1000893 1000895 1030719 1030722 1032866 1032868 1035140 1035145 1037619 1037624 1037626 1038840 1038841 1038855 1040867 1040872 929177 (18) |
| mkrizek | 110 | 1037626 (1) |
| adamwill | 101 | 1023250 1027507 1028207 1031239 1035548 1037934 1040922 881624 892178 (9) |
| roshi | 99 | 1032921 1037626 (2) |
| nonamedotc | 72 | |
| lnie | 69 | |
| Wutao85 | 58 | 1030804 (1) |
| kparal | 42 | 1038855 (1) |
| pschindl | 41 | 1033749 (1) |
| cmurf | 39 | 1030695 (1) |
| jsedlak | 16 | 1028503 (1) |
| lbrabec | 13 | |
| boblfoot | 13 | |
| kevin | 12 | |
| mooninite | 6 | |
| cra | 6 | |
| jdulaney | 5 | |
| mattdm | 4 | |
| dmossor | 3 | |
| konradr | 2 | |
| dariof | 2 | |
| tflink | 1 | |
| satellitl | 1 | |
| satelliti | 1 |
Pwhalen kept a hefty lead when compared to the Beta stats. satellit and robatino tied for second with 24 unique reference bugs between them. mkrizek wasn't far behind those two with 110 reports. We didn't have as many reports when compared to Beta, but we did see additional people working the wiki - hopefully we can keep that going into Fedora.next!
Bugzilla
This section is a slightly trimmed list of all the contributors who reported bugs into Bugzilla for F20 Final. Between Beta and Final the number of reporters swelled by almost 100; while at the same time the number of new bug reports dropped by 100. Good numbers on both sides! Considering the stats from Alpha - F20 had a great trend all the way through. In that timeframe there was almost a 400 person increase in reporters. It's awesome to see such an increase throughout a release.
Test period: Fedora 20 Beta - Fedora 20 Final (2013-11-12 - 2013-12-17)
Reporters: 540
New reports:
1280
| Name | Reports submitted2 | Excess reports3 | Accepted blockers4 |
|---|---|---|---|
| Mikhail | 63 | 7 (11%) | 0 |
| Adam Williamson | 33 | 4 (12%) | 5 |
| Tim Waugh | 24 | 2 (8%) | 0 |
| Kamil Páral | 19 | 2 (10%) | 1 |
| Chris Murphy | 18 | 1 (5%) | 0 |
| Alexey Torkhov | 17 | 0 (0%) | 4 |
| Rolle | 15 | 1 (6%) | 0 |
| Andre Robatino | 14 | 11 (78%) | 2 |
| Igor Gnatenko | 14 | 1 (7%) | 0 |
| Amit Shah | 11 | 0 (0%) | 0 |
| Jaroslav Škarvada | 11 | 0 (0%) | 0 |
| Jason Haar | 9 | 1 (11%) | 0 |
| Karsten Hopp | 9 | 0 (0%) | 0 |
| Vratislav Podzimek | 9 | 2 (22%) | 0 |
| Ankur Sinha (FranciscoD) | 8 | 0 (0%) | 0 |
| Brian J. Murrell | 8 | 0 (0%) | 0 |
| Cole Robinson | 8 | 0 (0%) | 0 |
| mastaiza | 8 | 1 (12%) | 0 |
| Miro Hrončok | 8 | 0 (0%) | 0 |
| Vetoshkin Nikita | 8 | 0 (0%) | 0 |
| Christian Stadelmann | 7 | 2 (28%) | 0 |
| Cristian Ciupitu | 7 | 0 (0%) | 0 |
| James Cape | 7 | 1 (14%) | 0 |
| Jozef Mlich | 7 | 1 (14%) | 0 |
| Maciek Borzecki | 7 | 0 (0%) | 0 |
| ONURALP SEZER | 7 | 0 (0%) | 0 |
| Robin Hack | 7 | 2 (28%) | 0 |
| Paul Whalen | 6 | 0 (0%) | 2 |
| James Patterson | 6 | 1 (16%) | 1 |
| satellit at bendbroadband.com | 6 | 0 (0%) | 1 |
| collura at ieee.org | 6 | 0 (0%) | 0 |
| Gareth Williams | 6 | 0 (0%) | 0 |
| Havoc Pennington | 6 | 1 (16%) | 0 |
| IBM Bug Proxy | 6 | 0 (0%) | 0 |
| lnie | 6 | 1 (16%) | 0 |
| Martin Holec | 6 | 0 (0%) | 0 |
| Pavel MlÄoch | 6 | 0 (0%) | 0 |
| Tom Hughes | 6 | 1 (16%) | 0 |
| Zbigniew Jędrzejewski-Szmek | 6 | 0 (0%) | 0 |
| Mike FABIAN | 5 | 0 (0%) | 1 |
| Bojan Smojver | 5 | 0 (0%) | 0 |
| BrollyLSSJ | 5 | 0 (0%) | 0 |
| Bruno Bruzzano | 5 | 0 (0%) | 0 |
| Christian Kujau | 5 | 0 (0%) | 0 |
| Dan Mashal | 5 | 2 (40%) | 0 |
| Emmanuel Pacaud | 5 | 0 (0%) | 0 |
| Heiko Adams | 5 | 0 (0%) | 0 |
| joel at simulantproductions.com | 5 | 0 (0%) | 0 |
| lejeczek | 5 | 1 (20%) | 0 |
| Michael Scherer | 5 | 0 (0%) | 0 |
| Orion Poplawski | 5 | 1 (20%) | 0 |
| Paul Finnigan | 5 | 2 (40%) | 0 |
| Pierguido Lambri | 5 | 0 (0%) | 0 |
| Raphos | 5 | 1 (20%) | 0 |
| redhat at idlecore.com | 5 | 0 (0%) | 0 |
| Richard W.M. Jones | 5 | 0 (0%) | 0 |
| Russell Doty | 5 | 1 (20%) | 0 |
| ...and also 483 other reporters who created less than 5 reports each, but 755 reports combined! | |||
Mikhail continues the reign over Bugzilla - nearly doubling second place (AdamW), again. Tim Waugh and Kamil were really close for third and fourth (respectively). Thanks to everyone who took the time to report bugs - it really helps!
Bodhi - Updates Testing
This section is a slightly trimmed list of all the contributors who provided feedback in Bodhi during Final testing. Bodhi is a system used to verify the stability of packages before they get to the whole Fedora ecosystem. We ended up losing some people when compared to the numbers from Beta - but that's not too surprising getting close to a Final release. We'll see those numbers move back up with Fedora.next!
Test period: Fedora 20 Beta - Fedora 20 Final (2013-11-12 - 2013-12-17)
Testers: 194
Comments [5]: 899
Adam Williamson (adamwill) took first this time around with 76. Igor Gnatenko (ignatenkobrain) again came in a close second. Nonamedotc dropped from third during Beta to 5th, with Ankur Sinha (ankursinha) and Piotr Drąg (raven) moved to third and fourth. Awesome work everyone!
Conlusion
These numbers show a solid finish for the Final release. Since Beta we've seen the number of contributors grow, and I expect that trend to be sustained throughout the next release cycle. With 5 new Working Groups producing three new products I don't know what the stats will look like. It'll be hard to show concrete comparisons between F20 and the multi-faceted F21, but that's a good chance to try something new. Thanks to everyone for all the testing of Fedora 20! I look forward to working with you all on the next release!
Also, if you're at all interested in helping the quality of Fedora, please come help us out! Read the wiki page and join us on freenode at #fedora-qa. We'd love to have you and answer any questions you might have!
// Roshi
.. [1] This is a list of bug reports linked to the wiki results. They don't have to be reported by that concrete person.
.. [2] The total number of new reports (including "excess reports"). Reopened reports or reports with a changed version are not included, because it was not technically easy to retrieve those. This is one of the reasons why you shouldn't take the numbers too seriously, but just as interesting and fun data.
.. [3] Excess reports are those that were closed as NOTABUG, WONTFIX, WORKSFORME, CANTFIX or INSUFFICIENT_DATA. Excess reports are not necessarily a bad thing, but they make for interesting statistics. Close manual inspection is required to separate valuable excess reports from those which are less valuable.
.. [4] This only includes reports that were created by that particular user and accepted as blockers afterwards. The user might have proposed other people's reports as blockers, but this is not reflected in this number.
.. [5] If a person provides multiple comments to a single update, it is considered as a single comment. Karma value is not taken into account.