Fedora 20 Alpha was released on 2013-09-19 (I know, I know, I'm a bit late), and we have the stats from a couple different areas of the testing efforts. We'll be looking at contributions to the wiki, bugzilla and bodhi. Thanks to everyone who contributed and we look forward to help with Beta!
Now, onto the statistics.
Wiki
This section is a slightly trimmed list of all the contributors who filled in our release validation test matrices (Install, Desktop and Base). Each step of the process goes through these validation tests - which helps to show how thoroughly tested each area is.
Test period: Fedora 19 Final- Fedora 20 Alpha
Testers: 24
Reports: 972
Unique referenced bugs: 62
| Name | Reports submitted | Referenced bugs [1] |
|---|---|---|
| robatino | 280 | 1000891 1000893 1000895 1000897 1000898 1000961 1000998 1001007 1001081 1002055 1002389 1002391 1002806 1004508 1004524 1004530 1004940 1004944 1005587 1005588 1007037 1007043 1007373 1007376 1008769 1008771 1008788 1009728 1009732 929177 (30) |
| pwhalen | 159 | 1002737 1002806 1004421 1004505 1004902 1006474 1006539 1008788 892178 979174 985569 985572 (12) |
| nonamedotc | 100 | 1000703 1000930 1001323 1004878 1004889 892178 (6) |
| lnie | 80 | 1000703 1000930 1001414 1001425 1004889 1006113 (6) |
| tflink | 61 | 1000891 1001081 (2) |
| kparal | 51 | 1000889 1000891 1002055 1003637 1009809 1009828 (6) |
| Wutao85 | 36 | 1000927 1004846 1005632 (3) |
| mkrizek | 29 | 1004323 (1) |
| lbrabec | 27 | 1007387 (1) |
| satellit | 25 | 1004421 1008569 (2) |
| jskladan | 19 | |
| pschindl | 18 | |
| adamwill | 17 | 1009833 (1) |
| roshi | 13 | |
| spstarr | 13 | 1000715 995268 (2) |
| kevin | 12 | |
| from rc1 | 9 | |
| boblfoot | 8 | 1000927 1008684 (2) |
| parasense | 6 | |
| jsedlak | 3 | |
| red | 2 | |
| jgrulich | 2 | |
| jreznik | 1 | |
| Pascal0776 | 1 |
Robatino kept the lead from the last round of statistics. Second place pwhalen was closer to robatino than nonamedotc (who took third) was last year. Better watch out robatino! Pwhalen is in charge of the Red Hat side of ARM testing - the only of the three from Red Hat.
Between the three of them, they submitted over 500 reports on 48 bugs. This really helps during the debugging process. Thanks to everybody!
Bugzilla
This section is a slightly trimmed list of all the contributors who reported bugs into Bugzilla for F20 Alpha. The numbers didn't go up that much when compared to Fedora 19 Final, but we can fix that for Beta :)
Test period: Fedora 19 Final - Fedora 20 Alpha (2013-08-20 -
2013-09-19)
Reporters: 149
New reports:
473
| Name | Reports submitted [2] | Excess reports [3] | Accepted blockers [4] |
|---|---|---|---|
| Andre Robatino | 27 | 19 (70%) | 3 |
| Igor Gnatenko | 27 | 1 (3%) | 0 |
| Mike FABIAN | 18 | 1 (5%) | 0 |
| Kamil Páral | 16 | 1 (6%) | 1 |
| Michael Schwendt | 12 | 0 (0%) | 0 |
| Steve Tyler | 11 | 0 (0%) | 1 |
| Flóki Pálsson | 11 | 4 (36%) | 0 |
| Pavel Raiskup | 11 | 0 (0%) | 0 |
| Adam Williamson | 9 | 0 (0%) | 0 |
| Ales Kozumplik | 9 | 4 (44%) | 0 |
| Björn "besser82" Esser | 9 | 1 (11%) | 0 |
| Jan Sedlák | 9 | 2 (22%) | 0 |
| Mikolaj Izdebski | 9 | 0 (0%) | 0 |
| Lukas Brabec | 8 | 1 (12%) | 1 |
| Martin Holec | 8 | 0 (0%) | 0 |
| Paul Whalen | 7 | 1 (14%) | 2 |
| Elad Alfassa | 7 | 0 (0%) | 0 |
| Reartes Guillermo | 6 | 1 (16%) | 1 |
| lnie | 6 | 1 (16%) | 0 |
| Ankur Sinha (FranciscoD) | 5 | 0 (0%) | 0 |
| collura at ieee.org | 5 | 0 (0%) | 0 |
| Dan Mashal | 5 | 0 (0%) | 0 |
| David Aquilina | 5 | 0 (0%) | 0 |
| Hans de Goede | 5 | 1 (20%) | 0 |
| Noah Menzi | 5 | 0 (0%) | 0 |
| nonamedotc at gmail.com | 5 | 1 (20%) | 0 |
| sangu | 5 | 0 (0%) | 0 |
| ...and also 122 other reporters who created less than 5 reports each, but 213 reports combined! | |||
I could haved guessed robatino would be at the top again, but he was tied by Igor Gnatenko (ignatenkobrain). Good job Igor! The numbers were pretty evenly distributed, which is good to see.
Bodhi - Updates Testing
This section is a slightly trimmed list of all the contributors who provided feedback in Bodhi for this time period. Bodhi is a system used to verify the stability of builds before they get to stable. The number of testers and comments dropped since F19 Final - but this is Alpha, so I suppose that's expected.
Test period: Fedora 19 Final - Fedora 20 Alpha (2013-08-20 - 2013-09-19)
Testers: 73
Comments [5]: 396
| Name | Updates commented |
|---|---|
| Björn Esser (besser82) | 106 |
| nonamedotc | 42 |
| Igor Gnatenko (ignatenkobrain) | 35 |
| Piotr Drąg (raven) | 19 |
| Fabio Valentini (fafatheone) | 19 |
| Ankur Sinha (ankursinha) | 15 |
| bitlord | 14 |
| Lukas Brabec (lbrabec) | 13 |
| Christopher Meng (cicku) | 10 |
| Kevin Fenzi (kevin) | 8 |
| Jiří Popelka (jpopelka) | 7 |
| Petr Schindler (pschindl) | 7 |
| Kalev Lember (kalev) | 5 |
| Reindl Harald (hreindl) | 5 |
| Michael Schwendt (mschwendt) | 5 |
| Martin Krizek (mkrizek) | 5 |
| Paul Whalen (pwhalen) | 4 |
| Kamil Páral (kparal) | 4 |
| Rex Dieter (rdieter) | 3 |
| Amit Saha (amitksaha) | 3 |
| Bruno Wolff III (bruno) | 3 |
| Joachim Backes (backes) | 3 |
| Jens Petersen (petersen) | 3 |
| ...and also 50 other reporters who created less than 3 reports each, but 58 reports combined! |
A new QA star is Björn Esser (besser82), who absolutely ruled bodhi this release - doubling nonamedotc's impressive score. Third place was Igor Gnatenko (ignatenkobrain). That's a lot of comments for improving packages and getting them moved into stable! Thanks to everyone who helped out!
Conlusion
For an alpha release, these numbers are pretty good. Let's try to keep things moving forward as we get into Beta.
If you're at all interested in helping the quality of Fedora, please come help us out! Read the wiki page and join us on freenode at #fedora-qa. We'd love to have you and answer any questions you might have!
// Roshi
.. [1] This is a list of bug reports linked to the wiki results. They don't have to be reported by that concrete person.
.. [2] The total number of new reports (including "excess reports"). Reopened reports or reports with a changed version are not included, because it was not technically easy to retrieve those. This is one of the reasons why you shouldn't take the numbers too seriously, but just as interesting and fun data.
.. [3] Excess reports are those that were closed as NOTABUG, WONTFIX, WORKSFORME, CANTFIX or INSUFFICIENT_DATA. Excess reports are not necessarily a bad thing, but they make for interesting statistics. Close manual inspection is required to separate valuable excess reports from those which are less valuable.
.. [4] This only includes reports that were created by that particular user and accepted as blockers afterwards. The user might have proposed other people's reports as blockers, but this is not reflected in this number.
.. [5] If a person provides multiple comments to a single update, it is considered as a single comment. Karma value is not taken into account.