Cleaning up the Bug Tracker

Have some feature requests, feedback, cool stuff to share, or want to know where FreeCAD is going? This is the place.
triplus
Posts: 7267
Joined: Mon Dec 12, 2011 4:45 pm

Re: Cleaning up the Bug Tracker

Postby triplus » Mon Aug 21, 2017 11:33 am

Hi @Kunda1.

You have been doing a lot of management related tasks regarding issue tracker for a few months now. Like opening issue related threads here on the forum and other things. I was wondering what does the statistics say. Did we manage to improve things in any regard or does it show the issue reporting and resolving dynamic in FOSS project is a bit specific?

Should we for example start thinking about closing issue reports automatically after longer time of inactivity? As the relevant ones will likely be reopened anyway. And as for the rest best to close them at some point to reduce the noise?
User avatar
Kunda1
Posts: 2754
Joined: Thu Jan 05, 2017 9:03 pm

Re: Cleaning up the Bug Tracker

Postby Kunda1 » Mon Aug 21, 2017 2:50 pm

triplus wrote:
Mon Aug 21, 2017 11:33 am
Hi @Kunda1.

You have been doing a lot of management related tasks regarding issue tracker for a few months now. Like opening issue related threads here on the forum and other things. I was wondering what does the statistics say. Did we manage to improve things in any regard or does it show the issue reporting and resolving dynamic in FOSS project is a bit specific?
I have been working the Bugtracker since the end of last year (Nov-Dec '16). For visual metrics I would ideally attach the MantisBT graph that is generated but it is poorly designed and doesn't fit on my laptop screen. So I'm attaching the following stats to show progress.
FC-mantis-stats-2017-08-21-summary-per-period.png
Tracking tickets that have been opened and closed per period.
FC-mantis-stats-2017-08-21-summary-per-period.png (18.84 KiB) Viewed 400 times
There has been good progress.

My observation is that the FC community uses the BT differently then other projects. I think this is due to historical habit and a lack of stable integration between the forum, bugtracker, and github. At the time of this writing, the emphasis of the FC project is as following from highest priority to lowest: forum, github and then the bugtracker. Historically and currently people have been posting to the bugtracker assuming that this was a 'first-response' method of getting the teams attention. In FC as you know very well, we ask people to first open a forum thread and then the community ascertains if the issue merits a ticket (thanks to some recent refinements in banners and such this 'noise' has been cut down substantially). Because of this low priority focus on the BT, tickets have been open and then rot because they get buried without being announced to the forum.

FC team also doesn't really utilize the 'Priority' status of tickets (low, normal, high, urgent, immediate) which I think can be useful to prioritize and organize bugs.

An aside: we (mostly @yorik, @kkremitzki but also myself) tried to implement a stable workflow for Source Integration (SI) which is a plugin for MantisBT to integrate with github but due to initial import issues (the SI plugin needs to load the git history of the whole FreeCAD git repo but malfunctions so we have an incomplete import ATM) we needed to manually sync it which we do seldom and it doesn't always work correctly. If anyone is interested here are some Source-Integration issues that are blocking us from it working: here and here

An interesting phenomenon and strength of FC is it's diversity. The number of tickets closed shows some progress but not incredible progress. This has to do somewhat with the popularity and heavy development going on in FEM, Path, TD, and PDN workbenches. Although I don't have good metrics to show when these tickets were open and closed...here is a snapshot of their activity:
FC-mantis-stats-2017-08-21-Categories.png
Shows the amount of open tickets per Mantis Category.
FC-mantis-stats-2017-08-21-Categories.png (36.48 KiB) Viewed 400 times
FC-mantis-stats-2017-08-21-Resolution.png
FC-mantis-stats-2017-08-21-Resolution.png (26.16 KiB) Viewed 400 times
triplus wrote:
Mon Aug 21, 2017 11:33 am
Should we for example start thinking about closing issue reports automatically after longer time of inactivity? As the relevant ones will likely be reopened anyway. And as for the rest best to close them at some point to reduce the noise?
I'm not sure about auto-closing ticket. I've heard different takes on this before. I refer this question to the devs.

Perhaps another model to approach this is schedule a bi-yearly bug tracker cleanup where a team combs through the tracker and weeds out any non-relevant bugs/features. Right now for example there are 31 pending 'Feedback' status tickets that could be resolved.
FC-mantis-stats-2017-08-21-Status.png
Ticket per status. There are 31 ticket in Feedback status. Many of them are rotting.
FC-mantis-stats-2017-08-21-Status.png (18.4 KiB) Viewed 400 times
Currently: We have 221 bug and 251 features with some other misc. tickets which brings us to 491 active open tickets.
Want to contribute back to FC? Checkout:
#lowhangingfruit | Use the Source, Luke. | How to Help FreeCAD | How to report FC bugs and features
triplus
Posts: 7267
Joined: Mon Dec 12, 2011 4:45 pm

Re: Cleaning up the Bug Tracker

Postby triplus » Mon Aug 21, 2017 8:09 pm

Good job!
User avatar
Kunda1
Posts: 2754
Joined: Thu Jan 05, 2017 9:03 pm

Re: Cleaning up the Bug Tracker

Postby Kunda1 » Tue Sep 26, 2017 3:03 pm

tracker-09-26-2017.png
tracker-09-26-2017.png (97.93 KiB) Viewed 325 times
Want to contribute back to FC? Checkout:
#lowhangingfruit | Use the Source, Luke. | How to Help FreeCAD | How to report FC bugs and features
User avatar
Kunda1
Posts: 2754
Joined: Thu Jan 05, 2017 9:03 pm

Re: Cleaning up the Bug Tracker

Postby Kunda1 » Mon Jan 08, 2018 5:02 pm

Image
Want to contribute back to FC? Checkout:
#lowhangingfruit | Use the Source, Luke. | How to Help FreeCAD | How to report FC bugs and features
triplus
Posts: 7267
Joined: Mon Dec 12, 2011 4:45 pm

Re: Cleaning up the Bug Tracker

Postby triplus » Tue Jan 09, 2018 12:27 am

Nice!
User avatar
yorik
Site Admin
Posts: 9981
Joined: Tue Feb 17, 2009 9:16 pm
Location: São Paulo, Brazil
Contact:

Re: Cleaning up the Bug Tracker

Postby yorik » Tue Jan 09, 2018 12:15 pm

Thanks a lot for your heavy work on the tracker @Kunda1. This makes a huge difference!
User avatar
Kunda1
Posts: 2754
Joined: Thu Jan 05, 2017 9:03 pm

Re: Cleaning up the Bug Tracker

Postby Kunda1 » Sun Sep 16, 2018 6:21 pm

Lots of work recently on the tracker
Image

Image
Want to contribute back to FC? Checkout:
#lowhangingfruit | Use the Source, Luke. | How to Help FreeCAD | How to report FC bugs and features
User avatar
NormandC
Posts: 16569
Joined: Sat Feb 06, 2010 9:52 pm
Location: Québec, Canada

Re: Cleaning up the Bug Tracker

Postby NormandC » Mon Sep 17, 2018 2:03 am

I believe the number of registered reports has been steadily increasing in the past couple of years.
User avatar
bernd
Posts: 6018
Joined: Sun Sep 08, 2013 8:07 pm
Location: Zürich, Switzerland

Re: Cleaning up the Bug Tracker

Postby bernd » Mon Sep 17, 2018 7:09 am

are these bugs only, or bugs and features?