[
Date Prev][
Date Next][
Thread Prev][
Thread Next][
Date Index][
Thread Index]
[
List Home]
|
Re: [polarsys-iwg] Maturity Assessment review and feedback
|
Hi all,
After the good suggestion from Etienne about « usage » category, I have also some suggestion: track availability and results of a validation/acceptance document for each PolarSys component.
Industrial companies have all Validation Scenarios or Verification Procedures plans (vocabulary may change according to domain, culture and certification authorities recommendations) and require their subcontractors to comply with them for product delivery acceptance.
I think that PolarSys components/tools quality should not differ from what is generally expected/requested by industrial companies and it would give a good sign concerning maturity if we can ensure that some PolarSys components HAVE a validation document with a list ofverification procedures that cover end user requirements.
I’m perfectly aware that the validation campaign can not be entirely automated and so there are some metrics that will remain « manual » at least for some time.
But we can already get some first results by checking that Polarsys components have a validation plan document defined in wiki or bugzilla (it will require some organization). Then we can check whether there is a validation campaign run on the basis of this document at each major release. Finally we can probably analyse test results so as to retrieve results for each procedure and display the total of passed, failed, error or unconclusive tests, as it is already done for unit tests in continuous integration.
I can post a template document on the wiki as an illustration if it can help.
Thanks for any feedback,
best regards
raphaël
Raphaël Faudou
PolarSys ReqCycle leader
Le 22 août 2014 à 16:57, Boris Baldassari <boris.baldassari@xxxxxxxxx> a écrit :
> Hiho dear colleagues,
>
> A lot of work has been done recently around the maturity assessment initiative, and we thought it would be good to let you know about it to have some great feedback..
>
> * The PolarSys quality model has been improved and formalised. It is thoroughly presented in the polarsys wiki [1a], with the metrics [1b] and measurement concepts [1c] used . The architecture of the prototype [1d] has also been updated, following discussions with Gaël Blondelle and Jesus Gonzalez-Barahona from Bitergia.
>
> * A nice visualisation of the quality model has been developed [2] using d3js, which summarises the most important ideas and concepts. The description of metrics and measurement concepts has still to be enhanced, but the quality model itself is almost complete. Please fell free to comment and contribute.
>
> * A github repo has been created [3], holding all definition files for the quality model itself, metrics and measurement concepts. It also includes a set of scripts used to check and manipulate the definition files, and to visualise some specific parts of the system.
>
> * We are setting up the necessary information and framework for the rule-checking tools: PMD and FindBugs for now, others may follow. Rules are classified according to the quality attributes they impact, which is of great importance to provide sound advice regarding the good and bad practices observed in the project.
>
>
> Help us help you! If you would like to participate and see what this on-going work can bring to your project, please feel free to contact me. This is also the opportunity to better understand how projects work and how we can do better together, realistically.
>
> Sincerely yours,
>
>
> --
> Boris
>
>
>
> [1a] https://polarsys.org/wiki/EclipseQualityModel
> [1b] https://polarsys.org/wiki/EclipseMetrics
> [1c] https://polarsys.org/wiki/EclipseMeasurementConcepts
> [1d] https://polarsys.org/wiki/MaturityAssessmentToolsArchitecture
> [2] http://borisbaldassari.github.io/PolarsysMaturity/qm/polarsys_qm_full.html
> [3] https://github.com/borisbaldassari/PolarsysMaturity
> _______________________________________________
> polarsys-iwg mailing list
> polarsys-iwg@xxxxxxxxxxx
> To change your delivery options, retrieve your password, or unsubscribe from this list, visit
> https://dev.eclipse.org/mailman/listinfo/polarsys-iwg
