Validation Information in the Mexican Reference Database Using the ISBSG Database – Francisco Valdés-Souto
Since 2007 to date, in Mexico the use of functional size measurement has been promoted using the COSMIC standard (ISO / IEC 19761), COSMIC is a Mexican Standard (NMX-I-19761) and the functional size is considered a as a significant metric, understanding that it has three qualifiers defined by the Mexican Association of Software Metrics (AMMS) which acronym is BTT:
- BASIC because they are internationally generally accepted standards that allow the generation of derived metrics in the future;
- TRANSVERSAL because they serve to all economic actors and software development roles, to perform their functions (development, test, D&A, self-management, etc.) and transactions (buying and selling, bids, using, etc.);
- TRANSCENDENT because being basic is intended to allow comparison over time (forward and backward) and through different practices, technologies, which are changing.
One of the first steps of the AMMS was to create a reference database for the Mexican Software Development Industry, which was carried out through a public call for projects to be measured using COSMIC.
The approach to dimension the size of the collected projects was the use of the only approximation method that does not require a local calibration (EPCU approximation approach) according to the Expert guide of Early measurement and approach of the COSMIC method.
The reason for using size approximation was that the full requirements of all the projects could not be accessed, sometimes because they did not exist or because they were confidential.
Once the database was made up, with data from the project, effort and cost, as well as the size dimensioned using the EPCU approximation approach, the next question was whether the information was correct, although the approach method used has been broadly studied, how to know that the information obtained was correct?
Some of the studies carried out by ISBSG using the database of the Mexican Software Development Industry were replicated with two purposes:
1.- Validate that the behavior was equivalent, to have a validation that the information obtained was not counter-intuitive
2.- Provide formal reports to the agents of the Mexican Industry of Software development, which serve as references to mitigate the market inefficiency called information asymmetry.
This conference presents an analysis and comparison of some of the results obtained with the AMMS database and the studies carried out by ISBSG
Validation of Supplier Estimates Using COSMIC Method – Francisco Valdés-Souto
In the software development industry, it is well known that software development organizations (suppliers) need a better and formal estimation approaches in order to increase the success rate of software projects developed.
Considering a systematic view, any project requested by a customer needs to be validated in the estimation provided by the supplier, regardless of how formal or not the estimation method utilized was.
However, very often the customers do not know the information used by the suppliers to make their estimations. The software decision-makers must face a validation estimates problem where the more useful solution is used the expert judgment, with several problems related to it.
In this paper, a real case study is described where a validation estimates model was generated from a reference database based on the COSMIC method. The defined model using a density function helps the customer to define validation criteria considering the probability that the supplier estimate will be met according to an industry reference database.