
A New Approach to University IT Project Portfolio Management Based on Multi-Criteria Methods and the COBIT 5 Governance Framework
Majida LAAZIRI, Khaoula BENMOUSSA, Abdelaziz EL ALAOUI EL AMRANI, Ahmed MOUCHTACHI
Journal of Systems Science and Information ›› 2023, Vol. 11 ›› Issue (5) : 636-654.
A New Approach to University IT Project Portfolio Management Based on Multi-Criteria Methods and the COBIT 5 Governance Framework
Project portfolio management is a major challenge for some organizations. In most organizations, there are a large number of projects active at the same time, some not necessarily delivering value or not aligned with their strategic goals. Also universities face a lot of uncertainties when selecting and prioritizing the projects that make up their portfolio. In addition, the achievement of those who are aligned with the strategy of the university becomes a great challenge. So to ensure good project portfolio management, the implementation of selection and prioritization methods and processes becomes important. For the project portfolio management to be effective, it is necessary to establish a structured method adapted to the needs and strategy of the university. In this context, this paper proposes a method for selecting and prioritizing projects within the framework of the portfolio management dedicated to universities, which can promote harmony between the university's strategy, the needs and the priority objectives for enable better decision-making. This method is based on the processes of the COBIT 5 good practice framework, and on the multi-criteria decision-making methods AHP, TOPSIS and the WSM technique, thus, it proposes seven project selection criteria based on the five axes IT governance strategies and two catalysts derived from COBIT 5 enablers. The evaluation and validation of this method was applied in the portfolio management of the Abdelmalek Essaadi Moroccan University (AUE). The result shows that this proposed method has made it possible to make a better selection and prioritization of the portfolio of projects of Abdelmleek Essaadi University having the most value.
IS governance / information systems / project portfolio management / university governance / project prioritization / information technology (IT) / good practice framework / COBIT 5 / APO05 / multi-criteria decision-making method / AHP / TOPSIS / WSM {{custom_keyword}} /
Table 1 Prioritization criteria and associated processes |
Criteria | Description | Associated processes |
Strategic alignment | Strategic Alignment is about ensuring that IT plans remain aligned with business plans; target the most relevant projects for the university's strategy, define, update and validate IT value added proposals; and to align the functioning of IT with the functioning of the university[47,48]. | EDM01: Ensure the definition and maintenance of the governance framework APO: Align, plan and organize BAI06: Manage changes BAI07: Manage acceptance of change and transition VAL IT: Principle 1 VG8 set strategic orientations. |
University needs (stakeholders) | The needs (objectives) of stakeholders must be determined in terms of sustainability in order to identify and select the projects that best meet their needs. | EDM05 Ensure transparency for stakeholders BAI02 Manage the definition of requirements BAI03 Manage the identification and design of solutions VAL IT principle VG 5: Define information requirements. |
Value contribution (Realization of profit) | The Value Contribution consists of determining the added value of each project, ensuring that the projects bring the expected benefits from a strategic point of view, only these projects will be included in the portfolio. | EDS02 Ensure delivery of benefits APO09 Manage service agreements BAI04 Manage availability and capacity SEM01 Monitor, evaluate and measure performance and compliance APO11 Manage quality LSS04 Manage continuity VAL IT principle 3 IM12: Generate / monitor profits. |
Resource optimization | Consists of optimizing the investment in IT resources and ensuring proper management of resources: Applications, information, infrastructure and people, and their alignment with strategic objectives. | EDS04 Ensure optimization of resources APO06 Manage budget and costs APO07 Manage human resources APO10 Manage suppliers BAI09 Manage assets VAL IT Principle 2: PM5 monitor resource requirements and their use. |
Risk management | Managing portfolios requires an awareness of risk on the part of managers, a clear vision of the university's risk appetite, and the assignment of risk management responsibilities within the university. | EDS03 Ensure risk optimization APO12 Manage risks APO13 Manage security LSS02 Manage service requests and incidents LSS03 Manage Problems LSS05 Manage security services LSS06 Manage business process controls. |
Respect for the values, culture and ethics of the university | The culture, ethics and behavior of individuals and the university must be taken into account when selecting projects. It is a factor of success in governance and management activities. A supportive and open-minded culture is necessary to build effective personal relationships, and to build a positive and collaborative environment. | Cobit 5 Enabler 4 Culture, ethics and behavior. |
Think about the skills of the administrative and technical managers of the university. | University managers must be at least as qualified and competent in administrative management services, technical and general skills including Relationship Management, Conflict Management, Influence, Negotiation to be able to effectively design and govern processes and activities. | APO08 Manage Relationships Cobit 5 Enabler 7 People, skills and competences. |
Table 2 List of proposed projects |
Table 3 Scale proposed by SAATY[59] |
Degrees of importance of each characteristic | Definition | Explanation |
1 | Equal importance | Two characteristics contribute in the same way to the goal. |
3 | Low importance of one characteristic over another. | Personal experience and appreciation slightly favor one characteristic over another. |
5 | Strong or decisive importance | Experience and appreciation strongly favor one characteristic over another. |
7 | Very strong or proven importance | A characteristic is strongly favored and its dominance is attested in practice. |
9 | Absolute importance | The evidence favoring one characteristic over another is as convincing as it gets. |
2, 4, 6, 8 | Values associated with intermediate judgments | When a compromise is necessary. |
Table 4 Pairwise comparison |
C1 | C2 | C3 | C4 | C5 | C6 | C7 | |
C1 | 1 | 5 | 4 | 4 | 4 | 5 | 5 |
C2 | 1/5 | 1 | 5 | 3 | 3 | 3 | 1/2 |
C3 | 1/4 | 1/5 | 1 | 1/3 | 1/3 | 1 | 1/4 |
C4 | 1/4 | 1/3 | 3 | 1 | 3 | 2 | 1 |
C5 | 1/4 | 1/3 | 3 | 1/3 | 1 | 3 | 1 |
C6 | 1/5 | 1/3 | 1 | 1/2 | 1/3 | 1 | 1/3 |
C7 | 1/5 | 2 | 4 | 1 | 1 | 3 | 1 |
Table 5 Calculation of the weight with the AHP method |
Criteria | Priority | Ranking |
C1 | 30.6% | 1 |
C2 | 12.8% | 4 |
C3 | 11.2% | 5 |
C4 | 13% | 3 |
C5 | 10.3% | 6 |
C6 | 4.7% | 7 |
C7 | 17.5% | 2 |
Table 6 Values of proposed projects |
| C1 | C2 | C3 | C4 | C5 | C6 | C7 |
A1 | 90 | 70 | 60 | 60 | 60 | 70 | 80 |
A2 | 90 | 60 | 80 | 60 | 60 | 70 | 70 |
A3 | 90 | 80 | 80 | 60 | 60 | 70 | 70 |
A4 | 90 | 70 | 80 | 50 | 60 | 70 | 70 |
A5 | 90 | 70 | 80 | 60 | 60 | 60 | 70 |
A6 | 90 | 50 | 70 | 50 | 50 | 70 | 60 |
Table 7 Calculation matrix for the sum of the criteria of each alternative |
| C1 | C2 | C3 | C4 | C5 | C6 | C7 |
A1 | 8100 | 4900 | 3600 | 3600 | 3600 | 4900 | 80 |
A2 | 8100 | 3600 | 6400 | 3600 | 3600 | 4900 | 4900 |
A3 | 8100 | 6400 | 6400 | 3600 | 3600 | 4900 | 4900 |
A4 | 8100 | 4900 | 6400 | 2500 | 3600 | 4900 | 4900 |
A5 | 8100 | 4900 | 6400 | 3600 | 3600 | 3600 | 4900 |
A6 | 8100 | 2500 | 4900 | 2500 | 2500 | 4900 | 3600 |
SUM | 48600 | 27200 | 34100 | 19400 | 20500 | 28100 | 29600 |
Table 8 Standardized Decision Matrix |
| C1 | C2 | C3 | C4 | C5 | C6 | C7 |
A1 | 0.41 | 0.42 | 0.32 | 0.43 | 0.42 | 0.42 | 0.46 |
A2 | 0.41 | 0.36 | 0.43 | 0.43 | 0.42 | 0.42 | 0.41 |
A3 | 0.41 | 0.49 | 0.43 | 0.43 | 0.42 | 0.42 | 0.41 |
A4 | 0.41 | 0.42 | 0.43 | 0.36 | 0.42 | 0.42 | 0.41 |
A5 | 0.41 | 0.42 | 0.43 | 0.43 | 0.42 | 0.36 | 0.41 |
A6 | 0.41 | 0.30 | 0.38 | 0.36 | 0.35 | 0.42 | 0.35 |
Table 9 Selection of minimum and maximum values |
| 0.41 | 0.49 | 0.43 | 0.43 | 0.42 | 0.42 | 0.46 |
0.41 | 0.30 | 0.32 | 0.36 | 0.35 | 0.36 | 0.35 |
Table 10 Calculation of the measure of separation of alternatives |
Ideal separation | |||||||||
C1 | C2 | C3 | C4 | C5 | C6 | C7 | SUM | ||
A1 | 0 | 0.0147 | 0 | 0.0052 | 0.0049 | 0.0036 | 0.01351 | 0.375144 | 0.61249 |
A2 | 0 | 0.0037 | 0.0117 | 0.0052 | 0.0049 | 0.0036 | 0.00338 | 0.032376 | 0.179935 |
A3 | 0 | 0.0331 | 0.0117 | 0.0052 | 0.0049 | 0.0036 | 0.00338 | 0.395122 | 0.628587 |
A4 | 0 | 0.0147 | 0.0117 | 0 | 0.0049 | 0.0036 | 0.00338 | 0.038251 | 0.195579 |
A5 | 0 | 0.0147 | 0.0117 | 0.0052 | 0.0049 | 0 | 0.00338 | 0.37318 | 0.610885 |
A6 | 0 | 0 | 0.0029 | 0 | 0 | 0.0036 | 0 | 0.006491 | 0.080568 |
Ideal-negative separation | |||||||||
C1 | C2 | C3 | C4 | C5 | C6 | C7 | SUM | ||
A1 | 0 | 0.0037 | 0.0117 | 0 | 0 | 0 | 0 | 0.015407 | 0.124124 |
A2 | 0 | 0.0147 | 0 | 0 | 0 | 0 | 0.00338 | 0.351418 | 0.351418 |
A3 | 0.0011 | 0 | 0 | 0 | 0 | 0 | 0.00338 | 0.351418 | 0.06689 |
A4 | 0 | 0.0037 | 0 | 0.0052 | 0 | 0 | 0.00338 | 0.345543 | 0.587829 |
A5 | 0 | 0.0037 | 0 | 0 | 0 | 0.0036 | 0.00338 | 0.010614 | 0.103022 |
A6 | 0 | 0.0331 | 0.0029 | 0.0052 | 0.0049 | 0 | 0.01351 | 0.3929 | 0.626818 |
Table 11 Calculate the relative proximity of the ideal solution |
G | Projects | |
A1 | 83.1% | DIP |
A2 | 23.2% | DEAE |
A3 | 90.3% | SIMARECH |
A4 | 24.9% | DAE |
A5 | 85.5% | SIMACOOP |
A6 | 11.3% | PGM |
Table 12 Prioritization of alternatives with the WSM technique |
A1 | A2 | A3 | A4 | A5 | A6 | weight | |
C1 | 90 | 90 | 90 | 90 | 90 | 90 | 30.6 |
C2 | 70 | 60 | 80 | 70 | 70 | 50 | 12.8 |
C3 | 60 | 80 | 80 | 80 | 80 | 70 | 11.2 |
C4 | 60 | 60 | 60 | 50 | 60 | 50 | 13 |
C5 | 60 | 60 | 60 | 60 | 60 | 50 | 10.3 |
C6 | 70 | 70 | 70 | 70 | 60 | 70 | 4.7 |
C7 | 80 | 70 | 70 | 70 | 70 | 60 | 17.5 |
Weighting score | 7449 | 7368 | 7626 | 7370 | 7451 | 67223 |
Table 13 Portfolio adjustment using the TOPSIS method |
SIMARECH | 90.3% | 1 |
SIMACOOP | 85.5% | 2 |
DIP | 83.1% | 3 |
DAE | 24.9 % | 4 |
DEAE | 23.2 % | 5 |
PGM | 11.3% | 6 |
Table 14 Portfolio adjustment with the WSM technique |
A1 | SIMARECH | 7626 | 1 |
A2 | SIMACOOP | 7451 | 2 |
A3 | DIP | 7449 | 3 |
A4 | DAE | 7370 | 4 |
A5 | DEAE | 7368 | 5 |
A6 | PGM | 6722 | 6 |
1 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
2 |
ISACA. COBIT5: A business framework for the governance and management of enterprise IT. 2016.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
3 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
4 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
5 |
International Organization for Standardization (ISO). ISO/IEC 38500: 2008, Corporate governance of information technology. Switzerland, 2008.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
6 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
7 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
8 |
Hicks M, Pervan G, Perrin B. A study of the review and improvement of IT governance in Australian universities. CONF-IRM 2012 Proc., May 2012.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
9 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
10 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
11 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
12 |
ISACA. Official website. https://www.isaca.org/.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
13 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
14 |
Pries-Heje J, Venable J, Bunker D, et al. Human benefit through the diffusion of information systems design science research. AICT-318, 2010.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
15 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
16 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
17 |
Blomquist T, Stadnick P. Project portfolio management practices for innovation — A case study at ABN AMRO-Brazil. Handelshgskolan Vid Ume Universitet, 2007.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
18 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
19 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
20 |
Castonguay J, Miller R. La gouvernance des grands projets d'infrastructure publique - Le démarrage des grands projets publics: Éléments de réflexion. CIRANO Project Reports, May 2006.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
21 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
22 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
23 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
24 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
25 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
26 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
27 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
28 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
29 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
30 |
ISACA. COBIT 5: A business framework for the governance and management of enterprise. 2012.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
31 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
32 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
33 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
34 |
Saaty T L. What is the analytic hierarchy process? Mathematical Models for Decision Support, Berlin, Heidelberg: Springer Berlin Heidelberg, 1988: 109–121. Doi: 10.1007/978-3-642-83555-1-5.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
35 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
36 |
Guitouni A, Martel J M, Bélanger M. Cadre méthodologique pour différencier les méthodes multicritères. 2010.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
37 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
38 |
Saaty T L. Analytic network process. Encyclopedia of operations research and management science. Dordrecht: Kluwer Academic Publishers. Doi: 10.1007/1-4020-0611-X-32.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
39 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
40 |
Bafail O A, Abdulaal R M S. A combined BWM-TOPSIS approach versus AHP-TOPSIS approach: An application to solid waste management. IEIM 2022: The 3rd International Conference on Industrial Engineering and Industrial Management. Doi: 10.1145/3524338.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
41 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
42 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
43 |
FERHATI Fatima Zohra Et KAOUANE Nissia. Conception d'un outil d'aide multicritère à la décision pour le ranking des projets d' exploration dans l'amont pètrolier (SONATRACH). Boumerdès, 2017.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
44 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
45 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
46 |
(INERIS) Direction des Risques Chroniques. Panorama des méthodes d'analyse multicritère comme outils d'aide à la décision, 2009.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
47 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
48 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
49 |
Benmoussa K, Laaziri M, Khoulji S, et al. SIMARECH 3: A new application for the governance of scientific research. The First International Conference on Affective Computing, Machine Learning and Intelligent Systems, 2017, 5: 776–784. http://scholarpublishing.org/index.php/TMLAI/article/view/3429.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
50 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
51 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
52 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
53 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
54 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
55 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
56 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
57 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
58 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
59 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
60 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
61 |
Benmoussa K, Laaziri M, Khoulji S, et al. Enhanced model for ergonomic evaluation of information systems: Application to scientific research information system. 2019, 9(1): 683–694. Doi: 10.11591/ijece.v9i1.
{{custom_citation.content}}
{{custom_citation.annotation}}
|
62 |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
{{custom_ref.label}} |
{{custom_citation.content}}
{{custom_citation.annotation}}
|
/
〈 |
|
〉 |