Research Article | | Peer-Reviewed

Artificial Intelligence Functions as a Complementary Capability for Monitoring and Evaluation System Effectiveness in African Public Management

Received: 10 August 2026     Accepted: 21 August 2026     Published: 18 September 2026
Views:       Downloads:
Abstract

Artificial intelligence (AI) adoption in Monitoring and Evaluation (M&E) practice has outpaced empirical evidence on its institutional contribution to public management and development policy. This research examines whether deeper AI integration is associated with stronger M&E system effectiveness and whether more effective M&E systems correspond with greater Organizational Evidence Capability and Net Benefits. A cross-sectional analytical survey covered 75 M&E practitioners across 19 African countries. Empirical analysis preserved ordinal properties of survey measures and combined Kruskal-Wallis tests with rank-based associations. Cumulative-logit models provided adjusted estimates that accounted for M&E system maturity. AI-use intensity showed significant associations with System Quality (H = 42.26, ε2 =.553, p <.001), Information Quality (H = 26.98, ε2 =.338, p < .001), and Service Quality (H = 12.73, ε2 =.137, p =.005). Adjusted ordinal models confirmed this pattern, with cumulative odds ratios of 2.75 (95% CI [2.00, 3.78]), 1.94 (95% CI [1.34, 2.82]), and 1.60 (95% CI [1.01, 2.55]), respectively. Stronger M&E System Effectiveness also showed substantial associations with Organizational Evidence Capability (OR = 10.82) and Net Benefits (OR = 7.15). Deeper AI use corresponded with greater reporting efficiency and improved data quality, while evidence use in organizational decisions also increased. No statistically significant association emerged for data-processing time. Findings support a conception of AI as a complementary organizational capability whose value depends on integration into established evidence processes rather than technological access alone. For public management and development policy, AI adoption should therefore remain anchored in M&E system performance and clearly defined evidence requirements for decision-making.

Published in Journal of Public Policy and Administration (Volume 10, Issue 3)
DOI 10.11648/j.jppa.20261003.17
Page(s) 240-255
Creative Commons

This is an Open Access article, distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution and reproduction in any medium or format, provided the original work is properly cited.

Copyright

Copyright © The Author(s), 2026. Published by Science Publishing Group

Keywords

Artificial Intelligence Integration, Monitoring and Evaluation System Effectiveness, Organizational Evidence Capability, Evidence-based Decision-making, Results-based Management, Public Management, Development Management

1. Introduction
1.1. Background and Research Rationale
Public and development organizations increasingly face an evidence-use problem rather than an information-supply problem. Monitoring and Evaluation (M&E) systems connect programme evidence with management and policy choices. Results-based M&E supports performance management and evidence-informed public policy , but its value depends on credible information that reaches decisions. Building on DeLone and McLean , Ba (2021) defines M&E System Effectiveness through System Quality, Information Quality, and Service Quality . This architecture provides the baseline for assessing whether AI reinforces M&E rather than merely adding technology.
The African context gives this distinction particular significance because growth in administrative and programme data has not automatically strengthened evidence use in public management and policy. Institutional conditions shape whether evidence informs decisions , while national ownership influences the legitimacy and durability of M&E systems . Evidence uptake also depends on sustained interaction between those who produce evidence and those who exercise managerial or policy authority . Effective M&E therefore rests on more than technical performance. It requires reliable information systems embedded in institutional arrangements that connect credible evidence with decision authority and managerial choice.
AI expands computational and knowledge-processing capacity within organizations. Machine learning can identify patterns in complex datasets, while contemporary AI systems retrieve and synthesize information at scale . These capabilities can redistribute expertise and alter decision structures , with implications for managerial judgment . Yet automation remains interdependent with human expertise , and productivity effects vary across tasks and organizational settings . For M&E, the central issue is whether AI strengthens evidence production and validation while improving how evidence informs management and policy decisions.
Organizational research suggests that technology access alone is insufficient. AI creates value through complementary capabilities , while readiness shapes the transition from experimentation to effective use . Public-sector studies likewise locate performance and public value in organizational processes and institutional capability . OECD emphasizes governance and organizational capacity , and the World Development Report 2026 highlights complementary infrastructure, data, skills, and institutions in developing economies . M&E maturity may therefore influence both AI adoption and its returns.
AI integration also raises important concerns about evidence integrity. NIST identifies validity, reliability, transparency, and accountability as core requirements for trustworthy AI , while generative systems may produce plausible outputs without adequate factual support . These risks become consequential when AI-assisted evidence informs programme reviews, management decisions, or public policy. A key research gap persists between two largely separate bodies of literature on organizational AI capability and M&E system effectiveness. This research examines whether deeper AI use is associated with stronger M&E performance after adjustment for system maturity and whether stronger M&E performance corresponds with greater Organizational Evidence Capability and Net Benefits.
1.2. Research Objective and Contribution
The research examines AI as a potential reinforcement capability within African M&E systems. It focuses on AI-use intensity rather than binary adoption because occasional access to an AI tool does not establish organizational integration. The objective is to determine whether deeper use across routine M&E functions is associated with stronger M&E system performance and whether that performance is associated with organizational evidence capability and broader system benefits.
The research addresses three questions:
1) How do M&E practitioners use AI across core functions, and to what extent has this use progressed from exploration to operational integration?
2) To what extent is AI-use intensity associated with System Quality, Information Quality, and Service Quality within M&E systems?
3) To what extent is stronger M&E System Effectiveness associated with greater Organizational Evidence Capability and higher M&E System Net Benefits?
The theoretical contribution lies in connecting organizational AI capability with an established model of M&E system effectiveness. Research on AI emphasizes organizational capability and readiness for effective use, whereas M&E scholarship focuses on the quality of evidence systems and their contribution to decision-making. The research therefore situates AI within the institutional processes through which M&E generates organizational value rather than treating technology adoption as an outcome in itself.
This framing also distinguishes AI adoption from operational integration. Episodic use may improve a discrete task without altering the wider evidence system, whereas recurrent use across M&E functions can reshape workflows and strengthen the link between evidence production and managerial decision-making. AI-use intensity therefore offers a more informative measure than a simple distinction between adopters and non-adopters and remains consistent with organizational capability and readiness research .
The African focus extends this argument to an institutional setting that remains underrepresented in research on organizational AI. African evaluation scholarship emphasizes national ownership and the institutional conditions through which evidence acquires legitimacy and enters public decision processes . The central issue therefore extends beyond access to AI and concerns its integration into locally embedded evidence systems, consistent with public-sector AI governance perspectives and with the emphasis on complementary institutional capabilities in developing economies .
The research does not claim causal identification because cross-sectional associations cannot establish whether AI integration precedes stronger M&E performance. Organizations with more mature evidence systems may also possess greater capacity to adopt and institutionalize AI. The empirical analysis therefore tests whether observed relationships are consistent with the proposed reinforcement mechanism while accounting for M&E system maturity.
1.3. Research Framework and Hypotheses
The framework builds on Ba’s (2021) M&E System Effectiveness model , which adapts the DeLone and McLean information-systems success architecture . System Quality, Information Quality, and Service Quality represent core dimensions of M&E performance, while Results-Based Management (RBM), Knowledge and Information Management (KIM), and Evidence-Based Decision-Making (EBDM) capture organizational functions through which evidence supports management and policy decisions. Net Benefits represent the broader organizational value associated with effective M&E. Petter et al. provide additional empirical support for the relationships that connect system quality with use and subsequent organizational benefits .
Figure 1 positions AI-use intensity as a reinforcement layer rather than a fourth effectiveness dimension. AI matters when integration improves functions already embedded in the evidence system. Recent reassessment of the DeLone and McLean model likewise finds its core dimensions relevant under emerging technologies, while trust and information quality require renewed attention .
The mechanism is complementarity because technology creates organizational value through supporting processes and capabilities . Mikalef and Gupta extend this logic to AI , Jöhnk et al. identify readiness conditions , and public-sector studies link AI performance and public value to institutional capability . The framework therefore expects depth of integration to matter more than access.
Figure 1. Research Framework.
AI can reinforce each M&E quality dimension through distinct mechanisms. Automation and data integration can strengthen System Quality by improving workflow efficiency and system functionality. AI-assisted validation, anomaly detection, and predictive analysis can enhance Information Quality, including analysis of unstructured evidence. Generative and natural-language interfaces may improve synthesis and access to information when appropriate methodological controls remain in place. These mechanisms accord with DeLone and McLean , Petter et al. , and Ba’s application of the framework to M&E effectiveness .
The framework then links M&E effectiveness to Organizational Evidence Capability. Stronger systems matter when evidence enters performance management, learning, and decisions. Ba links M&E effectiveness to RBM, KIM, and EBDM , while Amisi et al. show that evidence use depends on institutional relationships . This distinction prevents task efficiency from being equated with system effectiveness and extends the complementarity argument from technical processes to organizational use .
Operational outcomes offer an additional empirical test of this proposition. If deeper AI use strengthens M&E practice, it should improve reporting efficiency and data quality while supporting greater evidence use in decisions. Faster processing may emerge as another benefit. Experimental and workplace studies identify performance gains from generative AI, although effects vary across tasks and organizational contexts . Automation-augmentation research likewise emphasizes continued reliance on professional judgment to convert AI capability into measurable performance gains .
Net Benefits capture downstream organizational outcomes and represent the ultimate expression of information-system success . Within the M&E framework, they encompass improvements in programme and policy management associated with stronger evidence systems and more effective organizational decision-making .
The framework specifies associations, not causal effects. Stronger organizations may possess both mature M&E systems and greater technological capacity . M&E system maturity is therefore controlled, and robustness tests examine whether the principal associations persist across specifications.
On this basis, the research tests the following hypotheses:
1) H1a. Higher AI-use intensity is positively associated with M&E System Quality.
2) H1b. Higher AI-use intensity is positively associated with M&E Information Quality.
3) H1c. Higher AI-use intensity is positively associated with M&E Service Quality.
4) H2. Higher M&E System Effectiveness is positively associated with stronger Organizational Evidence Capability, reflected in RBM, KIM, and EBDM.
5) H3. Higher M&E System Effectiveness is positively associated with greater M&E System Net Benefits.
6) H4. Higher AI-use intensity is positively associated with favorable operational M&E outcomes, reflected in shorter processing and reporting times, improved data quality, and greater use of M&E evidence in decision-making.
Together, the hypotheses test a reinforcement pathway in which deeper AI-use intensity corresponds with stronger M&E system effectiveness, which in turn is associated with greater Organizational Evidence Capability and Net Benefits. The framework connects information-systems success theory, development-management effectiveness, and organizational AI capability without conflating their respective explanatory roles. Ba (2021) provides the conceptual bridge through an evidence-to-decision architecture , while AI-capability theory explains why technological access alone is insufficient to generate organizational value.
2. Materials and Methods
2.1. Research Design, Population, and Data Collection
This research uses a cross-sectional analytical survey to examine associations between AI-use intensity and M&E system effectiveness among practitioners working in Africa. Each respondent assessed a specific M&E system, programme, project, or professional assignment, which served as the unit of analysis and anchored responses in a concrete professional context rather than in abstract perceptions of AI or M&E. Because the design captures observations at a single point in time, it supports theory-driven tests of association but cannot establish temporal precedence or causal effects .
The study targeted professionals directly involved in M&E, including organizational specialists, programme managers, evaluators, researchers, consultants, and practitioners working at the interface between information systems and evidence use. Purposive non-probability sampling introduced variation in institutional context and AI-use intensity by including both non-users and practitioners with operational AI experience. This design serves an explanatory purpose and does not claim statistical representativeness for the broader population of African M&E professionals, in line with AAPOR guidance on inference from non-probability samples .
Table 1. Research design and data-collection profile.

Design element

Specification

Research design

Cross-sectional analytical survey

Unit of analysis

M&E system, programme, project, or professional assignment referenced by respondent

Target population

Professionals with direct involvement in M&E practice in Africa

Sample size

75 observations

Sampling approach

Purposive non-probability sampling

Data collection

Self-administered bilingual web questionnaire

Languages

English and French

Data structure

Structured survey measures plus recoded open-ended responses

Field period

June-July 2026

Data collection took place from June to July 2026 through a self-administered web questionnaire available in English and French (Table 1). The instrument captured respondents’ professional profiles, M&E system maturity, AI-use intensity, specific tools and applications, and constructs defined in the research framework. Five-point ordinal scales measured most perceived changes, while categorical and multiple-response items captured professional characteristics and patterns of AI use .
Open-ended responses complemented structured measures and provided additional insight into how practitioners described AI use in M&E practice. A structured data-mining process examined each response, assigned codes based on substantive meaning, and consolidated equivalent responses into harmonized categories before their inclusion in the analytical dataset. This procedure preserved close correspondence with respondents’ original accounts while enabling systematic comparison, consistent with established approaches to qualitative content analysis .
Final analysis covered 75 observations. Structured variables provided the main basis for hypothesis testing, while recoded open-ended responses supported interpretation of AI-use patterns. Statistical inference remains limited to associations observed within the sample, since causal claims would require designs that establish temporal order and address competing explanations more directly .
2.2. Variables, Constructs, and Measurement
The measurement model distinguishes the intensity of AI use from the maturity of the M&E system within which that use occurs. AI-use intensity serves as the focal explanatory construct, whereas M&E system maturity captures the prior level of institutional development of the system assessed by each respondent. This distinction reduces the risk of attributing to AI differences that may instead reflect the strength of the pre-existing M&E architecture. The outcome structure follows Ba’s adaptation of the DeLone and McLean information-systems success model . It differentiates M&E System Effectiveness from Organizational Evidence Capability and Net Benefits, in accordance with the multidimensional conception of information-system performance established in the literature .
The study measures AI-use intensity on a six-level ordinal scale that ranges from 0 = no use to 5 = organization-wide integration. Intermediate levels distinguish exploration, pilot testing, limited operational use, and regular use across multiple M&E functions. Separate multiple-response measures capture the portfolio of AI tools and the functional scope of their application across data collection, data processing, analysis, reporting, and evidence use. This measurement structure separates the depth of AI integration from the technologies adopted or functions supported. It therefore provides a more precise representation of organizational AI use and remains consistent with research on AI capability and organizational readiness .
M&E system maturity is measured independently on a five-level ordinal scale ranging from no formal M&E system to full institutionalization with continuous improvement. This measure captures organizational context and helps separate AI integration from pre-existing system development. Remaining constructs rely on multi-item scales summarized in Table 2. Most outcome items use a five-point response scale ranging from 1 = no observable effect to 5 = transformational improvement. Higher scores therefore reflect stronger improvements that respondents attribute to AI use rather than absolute assessments of underlying M&E system performance.
Table 2. Variables, categories and measurements.

Variable / construct

Items or categories included

Measurement

Reliability

M&E system maturity

No formal M&E system; basic system applied inconsistently; documented and regularly used system; system integrated into management processes; institutionalized and continuously improved system

5-level ordinal scale, 1-5

Single item

AI-use intensity

No use; exploration only; pilot testing; limited operational use; regular use in multiple functions; organization-wide integration

6-level ordinal scale, 0-5

Single item

AI tools used

Machine learning; NLP; generative AI; computer vision; geospatial AI; decision-support tools. Specific options included Random Forest, regression and classification models, ChatGPT, Claude, Gemini, Copilot, Perplexity, OCR, Google Earth Engine, ArcGIS AI, Power BI Copilot, Tableau AI, AI dashboards, and recommendation systems

Multiple-response binary indicators

AI functional scope

Data collection; data processing; data analysis; reporting; evidence use

Multiple-response indicators

System Quality (SQ)

M&E system design; indicator architecture; theory-of-change design; monitoring efficiency; reduction of manual work; interoperability; staff productivity; compensation for technical capacity gaps

8 items, 1-5

α =.933

Information Quality (IQ)

Data completeness; data accuracy; data consistency; report reliability; reporting timeliness; outcome measurement; attribution analysis; risk identification; early-warning capacity

9 items, 1-5

α =.979

Service Quality (SVQ)

Information availability; information accessibility; response time to information requests; adaptation to emerging information needs; long-term usability of M&E services

5 items, 1-5

α =.968

M&E System Effectiveness (MESE)

Composite of SQ, IQ, and SVQ

Mean of dimension scores

Results-Based Management (RBM)

Results tracking; performance management; accountability

3 items, 1-5

α =.896

Knowledge and Information Management (KIM)

Knowledge capture; knowledge sharing; institutional learning

3 items, 1-5

α =.970

Evidence-Based Decision-Making (EBDM)

Evidence use; decision quality; decision time; confidence in decisions

4 items, 1-5

α =.959

Organizational Evidence Capability (OEC)

Composite of RBM, KIM, and EBDM

Mean of dimension scores

System Quality, Information Quality, and Service Quality form the M&E System Effectiveness construct. Organizational Evidence Capability combines RBM, KIM, and EBDM. Net Benefits capture broader organizational value. Four operational indicators measure reported changes in processing time, reporting time, data quality, and evidence use. Internal consistency was assessed with Cronbach's alpha . Coefficients ranged from .896 to .979, which indicates strong internal coherence. Because very high alpha values can also reflect item redundancy and do not establish construct validity, interpretation remained anchored in the theory-defined measurement structure rather than sample-specific scale optimization .
2.3. Data Management and Analysis
Responses in English and French followed a common variable structure for analysis. Coding retained the direction and ordinal properties of original response scales. The analysis converted multiple-response items into binary indicators and consolidated coded open-ended responses into substantively equivalent categories. Four AI-use stages emerged in the sample, ranging from no use and exploration to limited operational use and regular use across multiple functions. The analysis treated these stages as ordered categories, while M&E system maturity captured institutional context as a categorical variable.
The statistical analysis adopted an ordinal-first strategy, as summarized in Table 3. Descriptive statistics reported medians, interquartile ranges, and response distributions for Likert-type constructs. Rank-based and distribution-free statistics assessed unadjusted relationships, whereas ordinal-response models provided the principal multivariable estimates. This strategy preserves the ordered nature of the response categories without imposing an assumption of equal intervals between adjacent scale points .
Table 3. Statistical analysis strategy.

Analysis / hypothesis

Outcome

Main explanatory variable

Primary estimator

Adjustment

Effect measure

Complementary analysis

Robustness check

Descriptive analysis

AI use, M&E maturity, study constructs

Frequencies; median [IQR]

n,%, median, IQR

Response distributions

H1a

System Quality

AI-use stage

Ordinal GEE, cumulative logit

M&E maturity; item effects

OR [95% CI]

Kruskal-Wallis; ε2; Kendall’s τb

Categorical AI use

H1b

Information Quality

AI-use stage

Ordinal GEE, cumulative logit

M&E maturity; item effects

OR [95% CI]

Kruskal-Wallis; ε2; Kendall’s τb

Categorical AI use

H1c

Service Quality

AI-use stage

Ordinal GEE, cumulative logit

M&E maturity; item effects

OR [95% CI]

Kruskal-Wallis; ε2; Kendall’s τb

Categorical AI use

H2

RBM, KIM, EBDM and OEC

M&E System Effectiveness

Ordinal cumulative-logit model

M&E maturity; item effects

OR [95% CI]

Kendall’s τb; partial Spearman ρ

Additional covariates; alternative link

H3

M&E System Net Benefits

M&E System Effectiveness

Ordinal cumulative-logit model

M&E maturity; item effects

OR [95% CI]

Kendall’s τb; partial Spearman ρ

Additional covariates; alternative link

H4

Processing time, reporting time, data quality, evidence use

AI-use stage

Ordered logit

M&E maturity

OR [95% CI]

Kendall’s τb

Categorical AI use; ordered probit

Note. IQR = interquartile range; ε2 = epsilon-squared; OR = cumulative odds ratio; CI = confidence interval; GEE = generalized estimating equations; RBM = results-based management; KIM = knowledge and information management; EBDM = evidence-based decision-making; OEC = organizational evidence capability
For H1a-H1c, cumulative-logit generalized estimating equation (GEE) models retained item-level responses and accounted for within-respondent dependence. This permits population-averaged estimation for correlated ordinal observations . Robust covariance estimation, with a finite-sample correction where appropriate, supported inference . Kruskal-Wallis tests and Kendall's τb provided complementary evidence on distributional differences and ordered association .
For H2 and H3, M&E System Effectiveness entered cumulative-logit models through respondents' ranked positions rather than an interval-scale assumption. Models estimated associations with Organizational Evidence Capability and Net Benefits after adjustment for M&E system maturity. H4 used proportional-odds models for ordered categories of reported change in processing time, reporting time, data quality, and evidence use. These operational indicators are practitioner-reported performance changes, not independently observed productivity measures.
Robustness checks used categorical representations of AI-use stage, ordered-probit links, selected additional covariates, and sensitivity checks for the proportional-odds structure. Models remained parsimonious because of the sample size. Interpretation emphasized effect magnitude, 95% confidence intervals, and consistency across specifications rather than p-values alone. All tests were two-sided at the 5% level, and the cross-sectional design limits conclusions to conditional associations .
3. Results
3.1. Sample Characteristics and Profile of AI Use
Sample composition includes 75 M&E practitioners from 19 African countries. West Africa represents 74.7% of respondents, while Central and East Africa account for 13.3% and 12.0%, respectively. Professional experience is substantial, with 44.0% reporting 5–10 years in M&E and 49.3% reporting more than 10 years. M&E specialists represent 37.3% of respondents, compared with 24.0% for independent consultants. Agriculture and rural development jointly account for 49.3%. Institutional maturity is comparatively high, as 68.0% assess their referenced M&E system as integrated into management processes or institutionalized with continuous improvement (Table 4).
Table 4. Sample characteristics and M&E system context (N = 75).

Characteristic

Category

n

%

Region

West Africa

56

74.7

Central Africa

10

13.3

East Africa

9

12.0

Professional status

M&E specialist within an organization

28

37.3

Independent consultant

18

24.0

Programme/project manager

14

18.7

Independent evaluator

10

13.3

Researcher/academic

5

6.7

M&E experience

Less than 5 years

5

6.7

5-10 years

33

44.0

11-15 years

18

24.0

16-20 years

5

6.7

More than 20 years

14

18.7

Main sector

Agriculture

24

32.0

Rural development

13

17.3

Humanitarian assistance

9

12.0

Multi-sector

9

12.0

Education

5

6.7

Environment and climate

5

6.7

Social protection

5

6.7

Other

5

6.7

M&E system maturity

No formal M&E system

10

13.3

System documented and regularly used

14

18.7

Integrated into management processes

24

32.0

Institutionalized and continuously improved

27

36.0

Note: Percentages may differ slightly from 100 because of rounding. Maturity categories follow the survey instrument.
AI use shows substantial variation across respondents. Nineteen participants (25.3%) report no current use, while 14 (18.7%) remain at exploration stage. Another 23 respondents (30.7%) report limited operational use, and 19 (25.3%) use AI regularly across multiple M&E functions. No respondent reports pilot testing or organization-wide integration. Overall, 56.0% have moved beyond exploration to operational use, although integration remains less developed in data collection. Only 25.3% report AI use across several collection functions or routine integration into data-collection processes.
The technology profile is concentrated around accessible generative and decision-support tools. Sixty-five respondents (86.7%) report at least one generative-AI platform and 28 (37.3%) at least one AI-enabled decision-support tool. ChatGPT is the most frequently reported platform (74.7%), followed by Gemini (44.0%); Claude and Power BI Copilot each reach 30.7%, and Microsoft Copilot 29.3% (Table 5). The absence of positive selections for named stand-alone machine-learning, NLP, computer-vision, and geospatial-AI tools should not be read as absence of those analytical techniques, because respondents also report predictive and text-analytic applications. Rather, practitioners appear to recognize AI primarily through generative platforms and integrated interfaces.
Table 5. AI tools reported by respondents.

AI tool or platform

n

%

ChatGPT

56

74.7

Gemini

33

44.0

Claude

23

30.7

Power BI Copilot

23

30.7

Microsoft Copilot

22

29.3

Perplexity

10

13.3

AI recommendation systems

9

12.0

Tableau AI

4

5.3

AI dashboards

4

5.3

Note: Multiple responses were permitted; percentages therefore do not sum to 100.
AI applications extend across the M&E workflow. Evidence-use applications have the widest reach (76.0%); each other major functional domain reaches 69.3%. Data cleaning is the most common processing application (62.7%), followed by AI-generated summaries (57.3%) and survey validation (56.0%). Strategic planning (46.7%) and AI-supported recommendations (45.3%) are also prominent, whereas risk scoring and advanced geospatial or scenario applications remain less common (Table 6). The pattern indicates operational diffusion, but its center of gravity remains workflow support, synthesis, and decision-oriented use rather than advanced stand-alone AI deployment.
Table 6. AI-use Applications.

M&E function

Respondents with at least one application, n (%)

Most frequently reported applications

Data collection

52 (69.3)

Survey validation: 42 (56.0%); voice-to-text: 19 (25.3%)

Data processing

52 (69.3)

Data cleaning: 47 (62.7%); quality checks: 33 (44.0%)

Data analysis

52 (69.3)

Predictive analytics: 28 (37.3%); text analytics: 22 (29.3%)

Reporting

52 (69.3)

AI-generated summaries: 43 (57.3%); dashboard generation: 24 (32.0%)

Evidence use

57 (76.0)

Strategic planning: 35 (46.7%); recommendations: 34 (45.3%); decision support: 28 (37.3%)

Note: Respondents could select several applications within each M&E function.
3.2. M&E Effectiveness and Relationships With AI Use
H1a-H1c test whether higher AI-use intensity is associated with stronger System Quality, Information Quality, and Service Quality.
1) H1a: Higher AI-use intensity is positively associated with M&E System Quality (SQ).
2) H1b: Higher AI-use intensity is positively associated with M&E Information Quality (IQ).
3) H1c: Higher AI-use intensity is positively associated with M&E Service Quality (SVQ).
The ordinal distributions show a consistent upward shift across AI-use stages. Median System Quality rises from 2.0 [IQR 1.50-2.75] among non-users to 4.0 [4.00-4.50] among regular multi-function users. Information Quality rises from 2.0 [1.50-3.50] to 4.0 [4.00-4.50], and Service Quality from 2.0 [1.50-4.50] to 4.0 [3.50-5.00]. The strongest separation is therefore observed for System Quality, although all three dimensions of the Ba (2021) framework move in the expected direction .
Among regular multi-function users, 94.1% of System Quality item responses fall in the significant or transformational improvement categories, compared with 27.0% among non-users. The corresponding contrasts are 71.9% versus 29.8% for Information Quality and 80.0% versus 38.9% for Service Quality. These differences occur within the operational attributes of M&E effectiveness rather than in a single global rating, consistent with the distinction among system, information, and service quality in information-systems research .
Table 7. Association between AI-use intensity and M&E effectiveness.

Hypothesis / M&E dimension

Median by AI-use stage*

Kruskal-Wallis H

ε2

Kendall’s τb

Adjusted OR [95% CI]

p-value

Conclusion

H1a - System Quality

2.0 → 3.0 → 3.0 → 4.0

42.26***

.553

.596***

2.75 [2.00-3.78]

<.001

Supported

H1b - Information Quality

2.0 → 3.0 → 4.0 → 4.0

26.98***

.338

.498***

1.94 [1.34-2.82]

<.001

Supported

H1c - Service Quality

2.0 → 3.0 → 3.0 → 4.0

12.73**

.137

.258**

1.60 [1.01-2.55]

.045

Supported, weaker association

Note. AI-use stages progress from no use to exploration, limited operational use, and regular multi-function use. ε2 = Krus-kal-Wallis effect-size estimate; OR = cumulative odds ratio; CI = confidence interval. **p <.01; ***p <.001 for non-parametric statistics. Adjusted models control for M&E system maturity.
H1a receives the strongest support. System Quality shows the largest between-stage difference (H = 42.26, p <.001; ε2 =.553) and the strongest rank association (τb =.596, p <.001). After adjustment for M&E system maturity, each progression in AI-use stage is associated with 2.75 times higher cumulative odds of a stronger System Quality response (95% CI [2.00, 3.78], p <.001). This pattern is consistent with the proposition that AI creates value when it becomes embedded in organizational processes and with System Quality as a foundation of M&E effectiveness .
H1b is also strongly supported. Information Quality differs across AI-use groups (H = 26.98, p <.001; ε2 =.338), with a positive rank association (τb =.498, p <.001). The adjusted cumulative OR is 1.94 (95% CI [1.34, 2.82], p <.001). The result is consistent with AI's potential to strengthen information processing when complementary organizational capabilities are present and with the information-quality pathway in the DeLone and McLean model as applied to M&E .
H1c is supported, but the relationship is weaker. Service Quality differs across AI-use groups (H = 12.73, p =.005; ε2 =.137), and Kendall's τb is .258 (p =.008). The adjusted cumulative OR is 1.60 (95% CI [1.01, 2.55], p =.045). The smaller effect suggests that responsive and useful M&E services depend on organizational and human capabilities that technology does not supply by itself .
Categorical tests confirm significant differences for System Quality (Wald χ2(3) = 80.25, p <.001), Information Quality (χ2(3) = 26.72, p <.001), and Service Quality (χ2(3) = 27.04, p <.001). The progression is not perfectly linear: the clearest separation occurs among regular multi-function users, whereas exploration and limited operational use produce less consistent differences. This pattern supports the distinction between access, experimentation, and an organizationally embedded AI capability .
The evidence therefore suggests an integration threshold rather than a simple adoption gradient. Episodic use may improve isolated tasks without altering the wider M&E system. Recurrent use across functions creates more opportunity to affect workflows, information production, and access to evidence. This interpretation is compatible with research showing heterogeneous productivity gains once AI becomes part of routine professional work .
Taken together, H1a-H1c are supported. The association is strongest for System Quality, followed by Information Quality, and is more moderate for Service Quality. Convergence across distributional tests, rank coefficients, effect-size estimates, and adjusted ordinal models supports the reinforcement proposition, while the cross-sectional design precludes causal interpretation.
3.3. Organizational Evidence Capability, Net Benefits, and Operational Gains
H2 tests the association between M&E System Effectiveness (MESE) and Organizational Evidence Capability (OEC). H3 tests MESE and Net Benefits. H4 tests AI-use intensity against reported changes in processing time, reporting time, data quality, and evidence use.
OEC has a median of 4.0 [IQR 3.0-4.0]. Kendall's τb equals .798 for KIM,.726 for RBM, and .663 for EBDM (all p <.001), and .827 for OEC overall. After adjustment for M&E system maturity, the partial rank correlation between MESE and OEC remains .858 (p <.001). The association therefore spans the organizational evidence functions rather than a single dimension.
Table 8. Relationships between M&E system effectiveness, organizational evidence capability, and net benefits.

Hypothesis

Outcome

Median [IQR]

Kendall’s τb

Partial ρ*

Adjusted cumulative OR [95% CI]

p-value

Conclusion

H2

Results-Based Management

3.0 [3.0-4.0]

.726***

.765***

12.59 [6.10-26.00]

<.001

Supported

H2

Knowledge & Information Management

4.0 [3.0-4.0]

.798***

.851***

35.47 [13.85-90.85]

<.001

Supported

H2

Evidence-Based Decision-Making

4.0 [3.25-4.0]

.663***

.718***

6.80 [3.93-11.77]

<.001

Supported

H2

Overall Organizational Evidence Capability

4.0 [3.0-4.0]

.827*

.858*

10.82 [6.60-17.74]

<.001

Supported

H3

M&E System Net Benefits

3.0 [2.5-4.0]

.638*

.687*

7.15 [4.35-11.76]

<.001

Supported

Note. IQR = interquartile range; OR = cumulative odds ratio; CI = confidence interval. ***p <.001. Partial Spearman coef-ficients control for M&E system maturity. Cumulative-logit models pool ordinal item responses within each outcome construct, include item fixed effects, and use respondent-clustered robust standard errors. MESE enters as a standardized rank of the respondent-level median; ORs therefore represent the change in cumulative odds associated with a one-standard-deviation increase in the ordinal rank of MESE. Source: authors' calculations.
A one-standard-deviation increase in ranked MESE is associated with 10.82 times higher cumulative odds of a stronger OEC response (95% CI [6.60, 17.74], p <.001). Component estimates are also large: KIM OR = 35.47, RBM OR = 12.59, and EBDM OR = 6.80 (Table 8). These estimates indicate strong ordinal concordance between related constructs, not causal effect sizes, and are consistent with the evidence-to-decision architecture and information-systems theory .
H3 is also supported because Net Benefits have a median of 3.0 [2.5-4.0], with τb =.638 and a maturity-adjusted partial ρ = .687 (both p < .001). The adjusted cumulative OR is 7.15 (95% CI [4.35, 11.76], p <.001). High reported benefits are most common for programme design (57.3%), strategic planning (56.0%), and portfolio management (56.0%), consistent with the downstream role of Net Benefits .
Operational indicators provide a distinct test of H4. At least a 26% improvement is reported by 68.0% of respondents for data-processing time, 74.7% for reporting time, 73.3% for data quality, and 80.0% for evidence use in decisions. These are practitioner estimates rather than independently measured changes.
Table 9. Association between AI-use intensity and reported operational M&E gains.

Operational outcome

≥26% gain

Kendall’s τb

Adjusted stage-trend OR [95% CI]

p-value

Regular use vs. no use OR [95% CI]

Joint categorical p-value

H4 result

Data-processing time reduction

68.0%

.174

1.37 [0.88-2.15]

.165

2.30 [0.61-8.61]

.423

Not supported

Reporting-time reduction

74.7%

.349***

1.99 [1.27-3.10]

.002

6.76 [1.83-25.00]

.015

Supported

Data-quality improvement

73.3%

.350***

2.00 [1.29-3.09]

.002

6.70 [1.85-24.23]

.012

Supported

Greater evidence use in decisions

80.0%

.289**

1.83 [1.21-2.78]

.004

4.83 [1.51-15.40]

.033

Supported

Note. OR = cumulative odds ratio; CI = confidence interval. **p <.01; ***p <.001 for Kendall's τb. Stage-trend estimates use cumulative-logit models with HC3 robust standard errors and adjust for M&E system maturity. The categorical speci-fication estimates each observed AI-use stage separately. Source: authors' calculations.
Each progression in AI-use stage is associated with higher reporting-time reduction (OR = 1.99, 95% CI [1.27, 3.10], p =.002), data-quality improvement (OR = 2.00, 95% CI [1.29, 3.09], p =.002), and evidence use (OR = 1.83, 95% CI [1.21, 2.78], p =.004). The processing-time estimate is positive but not statistically significant (OR = 1.37, p =.165). H4 is therefore supported for reporting efficiency, data quality, and evidence use, but not for data-processing time (Table 9).
The categorical specification reinforces the stage-trend results. Relative to non-users, regular multi-function users have 6.76 times higher odds of a stronger reporting-time reduction category, 6.70 times higher odds of data-quality improvement, and 4.83 times higher odds of greater evidence use. Joint categorical effects are significant for these outcomes but not processing time. Exploration alone shows no comparable separation.
Robustness tests leave H2 and H3 materially unchanged. The OEC estimate remains 10.14 [6.03-17.07] after adding AI-use stage and 10.75 [6.33-18.27] after further adjustment for experience and professional status. The corresponding Net Benefits estimates are 7.35 [4.56-11.83] and 9.04 [5.20-15.72]. Alternative cumulative-probit models yield the same substantive conclusions (p <.001).
H4 is similarly stable after additional adjustment: AI-use stage remains significant for reporting time (OR = 1.94, p =.035), data quality (OR = 1.92, p =.037), and evidence use (OR = 2.04, p =.028), while processing time remains non-significant (OR = 1.25, p =.454). Ordered-probit models reproduce the same pattern.
Overall, H2 and H3 receive strong support and H4 partial support. Stronger M&E effectiveness is associated with evidence capability and broader M&E benefits. Deeper AI use is associated with selected operational gains, but the processing-time result shows that benefits do not arise uniformly across tasks .
Results align with the proposed pathway. Deeper AI integration corresponds with stronger M&E effectiveness, while stronger M&E effectiveness is associated with greater Organizational Evidence Capability and higher Net Benefits. AI use also relates to several operational improvements. Consistency across ordinal specifications reinforces this empirical pattern, although temporal ordering and unobserved organizational differences remain unresolved.
4. Discussion
4.1. Interpretation and Theoretical Contribution
Findings support a view of AI as a reinforcement capability within M&E effectiveness rather than as an additional dimension of system performance. Associations are strongest for System Quality and Information Quality, while Service Quality shows a more moderate relationship. Similar patterns extend to Organizational Evidence Capability and Net Benefits. Overall, results align more closely with capability complementarity than with a direct technology-to-performance relationship.
System Quality provides the clearest entry point for AI integration. AI can reduce manual burden, improve information flows, and strengthen recurrent M&E processes, all of which correspond to system characteristics that underpin effective information use . This finding extends Ba’s M&E framework by showing that AI becomes most consequential when organizations embed it in routine evidence processes rather than confine its use to isolated analytical tasks.
Information Quality shows the same direction but a less uniform gradient. Stronger results are concentrated among regular multi-function users, which distinguishes adoption from integration. Access to a platform may improve an individual task; recurrent organizational use has greater potential to alter validation, synthesis, and analytical routines. This interpretation is consistent with AI capability and readiness research .
The weaker Service Quality association limits technological determinism. Faster retrieval or synthesis does not ensure more responsive M&E services because responsiveness depends on institutional arrangements, user relationships, and professional judgment. This boundary accords with complementarity theory and public-sector evidence on the institutional mediation of AI value .
Downstream findings extend the argument from technical performance to evidence use. MESE is strongly associated with RBM, KIM, and EBDM, supporting Ba's evidence-to-decision architecture . The especially strong KIM relationship is consistent with evidence-use research. M&E has limited institutional value when findings remain confined to reports rather than enter relationships and processes that connect producers with decision-makers . This logic also reflects DeLone and McLean's emphasis on use and consequences .
The association with Net Benefits clarifies AI's place in the chain. AI need not have a direct path to organizational outcomes. Its contribution can arise through reinforcement of M&E processes that connect information quality to evidence capability and programme management . This is consistent with AI value as an organizational capability rather than technology ownership .
Operational findings add an important qualification. AI use is associated with reporting efficiency, data quality, and evidence use, but not reliably with processing time. Effects therefore vary by task, as other experimental and workplace evidence also shows . The automation-augmentation paradox suggests that value emerges through interaction with professional expertise rather than wholesale substitution .
The theoretical contribution is thus the integration of M&E effectiveness with organizational AI capability. Ba explains how M&E quality connects to evidence capability and benefits , while AI capability and readiness research explains why technology requires institutional integration . The concentration of stronger outcomes among regular multi-function users suggests a possible integration threshold, but causal and temporal tests remain necessary.
4.2. Institutional and Policy Implications
The results shift managerial attention from AI adoption counts to evidence-system performance. Regular use across several M&E functions appears more consequential than exploration, which means that platform access or isolated pilots are weak indicators of organizational AI capability. Institutions should identify specific M&E processes where AI can address a documented constraint and assess whether its integration improves system performance .
M&E maturity should guide the pace of integration. AI can add value in workflow management, information retrieval, quality control, and analytical support, but weak underlying processes can limit those returns. Organizational readiness is a prerequisite for effective use , and complementary capabilities remain important in developing-economy contexts . Institutions with fragile evidence systems may therefore gain more from strengthening core processes before expanding advanced AI applications.
Professional capability remains equally important. AI can accelerate analytical work, but responsibility for methodological interpretation and contextual validity remains with M&E professionals. The augmentation perspective implies that organizations need capacity to scrutinize AI-assisted evidence, identify unsuitable uses, and retain human authority over consequential judgments . Without such scrutiny, technical efficiency can become an evidentiary risk.
AI modernization should also remain anchored in the evidence-to-decision architecture. Faster information production has limited value if outputs do not enter programme reviews, performance discussions, and management decisions. This implication follows the M&E effectiveness model and evidence-use research that emphasizes institutional relationships rather than information availability alone .
At policy level, capability-centered frameworks are preferable to technology-centered adoption targets. Public institutions should assess whether AI strengthens defined evidence and decision functions, while governance keeps pace with operational use. OECD analysis emphasizes institutional capacity in public-sector AI , and public-administration research links value creation to organizational capability . NIST governance principles and the documented risk of unsupported generative outputs further imply that traceability, validation, and accountable human oversight are essential when AI-assisted evidence enters public decisions.
For African development institutions, the appropriate strategy is staged AI integration tied to demonstrated M&E value. The absence of a robust processing-time association cautions against assuming uniform benefits. Different levels of M&E maturity also make a single adoption model inappropriate. AI should therefore be treated as part of evidence-system strengthening, with the pace and scope of integration matched to institutional readiness and with success assessed through measurable improvements in evidence quality and decision use.
4.3. Limitations and Future Research
The cross-sectional design does not establish temporal precedence, and stronger evidence systems may also have greater digital capacity and a higher propensity to adopt AI. Adjustment for M&E system maturity and robustness checks reduce, but do not eliminate, reverse causality or residual confounding. The findings should therefore be interpreted as conditional associations rather than causal effects . Longitudinal designs could follow systems as they move from experimentation to recurrent integration.
The purposive sample of 75 experienced practitioners provides useful variation but does not support statistical generalization to all African M&E systems. West Africa is overrepresented, and no cases occupy the highest organization-wide AI-integration category. Larger comparative samples could test whether the observed relationships differ by country, sector, or institutional setting and whether the apparent advantage of regular multi-function use persists at more advanced stages .
Most outcomes are practitioner assessments, including the ordered percentage-change indicators. Future studies should combine survey measures with system logs, reporting timestamps, data-quality audits, and documented evidence-use decisions. Larger samples would also permit ordinal confirmatory factor analysis and structural models of the full pathway from AI integration through M&E effectiveness to evidence capability and net benefits, which would provide stronger tests of the conceptual distinctions in Ba and complementary-capability theory .
Future research should therefore test where, when, and for whom AI integration improves M&E performance. Comparative longitudinal designs that incorporate organizational readiness, professional capability, governance, and objective performance measures would provide a stronger basis for examining the integration threshold suggested here and for testing the interaction between AI and human expertise .
5. Conclusion
The principal contribution of this research is to reposition AI within the institutional architecture of evidence-informed public and development management. AI should not constitute a parallel technological system alongside M&E. Its strategic value lies in its capacity to reinforce an effective evidence system through which organizations connect information with managerial and policy choices. This perspective extends the M&E System Effectiveness framework of Ba (2021) beyond the conventional production of monitoring evidence and places it within a changing administrative environment where technological capability increasingly shapes how institutions interpret performance and exercise decision authority.
For public organizations, this means that AI strategy should begin with decision requirements rather than technology availability. Institutions need to identify where evidence currently fails to reach decisions with sufficient quality or timeliness and determine whether AI can strengthen that pathway. Such an approach makes M&E the institutional reference point for AI investment. Technologies acquire value when they improve the evidence available to managers and policymakers, not when organizations merely increase the number of AI applications in use. It also aligns technological investment with public-management objectives rather than allowing digital innovation to evolve independently of administrative performance.
Rapid technological change makes this orientation even more important. Organizations cannot base durable AI strategies on particular platforms whose capabilities may change quickly. They need an adaptive institutional capacity that can assess emerging applications against the continuing requirements of evidence quality and decision relevance. Professional judgment must retain authority over consequential interpretations, while governance arrangements should ensure that AI-supported evidence remains sufficiently credible for public accountability. The challenge is therefore not to institutionalize specific technologies, but to build M&E systems capable of absorbing useful technological change without weakening the standards that give evidence its administrative legitimacy.
The strategic way forward is to make AI-enabled M&E part of the institutional architecture for effective public management. Governments and development organizations should treat AI integration as an extension of evidence-system strengthening, with success assessed by its contribution to the quality of organizational decisions. Under this approach, effective M&E provides continuity in a technological environment defined by rapid change. It gives institutions a disciplined basis for determining where AI adds value and for translating that value into more evidence-responsive public action. This capacity, rather than technological sophistication itself, will determine whether AI becomes a durable reinforcement of development management and public policy.
Abbreviations

AAPOR

American Association for Public Opinion Research

AI

Artificial Intelligence

EBDM

Evidence-Based Decision-Making

GEE

Generalized Estimating Equations

IQ

Information Quality

IT

Information Technology

KIM

Knowledge and Information Management

M&E

Monitoring and Evaluation

MEL

Monitoring, Evaluation and Learning

MESE

Monitoring and Evaluation System Effectiveness

NB

Net Benefits

NIST

National Institute of Standards and Technology

NLP

Natural Language Processing

OEC

Organizational Evidence Capability

OECD

Organisation for Economic Co-operation and Development

RBM

Results-Based Management

SQ

System Quality

SVQ

Service Quality

WDR

World Development Report

Author Contributions
Abdourahmane Ba: Conceptualization, Data curation, Formal Analysis, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing
Paul Sarfo Mensah: Conceptualization, Investigation, Methodology, Project administration, Supervision, Validation, Writing – review & editing
Data Availability Statement
The data is available from the authors upon reasonable request.
Conflicts of Interest
The authors declare no conflicts of interest.
References
[1] Kusek, J. Z., & Rist, R. C. (2004). Ten steps to a results-based monitoring and evaluation system: A handbook for development practitioners. World Bank.
[2] Mackay, K. (2010). Conceptual framework for monitoring and evaluation. PREM Notes and Special Series on the Nuts and Bolts of Government M&E Systems, No. 1. World Bank.
[3] DeLone, W. H., & McLean, E. R. (2003). The DeLone and McLean model of information systems success: A ten-year update. Journal of Management Information Systems, 19(4), 9-30.
[4] Ba, A. (2021). How to measure monitoring and evaluation system effectiveness? African Evaluation Journal, 9(1), a553.
[5] Abrahams, M., Etta, F., Tarsilla, M., & Wotela, K. (2021). Evidence-based decision-making in the era of big data. African Evaluation Journal, 9(1), a602.
[6] Morkel, C., & Sibanda, A. (2022). Country-led monitoring and evaluation systems through the lens of participatory governance and co-production: Implications for a Made in Africa Evaluation approach. African Evaluation Journal, 10(1), a622.
[7] Amisi, M. M., Awal, M. S., Pabari, M., & Bedu-Addo, D. (2021). How relationship and dialogue facilitate evidence use: Lessons from African countries. African Evaluation Journal, 9(1), a559.
[8] Jordan, M. I., & Mitchell, T. M. (2015). Machine learning: Trends, perspectives, and prospects. Science, 349(6245), 255-260.
[9] Russell, S., & Norvig, P. (2021). Artificial intelligence: A modern approach (4th ed.). Pearson.
[10] Faraj, S., Pachidi, S., & Sayegh, K. (2018). Working and organizing in the age of the learning algorithm. Information and Organization, 28(1), 62-70.
[11] Shrestha, Y. R., Ben-Menahem, S. M., & von Krogh, G. (2019). Organizational decision-making structures in the age of artificial intelligence. California Management Review, 61(4), 66-83.
[12] Jarrahi, M. H. (2018). Artificial intelligence and the future of work: Human-AI symbiosis in organizational decision making. Business Horizons, 61(4), 577-586.
[13] Raisch, S., & Krakowski, S. (2021). Artificial intelligence and management: The automation-augmentation paradox. Academy of Management Review, 46(1), 192-210.
[14] Brynjolfsson, E., Li, D., & Raymond, L. (2025). Generative AI at work. The Quarterly Journal of Economics, 140(2), 889-942.
[15] Mikalef, P., & Gupta, M. (2021). Artificial intelligence capability: Conceptualization, measurement calibration, and empirical study on its impact on organizational creativity and firm performance. Information & Management, 58(3), 103434.
[16] Jöhnk, J., Weißert, M., & Wyrtki, K. (2021). Ready or not, AI comes - An interview study of organizational AI readiness factors. Business & Information Systems Engineering, 63(1), 5-20.
[17] Mikalef, P., Lemmer, K., Schaefer, C., Ylinen, M., Fjørtoft, S. O., Torvatn, H. Y., Gupta, M., & Niehaves, B. (2023). Examining how AI capabilities can foster organizational performance in public organizations. Government Information Quarterly, 40(2), 101797.
[18] van Noordt, C., & Tangi, L. (2023). The dynamics of AI capability and its influence on public value creation of AI within public administration. Government Information Quarterly, 40(4), 101860.
[19] OECD. (2025). Governing with artificial intelligence: The state of play and way forward in core government functions. OECD Publishing.
[20] World Bank. (2026). World Development Report 2026: The promise of artificial intelligence. World Bank.
[21] National Institute of Standards and Technology. (2023). Artificial intelligence risk management framework (AI RMF 1.0) (NIST AI 100-1). U.S. Department of Commerce.
[22] Ji, Z., Lee, N., Frieske, R., Yu, T., Su, D., Xu, Y., Ishii, E., Bang, Y. J., Chen, D., Dai, W., Chan, H. S., Madotto, A., & Fung, P. (2023). Survey of hallucination in natural language generation. ACM Computing Surveys, 55(12), Article 248, 1-38.
[23] Ba, A. (2026). Institutionalizing Evaluation as a Governance Capability: Evidence from Agriculture and Economic Policy in Africa. Journal of Public Policy and Administration, 10(1), 1-17.
[24] Petter, S., DeLone, W., & McLean, E. (2008). Measuring information systems success: Models, dimensions, measures, and interrelationships. European Journal of Information Systems, 17(3), 236-263.
[25] Saba, P., DeLone, W., Ul-Ain, N., Harfouche, A., Ben Nasr, I., Biot-Paquerot, G., & Mallek, S. (2025). The DeLone and McLean information systems success model: What is the future evolution for its foundations, components, and applications? Communications of the Association for Information Systems, 57, 878-898.
[26] Melville, N., Kraemer, K., & Gurbaxani, V. (2004). Review: Information technology and organizational performance: An integrative model of IT business value. MIS Quarterly, 28(2), 283-322.
[27] Noy, S., & Zhang, W. (2023). Experimental evidence on the productivity effects of generative artificial intelligence. Science, 381(6654), 187-192.
[28] Spector, P. E. (2019). Do not cross me: Optimizing the use of cross-sectional designs. Journal of Business and Psychology, 34(2), 125-137.
[29] American Association for Public Opinion Research. (2013). Report of the AAPOR task force on non-probability sampling. AAPOR.
[30] Dillman, D. A., Smyth, J. D., & Christian, L. M. (2014). Internet, phone, mail, and mixed-mode surveys: The tailored design method (4th ed.). Wiley.
[31] Hsieh, H.-F., & Shannon, S. E. (2005). Three approaches to qualitative content analysis. Qualitative Health Research, 15(9), 1277-1288.
[32] Krippendorff, K. (2018). Content analysis: An introduction to its methodology (4th ed.). SAGE.
[33] Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334.
[34] McNeish, D. (2018). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412-433.
[35] Agresti, A. (2010). Analysis of ordinal categorical data (2nd ed.). Wiley.
[36] McCullagh, P. (1980). Regression models for ordinal data. Journal of the Royal Statistical Society: Series B (Methodological), 42(2), 109-142.
[37] Liang, K.-Y., & Zeger, S. L. (1986). Longitudinal data analysis using generalized linear models. Biometrika, 73(1), 13-22.
[38] Mancl, L. A., & DeRouen, T. A. (2001). A covariance estimator for GEE with improved small-sample properties. Biometrics, 57(1), 126-134.
[39] Kruskal, W. H., & Wallis, W. A. (1952). Use of ranks in one-criterion variance analysis. Journal of the American Statistical Association, 47(260), 583-621.
Cite This Article
  • APA Style

    Ba, A., Mensah, P. S. (2026). Artificial Intelligence Functions as a Complementary Capability for Monitoring and Evaluation System Effectiveness in African Public Management. Journal of Public Policy and Administration, 10(3), 240-255. https://doi.org/10.11648/j.jppa.20261003.17

    Copy | Download

    ACS Style

    Ba, A.; Mensah, P. S. Artificial Intelligence Functions as a Complementary Capability for Monitoring and Evaluation System Effectiveness in African Public Management. J. Public Policy Adm. 2026, 10(3), 240-255. doi: 10.11648/j.jppa.20261003.17

    Copy | Download

    AMA Style

    Ba A, Mensah PS. Artificial Intelligence Functions as a Complementary Capability for Monitoring and Evaluation System Effectiveness in African Public Management. J Public Policy Adm. 2026;10(3):240-255. doi: 10.11648/j.jppa.20261003.17

    Copy | Download

  • @article{10.11648/j.jppa.20261003.17,
      author = {Abdourahmane Ba and Paul Sarfo Mensah},
      title = {Artificial Intelligence Functions as a Complementary Capability for Monitoring and Evaluation System Effectiveness in African Public Management},
      journal = {Journal of Public Policy and Administration},
      volume = {10},
      number = {3},
      pages = {240-255},
      doi = {10.11648/j.jppa.20261003.17},
      url = {https://doi.org/10.11648/j.jppa.20261003.17},
      eprint = {https://article.sciencepublishinggroup.com/pdf/10.11648.j.jppa.20261003.17},
      abstract = {Artificial intelligence (AI) adoption in Monitoring and Evaluation (M&E) practice has outpaced empirical evidence on its institutional contribution to public management and development policy. This research examines whether deeper AI integration is associated with stronger M&E system effectiveness and whether more effective M&E systems correspond with greater Organizational Evidence Capability and Net Benefits. A cross-sectional analytical survey covered 75 M&E practitioners across 19 African countries. Empirical analysis preserved ordinal properties of survey measures and combined Kruskal-Wallis tests with rank-based associations. Cumulative-logit models provided adjusted estimates that accounted for M&E system maturity. AI-use intensity showed significant associations with System Quality (H = 42.26, ε2 =.553, p 2 =.338, p 2 =.137, p =.005). Adjusted ordinal models confirmed this pattern, with cumulative odds ratios of 2.75 (95% CI [2.00, 3.78]), 1.94 (95% CI [1.34, 2.82]), and 1.60 (95% CI [1.01, 2.55]), respectively. Stronger M&E System Effectiveness also showed substantial associations with Organizational Evidence Capability (OR = 10.82) and Net Benefits (OR = 7.15). Deeper AI use corresponded with greater reporting efficiency and improved data quality, while evidence use in organizational decisions also increased. No statistically significant association emerged for data-processing time. Findings support a conception of AI as a complementary organizational capability whose value depends on integration into established evidence processes rather than technological access alone. For public management and development policy, AI adoption should therefore remain anchored in M&E system performance and clearly defined evidence requirements for decision-making.},
     year = {2026}
    }
    

    Copy | Download

  • TY  - JOUR
    T1  - Artificial Intelligence Functions as a Complementary Capability for Monitoring and Evaluation System Effectiveness in African Public Management
    AU  - Abdourahmane Ba
    AU  - Paul Sarfo Mensah
    Y1  - 2026/09/18
    PY  - 2026
    N1  - https://doi.org/10.11648/j.jppa.20261003.17
    DO  - 10.11648/j.jppa.20261003.17
    T2  - Journal of Public Policy and Administration
    JF  - Journal of Public Policy and Administration
    JO  - Journal of Public Policy and Administration
    SP  - 240
    EP  - 255
    PB  - Science Publishing Group
    SN  - 2640-2696
    UR  - https://doi.org/10.11648/j.jppa.20261003.17
    AB  - Artificial intelligence (AI) adoption in Monitoring and Evaluation (M&E) practice has outpaced empirical evidence on its institutional contribution to public management and development policy. This research examines whether deeper AI integration is associated with stronger M&E system effectiveness and whether more effective M&E systems correspond with greater Organizational Evidence Capability and Net Benefits. A cross-sectional analytical survey covered 75 M&E practitioners across 19 African countries. Empirical analysis preserved ordinal properties of survey measures and combined Kruskal-Wallis tests with rank-based associations. Cumulative-logit models provided adjusted estimates that accounted for M&E system maturity. AI-use intensity showed significant associations with System Quality (H = 42.26, ε2 =.553, p 2 =.338, p 2 =.137, p =.005). Adjusted ordinal models confirmed this pattern, with cumulative odds ratios of 2.75 (95% CI [2.00, 3.78]), 1.94 (95% CI [1.34, 2.82]), and 1.60 (95% CI [1.01, 2.55]), respectively. Stronger M&E System Effectiveness also showed substantial associations with Organizational Evidence Capability (OR = 10.82) and Net Benefits (OR = 7.15). Deeper AI use corresponded with greater reporting efficiency and improved data quality, while evidence use in organizational decisions also increased. No statistically significant association emerged for data-processing time. Findings support a conception of AI as a complementary organizational capability whose value depends on integration into established evidence processes rather than technological access alone. For public management and development policy, AI adoption should therefore remain anchored in M&E system performance and clearly defined evidence requirements for decision-making.
    VL  - 10
    IS  - 3
    ER  - 

    Copy | Download

Author Information
  • Business Science Institute, IaeLyon School of Management, Lyon, France

    Biography: Abdourahmane Ba is a Statistician-Engineer and public policy and evaluation specialist with over 20 years of experience across Africa. He holds a Doctor of Business Administration from IAE Lyon 3 Jean Moulin, Business Science Institute and has led major evaluations, MEL systems, and evidence-generation initiatives for governments and international development institutions. His research focuses on evaluation system effectiveness, evidence-informed public policy, data quality, and institutional learning. An author of peer-reviewed articles and books on evaluation and public policy, Dr. Ba combines quantitative methods with institutional analysis to strengthen the use of evidence in policy design, implementation, evaluation, and public-sector decision-making.

    Research Fields: Evaluation systems and evaluation capacity; evidence-informed public policy and decision-making; public policy evaluation; development programme evaluation; MEL systems effectiveness; knowledge management and institutional learning; data quality and verification; monitoring in fragile and constrained settings; applied statistics and impact evaluation; economic and development policy; education policy and evaluation.

  • Institute for Rural Development and Innovation Studies (IRDIS), Kwame Nkrumah University of Science and Technology (KNUST), Kumasi, Ghana

    Biography: Paul Sarfo Mensah is an Associate Professor and Development Consultant at the Institute for Rural Development and Innovation Studies, Kwame Nkrumah University of Science and Technology, Ghana. He has over 35 years of experience in research, evaluation, and evidence-informed public policy, with expertise in agriculture, natural resource management, rural development, and institutional capacity. He has led and contributed to major assignments for USAID, FAO, the World Bank, AfDB, DANIDA, UNFPA, UNICEF, and other development partners. His work covers baseline studies, performance and impact evaluations, policy research, and the translation of evidence into policy advice for government institutions. He has published more than 40 peer-reviewed articles and has extensive experience in linking research, evaluation, and policy decision-making.

    Research Fields: Evidence-informed public policy; monitoring, evaluation and learning; development economics; agriculture and rural development; natural resource governance; environmental policy; local governance and decentralization; impact evaluation; institutional capacity development; and knowledge-to-policy translation, agriculture and rural development, resilience, climate change.

  • Abstract
  • Keywords
  • Document Sections

    1. 1. Introduction
    2. 2. Materials and Methods
    3. 3. Results
    4. 4. Discussion
    5. 5. Conclusion
    Show Full Outline
  • Abbreviations
  • Author Contributions
  • Data Availability Statement
  • Conflicts of Interest
  • References
  • Cite This Article
  • Author Information