Insight-to-decision presentation · Seven sections · Scroll to read
Synthetic demonstration · 12 respondents
FIX THE DATA, NOT JUST THE SYMPTOMS
The report gets fixed. The data problem comes back.
A QIB diagnostic of where data-quality responsibility stops short of durable resolution
12
Survey respondents
8/1080%
Reported a recent data problem (among exposed, assessable respondents)
What the evidence suggests
People can finish a report by correcting a dataset locally. When a similar problem returns on the next refresh, that success may have concealed unfinished system work.
This synthetic demonstration uses employee experience to distinguish a problem with finding the owner from one with getting a source problem resolved.
Interpretation
Working question: What causes a known source problem to be repeatedly absorbed downstream?
PRINCIPAL FINDING
A recurring workaround can look like progress while the source stays uncertain.
The snapshot connects recurrence, known ownership, and local remediation—not just their separate rates.
6/785.7%
Personally saw a similar issue recur
6/6100%
Could identify an existing responsible party (among recurrent cases)
5/683.3%
Used local correction with unknown source status or a workaround (among recurrent cases)
1/812.5%
Recent incident confirmed corrected at source
How the cycle works
SOURCE / INTAKE
defect encountered→
ANALYST REPAIR
local cleanup→
OUTPUT DELIVERED
problem may recur→
NEXT DATA CYCLE
↶ The next data cycle can bring the same class of problem back
The loop is a diagnostic hypothesis from recurring experiences and comments, not a verified chain for one unique defect.
What the evidence suggests
Six of seven assessable employees had personally seen a similar issue with their data source/process. Every one of those six identified an existing responsible party. Five nonetheless reported either local correction with unknown source status or a workaround instead of a confirmed source fix.
This looks less like a routing failure and more like a potential learning/repair-loop failure: the immediate deliverable is recovered, but durable prevention is not reliably visible.
Interpretation
A possible data-cascade mechanism is visible: repairing an output is easier to observe than eliminating the condition that required repair.
What respondents said
“We reconstruct missing outcome fields from partner workbooks each month. The data team knows the source is incomplete, but upstream changes keep getting deferred.”
“Two dashboards use incompatible program-status definitions. We remap categories for every report because the original intake fields have not changed.”
Important alternative explanations
Similar problems may be different defects from the same source.
A workaround may be a justified, economic decision.
Unknown source status is not evidence the source remained broken.
Research and guidance
Sambasivan et al., CHI (2021) — Data Cascades in High-Stakes AI. Qualitative interviews with 53 high-stakes AI practitioners identified downstream consequences of under-valued data work; the 92% within-interview finding is not a comparable benchmark. Explanatory mechanism, not evidence of prevalence in this team.
DEEPER DIAGNOSIS
An owner’s name is not the same thing as the power to change a source.
The more revealing question is whether the identified owner can authorize, prioritize, or coordinate a lasting fix.
7/887.5%
Existing owner identifiable for the recent incident
6/6100%
Existing owner identifiable for recurrent cases
Ownership and remediation outcomes
Already clearn=5
3
2
3 local repair; source status unknown; 2 workaround; no source fix
Found after askingn=2
1
1
1 source corrected; 1 scope changed
No clear assignmentn=1
1
1 awaiting a decision
Local repair; source status unknownWorkaround; no source fixSource correctedScope changedAwaiting a decision
What the evidence suggests
For the five most recent incidents where the owner was already clear, respondents reported three work-specific corrections with uncertain source status and two workarounds without source correction. That is a striking contrast to the conventional instinct to solve data problems with an ownership inventory.
The comments point to at least two possible binding constraints: a known owner without capacity to change an import process; and an external-data authorization decision with no agreed decision-maker.
Interpretation
Investigate whether the bottleneck is capacity, authority, competing priorities, or external dependency before redrawing job responsibilities.
What respondents said
“We correct duplicate case records downstream in each report. The source-system owner is known, but does not have capacity to change the import routine.”
“We still do not know who can authorize access to the external data. Several people have offered to help, but there is no agreed decision maker.”
“We found the source owner and corrected a misleading field definition before the team used the results. The correction went into the data dictionary.”
Important alternative explanations
The two owner-located cases have different issue types and cannot be used to infer owner clarity causes outcomes.
The 5/5 pattern is descriptive, not evidence of a general group-level rate.
Research and guidance
UK Government Digital Service (2025) — Data and AI Ethics Framework. Distinguishes accountable data owners, operational stewards and custodians; stresses that responsible people must have the authority and expertise to implement changes. Governance design guidance, not intervention effect estimate.
CONSEQUENCES AND CONTRASTS
The hidden cost is repeated labor—and a declining sense that fixes work.
The effects appear in both the task and employees’ broader assessment of how data issues get resolved.
6/8
Extra work checking, cleaning, or obtaining data
4/8
The work took longer than expected
4/8
Confidence in findings or results was reduced
6/6
Recurrent cases that also involved extra work
Problem frequency × perceived effectiveness
0 reported problemsn=2
2
2 rated well / very well
1–2 reported problemsn=4
1
1
2
1 rated well / very well, 1 rated neither, 2 rated poorly / very poorly
3–9 reported problemsn=4
1
3
1 rated well / very well, 3 rated poorly / very poorly
Rated well / very wellRated neitherRated poorly / very poorly
Counts as reported in Q2 × Q9 cross-tab; not a causal or population relationship.
What the evidence suggests
Extra checking/cleaning or retrieval affected six of eight people describing recent incidents; four reported delays, and four reported reduced confidence. All six recurrent cases were paired with extra work in the snapshot’s recurrence-by-effects table.
Among employees reporting zero problems, both rated remediation well/very well (2/2). Among those reporting 3–9 occasions, three of four rated it poorly/very poorly. The directional contrast is worth investigating, not generalizing.
Interpretation
Repeated friction likely matters more than isolated defects. Preserve early validation and disciplined scope changes—the survey contains concrete examples of both.
What respondents said
“We validate row counts and required fields whenever a new file arrives, and we compare definitions with the previous cycle.”
“Our shared data dictionary and a designated steward make it easy to confirm data are usable before analysis.”
“The available sample excluded several smaller programs. We revised the analysis scope instead of pretending the data represented everyone.”
Important alternative explanations
Different workloads or reporting thresholds could explain the correlation.
Q7 allowed multiple effects; no additive totals.
Research and guidance
Sambasivan et al., CHI (2021) — Data Cascades in High-Stakes AI. Qualitative interviews with 53 high-stakes AI practitioners identified downstream consequences of under-valued data work; the 92% within-interview finding is not a comparable benchmark. Explanatory mechanism, not evidence of prevalence in this team.
RESEARCH-INFORMED RESPONSES
There is no single “data quality” fix. There are at least three decisions.
The right management lever depends on where the fault originates—and whether correction is worth making.
2/8
Recent incident: missing or incomplete data
2/8
Recent incident: errors or conflicting values
2/8
Recent incident: inaccessible or unobtainable data
1/8
Recent incident: unsuitable or unrepresentative data
Rows are management pathways, not mutually exclusive theme frequencies.
What the evidence suggests
The most recent problems span missingness, conflicting values, access, unclear meaning, and suitability. This variety argues against buying a broad cleaning or governance system before locating the consequential repeating sources.
Research supports different responses: production validation for predictable anomalies, accountable authority for access and stewardship decisions, and early data auditing for fit-for-purpose judgments.
Interpretation
A focused source pilot can determine which of these pathways creates actual value, while preserving justified limitation decisions.
What respondents said
“Two dashboards use incompatible program-status definitions. We remap categories for every report because the original intake fields have not changed.”
“We still do not know who can authorize access to the external data. Several people have offered to help, but there is no agreed decision maker.”
“The available sample excluded several smaller programs. We revised the analysis scope instead of pretending the data represented everyone.”
Research and guidance
Breck et al., SysML (2019) — Data Validation for Machine Learning. Describes production validation catching data anomalies earlier, avoiding downstream debugging; enterprise-scale ML application, not proof of ROI here. Applied technical evidence, not small-team causal benchmark.
UK Government Digital Service (2025) — Data and AI Ethics Framework. Distinguishes accountable data owners, operational stewards and custodians; stresses that responsible people must have the authority and expertise to implement changes. Governance design guidance, not intervention effect estimate.
DataKind, Data Audit Playbook — Data Audit. Assess data provenance, quality, bias and suitability early; legitimate outcomes include rescoping or declining a use case rather than cleaning everything. Social-impact data practice guidance, not causal study.
WORKING ACTION PLAN — COMPLETE WITH TEAM
Pick one repeating source problem. Make the next refresh the test.
Proposed experiment, not a decision already made. Choose deliberately, assign authority, and inspect what happens next.
5/683.3%
Recurrent cases resolved locally / by workaround, without confirmed source correction
What the evidence suggests
Select one consequential repeating defect, verify its practical origin, and document the owner who can authorize a source change. Keep a temporary workaround only when needed and record why it is acceptable.
Check the actual next data extract or process execution, not just whether a report was delivered. Then repeat comparable QIB questions over a four-week window to see whether the experience changed.
Interpretation
The hypothesis is testable: if the source is durably corrected, repeated local cleanup should decline on comparable work. A failure to improve should trigger a competing-explanation check.
Start date, next-source-check date, four-week recheck date
Verified source check: defect present, absent, or legitimately accepted?
QIB recheck: recurrence, remediation, cleanup work and confidence
Final decision: scale, adjust, document, or stop
Important alternative explanations
Changing mix of projects or exposure can affect repeat-QIB comparisons.
One cycle might be too short to observe a rare defect.
Research and guidance
UK Government Digital Service (2025) — Data and AI Ethics Framework. Distinguishes accountable data owners, operational stewards and custodians; stresses that responsible people must have the authority and expertise to implement changes. Governance design guidance, not intervention effect estimate.
Breck et al., SysML (2019) — Data Validation for Machine Learning. Describes production validation catching data anomalies earlier, avoiding downstream debugging; enterprise-scale ML application, not proof of ROI here. Applied technical evidence, not small-team causal benchmark.
EXECUTIVE SUMMARY — SYNTHETIC EXAMPLE
The team can identify the owner. It may still be paying for the same defect again.
Better data remediation means closing the loop between the person who discovers a problem and the source that creates it.
Extra checking, cleaning, or obtaining data (among recent incidents)
What the evidence suggests
In this 12-person synthetic demonstration, the standout signal is not missing ownership: all six people who recognized recurrence could identify an existing owner, but five reported local correction of uncertain source status or a workaround.
Comments illustrate deferred upstream changes and capacity/authorization barriers. Academic and professional research suggests why unresolved data work can accumulate downstream and why accountable authority and early validation matter.
What respondents said
“We correct duplicate case records downstream in each report. The source-system owner is known, but does not have capacity to change the import routine.”
Proposed action
Pilot one consequential repeating source defect, establish a decision-maker who can authorize correction, check the next extract, and repeat the QIB on a comparable four-week window.
Decision / action-plan fields
Source / defect:
Decision owner:
Decision deadline:
Next verification:
Limitations. Synthetic and descriptive (n=12). Similar issues are not deduplicated; unknown source status must not be treated as confirmed failure.
Research and guidance
Sambasivan et al., CHI (2021) — Data Cascades in High-Stakes AI. Qualitative interviews with 53 high-stakes AI practitioners identified downstream consequences of under-valued data work; the 92% within-interview finding is not a comparable benchmark. Explanatory mechanism, not evidence of prevalence in this team.
UK Government Digital Service (2025) — Data and AI Ethics Framework. Distinguishes accountable data owners, operational stewards and custodians; stresses that responsible people must have the authority and expertise to implement changes. Governance design guidance, not intervention effect estimate.
Breck et al., SysML (2019) — Data Validation for Machine Learning. Describes production validation catching data anomalies earlier, avoiding downstream debugging; enterprise-scale ML application, not proof of ROI here. Applied technical evidence, not small-team causal benchmark.