The review method

The review starts with the study, not the export.

Audit Trail Review as a Service (ATRaaS) follows a question-led, protocol-aware method for clinical studies. QA4Tech Experts establish what the study expects and prepare the evidence without losing its meaning, then review, investigate, and decide, assisted by technology and AI.

Five optical glass forms on connected platforms illustrate successive stages of evidence review.

Perspective

Each audit trail records what changed in one system, when, and under which account. A review has to establish what that means for the study: which participant and assessment were involved, what the protocol expected at that point, and whether the evidence can answer the review question. A combined dataset helps, but integration alone does not establish that records mean the same thing, that an apparent discrepancy is real, or that an export is complete. The method is designed so that each question is asked explicitly, answered from evidence, and recorded — including when the honest answer is that the evidence cannot say.

Practical obstacles

Audit trail data resists review by default.

These obstacles are not peculiar to one system or vendor. Naming them at the start is what separates a review that concludes something from one that produces a very large spreadsheet.

  • Every system exports a different structure, vocabulary, and level of granularity
  • One study activity fragments into many technical records, while one submission can carry many answers with a single recorded time
  • Volume defeats unaided manual reading long before the relevant events surface
  • Technical noise — session, sync, and system entries — buries the human activity
  • Protocol, visit, and process context lives outside the audit trail entirely
  • Activity, data entry, submission, server receipt, and audit-record times are different moments, and time zones and clocks can disagree
  • Shared accounts, blank display names, and undocumented codes limit what a record can establish about who did what
  • Exports can be incomplete, filtered, or truncated without saying so

Principles

Three principles run through every step.

01

Meaning before comparison

Source records keep their original fields, values, codes, and definitions. A common format is useful only when it preserves the differences that matter, so events from different systems are treated as equivalent only where a documented mapping supports it.

02

Expert judgment throughout

Review begins with study understanding and continues through direct examination, investigation, and reporting. It includes questions Experts initiate themselves as well as signals generated by automated checks.

03

Coverage as part of the conclusion

The output explains what was available, what was reviewed, and what could not be established. Missing evidence and uncertain chronology remain visible rather than being resolved by assumption.

Engagement steps

Five steps, with Experts doing the work in each.

The sequence is scaled to the agreed scope. An evidence readiness assessment concentrates on the first three steps and ends with a decision to proceed, revise the scope, or stop.

  1. 01

    Agree the questions and scope

    QA4Tech and the client agree the study, sources, period, priorities, responsibilities, and the scope of the review report. Together they establish what the study team, CRO, or vendors already review and where a cross-system perspective could add to it, and agree the routes for questions, urgent escalation, and follow-up.

  2. 02

    Establish the study context

    Experts examine the applicable protocol versions, amendments, and supporting documents. They identify critical data, milestones, and permitted pathways, and establish the actual system configuration and assessment context. Each expectation the review will test is recorded against the document version it comes from. Specialist input is agreed where needed.

  3. 03

    Assess and prepare the evidence

    Experts assess the exports against their stated scope and establish early what is missing. Original records are preserved and connected into a consistent study view through documented, versioned rules. Identity and time are reconciled only where the evidence supports it; gaps and unresolved mappings are recorded, never treated as passed checks.

  4. 04

    Review, investigate, and decide

    Experts prioritize significant changes and deletions, and protocol-critical data such as primary efficacy and safety data. They follow the participant journey as recorded in the evidence received and pursue their own questions. Automated checks raise signals for Expert assessment. Experts test alternative explanations, request further information, and decide whether the evidence supports a finding, supports no finding, or leaves the question unresolved.

  5. 05

    Report the work and its limits

    Experts prepare the review report, separating observations, interpretation, and conclusions. It states coverage, findings with their evidence-linked case records, legitimate explanations, unresolved questions, recommended follow-up, and what the review does not establish. It also records the evidence baseline and the mapping and method versions, so each conclusion can be traced to the records and versions it rests on.

Evidence flow

Evidence reaches a conclusion only through an Expert.

Experts establish context, assess the evidence, and direct analysis at every stage. Automated checks — and targeted AI, where it is used — return their results to an Expert, never directly to a conclusion.

  1. Evidence and context:
    • Study-system recordsAudit trails and relevant logs from EDC, eCOA, IRT and other study systems
    • Supporting evidenceData change requests, reasons for change, approvals and source definitions
    • Study documentsProtocol and amendments, critical data and critical processes
  2. Preparation:
    • Receive and preserveExperts assess scope, completeness and gaps; original evidence remains accessible
    • Establish study contextExperts interpret the applicable documents and record priorities and expectations
  3. Connection:
    • Connect evidence in study contextNormalize with provenance and reconcile identity and time, retaining original meaning, versions and uncertainty
  4. Review, in a loop between the checks and the Expert:
    • Automated checks and targeted AIRun defined checks and return signals; where used, targeted AI compares and organizes evidence for the Expert
    • Questions Analysis
    • Expert review and investigationInspect records and initiate questions, test explanations, request evidence, assess signals and decide
  5. Outcome:
    • Documented conclusions and follow-upExpert rationale, findings and unresolved cases, with review coverage, limitations and agreed follow-up
How the review is designed. The diagram shows the service method, not a system architecture or a connection to any particular source.

Synthetic example

A questionnaire response changes after submission.

The audit trail establishes that a participant’s answer changed, which account changed it, and when the system recorded it. It does not establish whether the change matters, whether it was appropriate, or how it relates to the rest of the study.

What the Expert examines

  • Instrument, item, and version — what the item measures, which questionnaire version was in use, and how the study uses it
  • Study stage — whether this was a screening, baseline, or later endpoint assessment, since each raises different questions
  • Recorded reason and data change request — whether a reason was recorded (a reason left blank in the source is not the same as a reason field missing from the export), and whether a request matches this participant, visit, form version, and item. A request is supporting evidence, not proof that the change was appropriate.
  • Related events in other systems — randomization and visit records in IRT, and any corresponding data in EDC, as recorded in the evidence received
  • Timestamp meaning — whether each time marks the activity, data entry, submission, server receipt, or audit-record creation, and in which time zone

Where the evidence can lead

Legitimate correction
The Expert establishes that the change matches a documented reason and request, affects the intended record, and fits the study’s permitted process. The case record shows the supporting evidence.
Concern for follow-up
The evidence does not support the change as recorded — for example, the request describes a different item. The Expert documents the concern and a recommendation for the agreed owner.
Inconclusive
Identity, chronology, or supporting records cannot be established from the evidence received. The case is reported as unresolved, with the limitation stated.

Synthetic illustration, not drawn from a real study. A legitimate explanation or an inconclusive assessment can be the correct outcome. Clinical, safety, or instrument questions go to an appropriate specialist through the agreed escalation route; ATRaaS does not assume the investigator’s clinical decision-making or the sponsor’s safety responsibilities.

Terms

Signals, findings, and coverage mean different things.

These distinctions hold from the first automated check to the report, so an apparent anomaly does not become an unsupported claim.

01

Signal

A potential irregularity requiring evaluation; not automatically a confirmed finding. No signal becomes a finding without an Expert’s assessment.

02

Finding

An issue supported by investigated evidence and a documented Expert assessment. A finding can start from a signal or from evidence that no check flagged.

03

Not a finding

An Expert assessment that the evidence does not support an issue. Like every assessment, it requires a written rationale.

04

Inconclusive

An Expert assessment that the evidence received neither supports nor rules out an issue. It is reported as unresolved, with the limitation that prevented a conclusion.

05

Not evaluable

The outcome when a check’s prerequisite evidence is missing — for example, a milestone absent from the export. It is reported as a question that could not be assessed.

06

Review coverage

What systems, records, periods, event types, and evidence were actually available and reviewed.

07

Protocol-aware review

Review informed by the applicable protocol version, amendments, study context, and critical data/process definitions.

The Expert’s role

The checks are an aid to review, not its boundary.

Experts set priorities, examine evidence directly, initiate investigations, weigh alternative explanations, and decide what belongs in the report. They can challenge an automated result or pursue a concern that produced no signal. Nothing is cleared because a check did not flag it.

Technology and AI

Technology directs attention. Experts judge the evidence.

Explicit expectations, such as ordering and timing rules, suit deterministic checks; some contextual comparisons can benefit from targeted AI. Neither establishes the significance of a record or the completeness of the evidence. That remains Expert work.

Deterministic checks

  • Test explicit study expectations, such as the order of events, visit windows, or a required reason for change
  • Show the Expert which records were used and why a signal was raised
  • Report a missing prerequisite as not evaluable, never as a pass
  • Record results that raised nothing, so “nothing flagged” can be told apart from “nothing checked”

Targeted AI assistance, case by case

  • Used for bounded tasks where it helps — for example, comparing recorded changes with data change requests
  • Output stays linked to the evidence it used, so an Expert can verify it
  • Assessed by an Expert before it informs any conclusion; it never reaches one itself
  • Permitted AI use is agreed for each engagement

Evidence limits

Some things a record alone cannot establish.

Where one of these limits applies, the report says so, rather than letting a conclusion reach further than the evidence.

  • A received export is not proof that the export was complete or unaltered
  • Close timestamps suggest a possible relationship, not that one event caused another
  • A late entry is not necessarily a late procedure
  • A questionnaire recorded before randomization is not automatically a protocol deviation
  • An absent record is not evidence that the activity did not happen
  • Timing alone does not establish misconduct
  • A result with no signals or no findings is not proof of a clean study

Evidence principles

Output is built to be defended.

Each conclusion is traceable to the source records it rests on, through a method another reviewer can follow.

01

Original evidence is preserved

Exports are kept as received, separately from anything derived from them, and every record read from an export is given a recorded disposition, including those set aside as out of scope.

02

Events trace back to source

Events in the combined study view link back to the records and fields they were built from, so the source behind a displayed value or time can be shown.

03

Identity and time are reconciled explicitly

Links between participants, visits, forms, and items across systems need a documented basis. Ambiguous matches stay visible, and different kinds of timestamp are not sorted together without qualification.

04

Uncertainty stays visible

Where a time, identity, or code meaning cannot be established, it is recorded as unresolved rather than guessed. A bare date is not shown as midnight; an event with no defensible time is listed, not dropped.

05

Rules and mappings are versioned

Transformation rules are defined for each study’s own system configuration and versioned. A corrected mapping creates a new version rather than overwriting the old one, and the review report records the versions it relied on.

06

Each study on its own terms

The same product can be configured differently in two studies, so each study’s systems are interpreted from that study’s configuration and documents. Familiarity with a product is not knowledge of a study’s set-up.

Start a conversation

Find out what your study’s evidence can establish.

Describe the question that matters and where the evidence for it is held. A short conversation establishes whether an evidence readiness assessment, the usual first step, or a pilot review is the right place to begin.

Schedule a Consultation