Language barrier falls with checklist change
Divide and conquer
March 2003 Karen Southwick
After several years of work, the CAP has finalized changes to its
Laboratory Accreditation Program checklist questions that clarify what participants
must do to meet calibration verification requirements.
The changes
are designed to eliminate confusing language and probably will not
require most labs to alter their procedures.
"The changes
were necessary because in older versions of the checklist and in
CLIA, the terminologies of calibration, calibration verification,
and reportable range were being used interchangeably," says Greg
Miller, PhD, professor of pathology at Virginia Commonwealth University
Health System, Richmond, and a consultant to the CAP Chemistry Resource
Committee.
Mixing the
terms for two different processes created inconsistencies and confusion
that the Chemistry Resource Committee, aided by the Instrumentation
and Therapeutic Drug Monitoring/ Endocrinology committees, sought
to clear up in the new checklist version.
The two-year
effort was spearheaded by Dr. Miller and Edward R. Ashwood, MD,
immediate past chair of the Chemistry Resource Committee and
chief medical officer and laboratory director at ARUP Laboratories,
Salt Lake City.
Ever since the CLIA regulations took effect, the language on calibration verification
has been vague, Dr. Ashwood says. "Our committee spent hundreds of hours discussing
this and we finally decided to put our own language to it"—namely, "some
very practical questions to put on the checklist that we felt were scientifically
valid."
Separating
terms
The changes
focus on separating calibration verification and analytical measurement
range (AMR) validation. First, "you need to calibrate your instruments
at least every six months or as frequently as the manufacturer recommends,"
says Dr. Ashwood. In lieu of calibration, "you can do something
to prove that calibration hasn’t changed, which is calibration verification"—that
is, assaying suitable material with target values specific for the
method and determining that the correct analyte value is recovered.
Calibration verification or recalibration is also required if the
laboratory has altered its method, such as changing critical reagents
or replacing a critical instrument component.
Second, laboratories
must validate the AMR by demonstrating that "your measurement value
is always linear between the highest and the lowest values," Dr.
Ashwood says. Calibration itself can be a form of AMR validation
if there are at least three calibrators that span the AMR. However,
the manufacturer’s requirements for calibration of many assays use
only one or two calibrators, which correctly set method calibration
over the AMR. Yet a two-point calibration assumes linear recovery
of analyte over the full AMR. In that case, the linear recovery
must be verified separately using materials that span the full AMR.
The CAP checklist requires validation of three points for AMR: the
lowest value, midpoint, and highest value (or values as close to
those points as possible).
"We [in the
committee] prefer at least five," says Dr. Ashwood,
"but CLIA says three," so the checklist question specifies three.
"Once every six months you’ve got to validate your analytical measurement
range: Take a low sample and a high sample, mix them together, and
produce three points."
So most laboratories
must perform two procedures to meet the new checklist requirements:
Calibrate or verify calibration at least every six months and perform
AMR validation at the same interval. If the calibration or calibration
verification includes three or more analyte levels which cover the
AMR, the latter is not required.
Dr. Ashwood
notes that under the old checklist, many inspectors "felt that if
you were calibrating every six months that was enough, so they weren’t
requiring AMR validation." The new checklist language details more
precisely when AMR must be done.
"The majority
of labs will still need to do AMR," Dr. Miller says, because "most
of the commercially available methods do not use calibrators that
cover from the very low to the very high values." Calibration verification
and AMR apply to quantitative procedures, including chemistry, toxicology,
and immunology.
A third term
defined in the checklist is the clinically reportable range (CRR)—the
analyte values that a method can report as a quantitative result,
allowing for specimen dilution or concentration. It is thus an extension
of the AMR. If labs decide to report values outside the AMR, they
must have a defined protocol that, for example, specifies the dilution
agent and stipulates, when applicable, which CRR values are meaningful
as numeric results and when to report less-than or greater-than
information.
At first, Dr.
Ashwood says, the CRR checklist question the committee designed
was not clear enough. "We wanted lab directors to define the upper
limit of the CRR [on each assay]," he says, "but we decided that
was impractical because there are some assays, such as a tumor marker,
you might dilute until a numeric value is obtained." The new checklist
question simply makes sure that if laboratories are diluting specimens,
they have a protocol to follow.
"This protocol
might specify the upper limit, and it might not," says Dr. Ashwood.
"With some assays you can’t do dilutions because they measure ratios.
With other assays you may want to set some upper limits based on
practical clinical considerations." For each procedure, "there should
be language on how to handle specimens with values outside of the
AMR."
Says Dr. Miller,
"If you choose to report results higher or lower than the AMR, you
need to have a defined dilution protocol." Laboratories that don’t
have such protocols should develop them before their next CAP inspection.
Most laboratories,
however, are probably already doing what the checklist changes require.
"This shouldn’t have a major effect on laboratory procedures," Dr.
Miller says. "We haven’t really changed what labs must do. We’re
just clarifying two separate analytical validation procedures."
Nonetheless, laboratories in the CAP Laboratory Accreditation Program are
tremendously interested in the checklist changes. More than 1,600 people participated
in two teleconferences on the changes hosted by Drs. Ashwood and Miller in November.
How
checklists evolve
The CAP inspection
checklists evolve continually under the direction of the resource
committees, says Ronald Lepoff, MD, chair of the Commission on Laboratory
Accreditation and vice chair of pathology at the University of Colorado
Health Sciences Center, Denver.
The recent
changes are important because they end confusion that has existed
for years. "I’ve traveled as far as Singapore for lab meetings and
had people ask me, ’What does this mean?’" he says, referring to
the old calibration verification language.
He praises
Drs. Miller and Ashwood and the committee members for their work.
"We’ve been trying for several years to come up with wording that
makes sense. I think they’ve gotten there."
After the resource
committees—which are responsible for content and practice—recommend
changes for the checklist, the recommendations must be approved
by the commission and ultimately by the LAP checklist commissioner,
now Stephen J. Sarewitz, MD, staff pathologist at Valley Medical
Center, Renton, Wash.
The commissioner’s job is to integrate input from the resource committees
and feedback from members, staff, and accredited laboratories "into
appropriate changes to the checklist," Dr. Sarewitz says. "We also
try to keep the changes practical for our inspectors in the field."
The checklist
changes must also be sent for review to the Centers for Medicare
and Medicaid Services. If the CMS does not object within 30 days,
the updated checklist is posted on the CAP Web site and included
in packets of information sent to labs before their inspections.
The most recent
changes will take effect with the next round of laboratory inspections,
Dr. Lepoff says. The accreditation packet and disk sent to laboratories
contain the checklist version for which they’ll be responsible.
In the future,
Dr. Sarewitz hopes to schedule regular new editions of the checklist
so laboratory professionals know when to expect them. "Previously,
checklists did not come out on a scheduled basis," he says. This
year, he plans checklist editions for release at the end of this
month (incorporating the changes detailed here), the end of July,
and the end of November. After that, "we will go to two editions
a year," he says.
In addition,
to help laboratories identify changes, "we’re instituting a flagging
system in which new and revised questions will be identified," Dr.
Sarewitz says. Also planned for the future are customized checklists
consisting of questions that apply to particular laboratories. For
example, if you’re doing anatomic pathology and excluding electron
microscopy, your laboratory’s customized checklists won’t contain
electron microscopy-related questions.
For more information on the new chemistry checklist and related issues, visit
the CAP Web site. Dr. Miller will make presentations on the changes during the
June 21-25 CLMA/ ASCP meeting and during the July 20-24 AACC meeting. The checklist
workshop at the CLMA/ASCP meeting will take place June 25; the workshop at the
AACC meeting is scheduled for July 22.
Karen Southwick is a writer in San Francisco.
|