Publications

PURPOSE

Disruption of lipid bilayer asymmetry is a common feature observed in cancer cells and offers novel routes for therapeutic targeting. We used the natural immune receptor TIM-4 to interrogate for loss of plasma membrane phospholipid polarity in primary acute myelogenous leukemia (AML) samples and evaluated the anti-leukemic activity of TIM-4-L-directed T-cell therapy in preclinical AML models.

EXPERIMENTAL DESIGN

We performed FACS analysis on 33 primary AML bone marrow specimens and correlated TIM-4-L expression frequency and intensity with molecular disease characteristics. Using Kasumi-1 and MV-4-11 AML cell lines, we further tested the anti-leukemic effects of TIM-4-L-directed engineered T cells in vitro and in vivo.

RESULTS

We found that 86% of untreated AML blasts displayed upregulation of cell surface TIM-4-L. These observations were agnostic to AML genetic classification, as samples with mutations in TP53, ASXL1, and RUNX1 displayed TIM-4-L upregulation similar to that seen in favorable and intermediate subtypes. TIM-4-L dysregulation was also stably present in AML cell lines. To evaluate the potential of targeting upregulated TIM-4-L with adoptive T-cell therapy, we constructed TIM-4-L-directed engineered T cells, which demonstrated potent anti-leukemic effects, effectively eliminating AML cell lines with a range of endogenous TIM-4-L expression levels both in vitro and in vivo.

CONCLUSIONS

These results highlight TIM-4-L as a highly prevalent target on AML across a range of genetic classifications and novel target for T-cell-based therapy in AML. Further investigations into the role of TIM-4-L in AML pathogenesis and its potential as an anti-leukemic target for clinical development are warranted.

IMPORTANCE

The introduction of large language models (LLMs), such as Generative Pre-trained Transformer 4 (GPT-4; OpenAI), has generated significant interest in health care, yet studies evaluating their performance in a clinical setting are lacking. Determination of clinical acuity, a measure of a patient's illness severity and level of required medical attention, is one of the foundational elements of medical reasoning in emergency medicine.

OBJECTIVE

To determine whether an LLM can accurately assess clinical acuity in the emergency department (ED).

DESIGN, SETTING, AND PARTICIPANTS

This cross-sectional study identified all adult ED visits from January 1, 2012, to January 17, 2023, at the University of California, San Francisco, with a documented Emergency Severity Index (ESI) acuity level (immediate, emergent, urgent, less urgent, or nonurgent) and with a corresponding ED physician note. A sample of 10 000 pairs of ED visits with nonequivalent ESI scores, balanced for each of the 10 possible pairs of 5 ESI scores, was selected at random.

EXPOSURE

The potential of the LLM to classify acuity levels of patients in the ED based on the ESI across 10 000 patient pairs. Using deidentified clinical text, the LLM was queried to identify the patient with a higher-acuity presentation within each pair based on the patients' clinical history. An earlier LLM was queried to allow comparison with this model.

MAIN OUTCOMES AND MEASURES

Accuracy score was calculated to evaluate the performance of both LLMs across the 10 000-pair sample. A 500-pair subsample was manually classified by a physician reviewer to compare performance between the LLMs and human classification.

RESULTS

From a total of 251 401 adult ED visits, a balanced sample of 10 000 patient pairs was created wherein each pair comprised patients with disparate ESI acuity scores. Across this sample, the LLM correctly inferred the patient with higher acuity for 8940 of 10 000 pairs (accuracy, 0.89 [95% CI, 0.89-0.90]). Performance of the comparator LLM (accuracy, 0.84 [95% CI, 0.83-0.84]) was below that of its successor. Among the 500-pair subsample that was also manually classified, LLM performance (accuracy, 0.88 [95% CI, 0.86-0.91]) was comparable with that of the physician reviewer (accuracy, 0.86 [95% CI, 0.83-0.89]).

CONCLUSIONS AND RELEVANCE

In this cross-sectional study of 10 000 pairs of ED visits, the LLM accurately identified the patient with higher acuity when given pairs of presenting histories extracted from patients' first ED documentation. These findings suggest that the integration of an LLM into ED workflows could enhance triage processes while maintaining triage quality and warrants further investigation.