A deep learning model performs at the level of an abdominal radiologist in the detection of clinically significant prostate cancer
Prostate cancer is the second most common cancer in men worldwide. Radiologists typically use a technique that combines different MRI sequences (called multiparametric MRI) to diagnose clinically significant prostate cancer. Results are expressed through the Prostate Imaging-Reporting and Data System version 2.1 (PI-RADS), a standardized interpretation and reporting approach. However, lesion classification using PI-RADS has limitations.
“The interpretation of prostate MRI is difficult,” said study senior author Naoki Takahashi, M.D., from the department of radiology at the Mayo Clinic in Rochester, Minnesota. “More experienced radiologists tend to have higher diagnostic performance.”
Applying artificial intelligence (AI) algorithms to prostate MRI has shown promise for improving cancer detection and reducing observer variability, which is the inconsistency in how people measure or interpret things that can lead to errors. However, a major drawback of existing AI approaches is that the lesion needs to be annotated (adding a note or explanation) by a radiologist or pathologist at the time of initial model development and again during model re-evaluation and retraining after clinical implementation.
“Radiologists annotate suspicious lesions at the time of interpretation, but these annotations are not routinely available, so when researchers develop a deep learning model, they have to redraw the outlines,” Takahashi said. “Additionally, researchers have to correlate imaging findings with the pathology report when preparing the dataset. If multiple lesions are present, it may not always be feasible to correlate lesions on MRI to their corresponding pathology results. Also, this is a time-consuming process.”
Takahashi and colleagues developed a new type of deep learning model to predict the presence of clinically significant prostate cancer
Among 5,735 examinations in 5,215 patients, 1,514 examinations showed clinically significant prostate cancer. On both the internal test set of 400 exams and an external test set of 204 exams, the deep learning model’s performance in clinically significant prostate cancer
Since the output from the deep learning model does not include tumor location, the researchers used something called a gradient-weighted class activation map (Grad-CAM) to localize the tumors. The study showed that for true positive examinations, Grad-CAM consistently highlighted the clinically significant prostate cancer
Takahashi sees the model as a potential assistant to the radiologist that can help improve diagnostic performance on MRI through increased cancer detection rates with fewer false positives.
“I do not think we can use this model as a standalone diagnostic tool,” Takahashi said. “Instead, the model’s prediction can be used as an adjunct in our decision-making process.”
The researchers have continued to expand the dataset, which is now twice the number of cases used in the original study. The next step is a prospective study that examines how radiologists interact with the model’s prediction.
“We’d like to present the model’s output to radiologists and assess how they use it for interpretation and compare the combined performance of radiologist and model to the radiologist alone in predicting clinically significant prostate cancer,” Takahashi said.
“Fully Automated Deep Learning Model to Detect Clinically Significant Prostate Cancer
Radiology is edited by Linda Moy, M.D., New York University, New York, N.Y., and owned and published by the Radiological Society of North America, Inc. (https://pubs.rsna.org/

