AngioReport: dataset and baseline methods for fundus angiography report generation

To develop an annotated fundus angiographic dataset, including fundus fluorescein angiography (FFA) and indocyanine green angiography (ICGA), and establish baseline methods for automatic report generation.

This retrospective study reviewed patients aged ≥18 years who underwent FFA or ICGA at Rajavithi Hospital, Thailand, between 1 January and 31 December 2019. A total of 55 361 de-identified images from 1691 patients (3179 eyes) were annotated by retinal specialists with detailed descriptions of the type, location, shape, size and pattern of abnormal fluorescence. Two baseline methods were developed: (1) a classification-based approach using ResNet101 with class-specific residual attention for multi-label lesion recognition and (2) a language-generation approach using the Bootstrapping Language-Image Pre-training framework, fine-tuned on angiographic images and structured reports. Model performances were evaluated using F1 score and BERTScore.

The dataset includes 24 diagnostic conditions, with macular neovascularisation (32.5%) being the most prevalent, followed by unremarkable findings (21.8%) and dry age-related macular degeneration (10.2%). Most eyes (81.8%) underwent both FFA and ICGA. Hyperfluorescence was observed in 75.6% of cases, predominantly due to leakage, while hypofluorescence was present in 28.1%. The classification-based method achieved an average score of 7.966, demonstrating superior performance in recognising choroidal neovascularisation, hyperfluorescent and hypofluorescent areas. The language-generation method achieved a comparable average score of 7.947, excelling in impression recognition and the hyperfluorescence identification.

We present the largest annotated fundus angiographic dataset to date, along with two effective baseline methods for automatic report generation, offering a valuable foundation for advancing artificial intelligence applications in ophthalmology.