Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Bortezomib-contained chemotherapy and thalidomide combined with CHOP (Cyclophosphamide, Doxorubicin, Vincristine, and Prednisone) play promising roles in plasmablastic lymphoma: a case report and literature review.

Clinical lymphoma, myeloma & leukemia·2014

Same author

Activation of a novel c-Myc-miR27-prohibitin 1 circuitry in cholestatic liver injury inhibits glutathione synthesis in mice.

Antioxidants & redox signaling·2014

Same author

[Development of Neglect Evaluation Scale for primary school students aged 6-11 years old in rural areas of China].

Zhonghua yu fang yi xue za zhi [Chinese journal of preventive medicine]·2014

Same author

A novel transgenic mouse model of Chinese Charcot-Marie-Tooth disease type 2L.

Neural regeneration research·2014

Same author

Recombinant adenovirus-mediated overexpression of 3β-hydroxysteroid-Δ24 reductase.

Neural regeneration research·2014

Same author

Development and characterization of microsatellite markers for Melastoma dodecandrum (Melastomataceae).

Applications in plant sciences·2014

Same journal

Protocol for semi-automatic quantitative bioimaging analysis of synapse loss.

STAR protocols·2026

Same journal

Protocol for integrated ubiquitination analysis of in vitro E3 ligase-DUB regulation and in vivo ubiquitin chain linkage characterization.

STAR protocols·2026

Same journal

Protocol for constructing multi-ancestry polygenic models using S4-Multi.

STAR protocols·2026

Same journal

Protocol for inducing deep vein thrombosis in C57BL/6J mice using the inferior vena cava stenosis model.

STAR protocols·2026

Same journal

Overcoming the challenges of genome-editing essential genes.

STAR protocols·2026

Same journal

Protocol for longitudinal two-photon calcium imaging and holographic optogenetic manipulation to investigate memory in mice.

STAR protocols·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Sep 6, 2025

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

Visualizing attention zones in machine reading comprehension models.

Yiming Cui¹, Wei-Nan Zhang², Ting Liu²

¹Research Center for Social Computing and Information Retrieval (SCIR), Harbin Institute of Technology, Harbin 150001, China; State Key Laboratory of Cognitive Intelligence, iFLYTEK Research, Beijing 100083, China.

|June 30, 2022

Summary

This summary is machine-generated.

This study presents a method to visualize attention zones in machine reading comprehension (MRC) models. This aids in understanding model explainability and can be applied to various pretrained language models.

Keywords:

Bioinformatics Cognitive Neuroscience Computer sciences Systems biology

More Related Videos

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Published on: April 11, 2025

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

Related Experiment Videos

Last Updated: Sep 6, 2025

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Published on: April 11, 2025

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

Area of Science:

Natural Language Processing
Artificial Intelligence
Machine Learning

Background:

Attention mechanisms are crucial for machine reading comprehension (MRC) models.
Understanding the explainability of these complex models is an ongoing challenge.

Purpose of the Study:

To develop a pipeline for building MRC models using pretrained language models.
To visualize the influence of attention zones across different model layers for enhanced explainability.

Main Methods:

A protocol and accompanying code were developed to build and visualize MRC models.
The method focuses on visualizing the relevance of each attention zone within the model's layers.

Main Results:

The developed pipeline successfully visualizes attention zone relevance in MRC models.
The approach offers insights into the explainability of pretrained language models.

Conclusions:

The presented protocol provides a practical tool for researchers to understand MRC model behavior.
This visualization technique is generalizable to various pretrained language models, advancing AI explainability.