Tap&Say：スマートフォンにおけるマルチモーダルテキスト補正のためのタッチ位置情報付き大規模言語モデル
Maozheng Zhao1, Shanqing Cai2, Shumin Zhai2
1Department of Computer Science Stony Brook University Stony Brook, New York, USA.
Proceedings of the SIGCHI conference on human factors in computing systems. CHI Conference
|December 25, 2025
まとめ
Tap&Sayは、タッチと音声入力を大規模言語モデル（LLM）と組み合わせることで、モバイルでのテキスト補正を改善する新しいマルチモーダルシステムです。このアプローチにより、コマンドとディクテーションを正確に区別し、編集箇所を特定することで、ユーザーエクスペリエンスが向上します。
関連する概念動画
01:14Design Example: Resistive Touchscreen
674
A device engineer plays a crucial role in designing user interfaces for mobile devices. One such interface is the resistive touchscreen, which fundamentally consists of two metallic layers: a flexible upper layer and a rigid lower layer, separated by a narrow gap. The high resistance between these two layers is a key characteristic of this design.
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
674
01:12Types of Errors: Detection and Minimization
9.3K
Error is the deviation of the obtained result from the true, expected value or the estimated central value. Errors are expressed in absolute or relative terms.
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
Absolute error in a measurement is the numerical difference from the true or central value. Relative error is the ratio between absolute error and the true or central value, expressed as a percentage.
Errors can be classified by source, magnitude, and sign. There are three types of errors: systematic, random, and gross.
Systematic or...
9.3K
02:07Improving Translational Accuracy
3.5K
3.5K
02:07Improving Translational Accuracy
14.0K
Base complementarity between the three base pairs of mRNA codon and the tRNA anticodon is not a failsafe mechanism. Inaccuracies can range from a single mismatch to no correct base pairing at all. The free energy difference between the correct and nearly correct base pairs can be as small as 3 kcal/ mol. With complementarity being the only proofreading step, the estimated error frequency would be one wrong amino acid in every 100 amino acids incorporated. However, error frequencies observed in...
14.0K
01:00Detection of Gross Error: The Q Test
6.8K
When one or more data points appear far from the rest of the data, there is a need to determine whether they are outliers and whether they should be eliminated from the data set to ensure an accurate representation of the measured value. In many cases, outliers arise from gross errors (or human errors) and do not accurately reflect the underlying phenomenon. In some cases, however, these apparent outliers reflect true phenomenological differences. In these cases, we can use statistical methods...
6.8K