AN ATTENTIONAL CORRESPONDENCE OF AUDIO-VISUAL EVENTS
|
Accession number;05A0212961
|
| Title;AN ATTENTIONAL CORRESPONDENCE OF AUDIO-VISUAL EVENTS |
| Author;
NISHIBORI K
(Nagoya Univ., Chikusa-ku, Jpn)
TAKEUCHI Y
(Nagoya Univ., Chikusa-ku, Jpn)
MATSUMOTO T
(Nagoya Univ., Chikusa-ku, Jpn)
KUDO H
(Nagoya Univ., Chikusa-ku, Jpn)
OHNISHI N
(Nagoya Univ., Chikusa-ku, Jpn)
|
Journal Title;IEIC Technical Report (Institute of Electronics, Information and Communication Engineers)
|
Journal Code:S0532B
|
ISSN:0913-5685
|
|
VOL.104;NO.544(IE2004 124-144);PAGE.67-72(2005)
|
| Figure&Table&Reference;FIG.5, TBL.3, REF.6 |
| Pub. Country;Japan |
| Language;English |
| Abstract;A human being understands the environment by integrating information obtained by the senses of sight, hearing and touch. We propose a method of integrating audio-visual information to determine correspondences between audio-visual signals in the real world where the illumination varies and background objects and/or noises exist. The method uses sound source direction as attentional cues and directs attention toward it to observe the scene where a moving object probably exist. After paying attention, the method extracts the visual movement and correspond with the other modalities: hand, sound signals. The model to perceive objects accurately by adjusting camera's iris in varying illumination place or difficult situation to extract the visual movement for an auto-iris. We implemented the method and conducted experiments. The results show the effectiveness of the proposed method in correct corresponding by attention. (author abst.) |
|
|
|
Related Articles;
|
|
