Difference between revisions of "Sound Visualization"
ValterAlves (Talk | contribs) m |
ValterAlves (Talk | contribs) m |
||
(5 intermediate revisions by the same user not shown) | |||
Line 21: | Line 21: | ||
| revisions =Introduced in version 1.0 | | revisions =Introduced in version 1.0 | ||
| description= | | description= | ||
− | [[Sound Visualization]] consists | + | [[Sound Visualization]] consists of providing graphical representations to accompany occurring sounds. There are some reasons for this to be interesting: |
* Emphasizing some aspect of the sound, by providing a cross-modal reinforcement of the perception. | * Emphasizing some aspect of the sound, by providing a cross-modal reinforcement of the perception. | ||
* Enabling the game to be played and enjoyed without sound. This is relevant in several circumstances: | * Enabling the game to be played and enjoyed without sound. This is relevant in several circumstances: | ||
− | ** for playing in noisy environments (e.g. using mobile platforms). | + | ** for playing in noisy environments (e.g., using mobile platforms). |
** for playing in places where the context obliges that the sound is mute or very low volume. | ** for playing in places where the context obliges that the sound is mute or very low volume. | ||
** for hard-of-hearing or deaf players<ref name="deafgamers"/>. | ** for hard-of-hearing or deaf players<ref name="deafgamers"/>. | ||
* In the particular case of [[Dialogue]]: overcome language comprehension difficulties by reading subtitles, possibly in another language, as explored in [[Subtitles and Captions]]. | * In the particular case of [[Dialogue]]: overcome language comprehension difficulties by reading subtitles, possibly in another language, as explored in [[Subtitles and Captions]]. | ||
− | + | Typical solutions adopted in games are (common to other media): | |
*Diegetic approaches: | *Diegetic approaches: | ||
− | ** Drawing sound waves, which allows | + | ** Drawing sound waves, which allows locating the source, and possibly the reach and the receptors of that sound, but does not allow knowing the sound itself. |
− | ** Drawing an onomatopoeia, possibly next to the source of the sound, which allows | + | ** Drawing an onomatopoeia, possibly next to the source of the sound, which allows learning what sound it is, and possibly the source. |
*Non-Diegetic approach: | *Non-Diegetic approach: | ||
** as explored in [[Subtitles and Captions]]: Inscribe a descriptor of the occurring sounds as closed captions, possibly embedded in subtitles, which allows a verbose description of the several aspects of the sound. | ** as explored in [[Subtitles and Captions]]: Inscribe a descriptor of the occurring sounds as closed captions, possibly embedded in subtitles, which allows a verbose description of the several aspects of the sound. | ||
Line 40: | Line 40: | ||
| examples= | | examples= | ||
− | | ex1=<mt p="SoundVisualization" g="Patapon" w="{{R16by9W}}" h="{{R16by9H}}">The | + | | ex1=<mt p="SoundVisualization" g="Patapon" w="{{R16by9W}}" h="{{R16by9H}}">The whole visual representation pulses with the sound - from the most objective, as the rectangle in the border and the drums' onomatopoeias (mapping the [[Sound Input]]), to the more subtle, as the moves and details of the characters (which map and the [[Sound Input]] and the sound they echo themselves).</mt> |
| ex2=<mt p="SoundVisualization" g="Cut The Rope" altg="Cut the Rope" w="{{ViPhoneW}}" h="{{ViPhoneH}}"></mt> | | ex2=<mt p="SoundVisualization" g="Cut The Rope" altg="Cut the Rope" w="{{ViPhoneW}}" h="{{ViPhoneH}}"></mt> | ||
| ex3=<mt p="SoundVisualization" g="Ecco" altg="Ecco the Dolphin" w="{{RPS2W}}" h="{{RPS2H}}"></mt> | | ex3=<mt p="SoundVisualization" g="Ecco" altg="Ecco the Dolphin" w="{{RPS2W}}" h="{{RPS2H}}"></mt> | ||
| ex4=<mt p="SoundVisualization" g="DevilsTuningFork" altg="Devil's Tuning Fork" w="{{R5by4W}}" h="{{R5by4H}}"></mt> | | ex4=<mt p="SoundVisualization" g="DevilsTuningFork" altg="Devil's Tuning Fork" w="{{R5by4W}}" h="{{R5by4H}}"></mt> | ||
− | | ex5=<mt p="SoundVisualization" g="SingStar" w="{{R16by9W}}" h="{{R16by9H}}"></mt> | + | | ex5=<mt p="SoundVisualization" g="SingStar" altg="SingStar Vol.3" w="{{R16by9W}}" h="{{R16by9H}}"></mt> |
| ex6=<mt p="SoundVisualization" g="Spore" w="{{R4by3W}}" h="{{R4by3H}}"></mt> | | ex6=<mt p="SoundVisualization" g="Spore" w="{{R4by3W}}" h="{{R4by3H}}"></mt> | ||
| ex7=<mt p="SoundVisualization" g="Ocarina Of Time" altg="The Legend of Zelda: Ocarina of Time" w="{{R4by3W}}" h="{{R4by3H}}"></mt> | | ex7=<mt p="SoundVisualization" g="Ocarina Of Time" altg="The Legend of Zelda: Ocarina of Time" w="{{R4by3W}}" h="{{R4by3H}}"></mt> |
Latest revision as of 14:43, 19 July 2012
The card's front face | The card's back face |
Synopsis
Graphical perception of the occurrence of sound. |
Relationships
May relate to:
Sound Input , Rhythm Gameplay , Pitch Gameplay .
May use:
Subtitles and Captions .
Description
Sound Visualization consists of providing graphical representations to accompany occurring sounds. There are some reasons for this to be interesting:
- Emphasizing some aspect of the sound, by providing a cross-modal reinforcement of the perception.
- Enabling the game to be played and enjoyed without sound. This is relevant in several circumstances:
- for playing in noisy environments (e.g., using mobile platforms).
- for playing in places where the context obliges that the sound is mute or very low volume.
- for hard-of-hearing or deaf players[1].
- In the particular case of Dialogue: overcome language comprehension difficulties by reading subtitles, possibly in another language, as explored in Subtitles and Captions.
Typical solutions adopted in games are (common to other media):
- Diegetic approaches:
- Drawing sound waves, which allows locating the source, and possibly the reach and the receptors of that sound, but does not allow knowing the sound itself.
- Drawing an onomatopoeia, possibly next to the source of the sound, which allows learning what sound it is, and possibly the source.
- Non-Diegetic approach:
- as explored in Subtitles and Captions: Inscribe a descriptor of the occurring sounds as closed captions, possibly embedded in subtitles, which allows a verbose description of the several aspects of the sound.
Examples
Additional Comments
For game reviews sensitive to their usage by deaf gamers see deafgamers.com[1]
References
- ↑ 1.01.1 Deaf Gamers http://www.deafgamers.com
Cite error: <ref>
tag with name "pending" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "AlvesACE11" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Stockburger2006" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "otocky-1" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "isaza-rdr" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "mossarrows" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Sheffield" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Griffin" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Jones" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "TobinAndInfamous" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "HerbertAndLifeInADay" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Trier2000" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Baraka" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Stocco2012" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Hatch2011" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Spielberg" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Ament" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Messiaen" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Whalen2004" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "WhartonCollins2011" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "apologizetomymule" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "afistfulofdollars" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "theSilence" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Loughlin2010" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "AlvesAM11" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "AlvesAM09" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "AlvesAM10" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "AlvesCh11" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Augoyard" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Leeds" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Sonnenschein" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Alexander79" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Alexander77" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Alves2009" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Alves2011a" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Augoyard" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Bj.C3.B6rk" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Borchers" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Erl" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Frauenberger" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Gamma" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Gilliam" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Holowka" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Jackson" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Kunert" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Leeds" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Marks2009ch8" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Marks2009" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Pajitnov" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Peck2001" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Peck2007" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Smaragdis2009a" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Smaragdis2009b" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Sonnenschein" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "UESP._2010._Oblivion:NPCs" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Viers" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Vlissides" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Alves" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Alexander" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Borchers" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Erl" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Gamma" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Tidwell" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Bjork" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Frauenberger" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Alves" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Alves" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Holowka" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Peck" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Halskov" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Lucero" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Schell" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Nielsen" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Heylighen" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Aarseth" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Alves" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Alves" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Atwater" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Augoyard" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Barr" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Brewster" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Collins2008a" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Collins2008b" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Cs.C3.ADkszentmih.C3.A1lyi" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Cunningham" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Cunningham" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Dam.C3.A1sio" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Dam.C3.A1sio" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Dam.C3.A1sio" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Deutsch" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Ekman" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Ekman" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Farnell" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Follett" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Frauenberger" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Freeman" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Gouk" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Grimshaw2007" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Grimshaw2008" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Grimshaw2009" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Hassenzahl" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Hassenzahl" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Hermann" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "J.C3.B8rgensen" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "J.C3.B8rgensen" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "J.C3.B8rgensen" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Juslin" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Kallmann" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Kramer" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Lane" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Ledoux" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Leeds" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Lynch" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Mahlke" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Mahlke" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Marks.26Novak2009" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Nacke" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Nettle" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Norman" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Norman" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Parker" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Peck" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Peck" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Roque" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Schafer" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Schafer" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Schell" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Sider" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Sonnenschein" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Sotamaa" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "The_Curious_Team._1999._Curious_about_space:_Can_you_hear_sounds_in_space.3F_Ask_an_Astronomer._Retrieved_September_31" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Tinwell" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Truax" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Truax" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "World_soundscape_project._n.d.._Retrieved_September_31" defined in <references>
is not used in prior text.
Cite error: <ref>
tag with name "Wrightson" defined in <references>
is not used in prior text.