Difference between revisions of "Sound Visualization"

From SoundInGames.com - Sound Design in Games
Jump to: navigation, search
m
m
Line 35: Line 35:
  
 
| examples=
 
| examples=
| ex4=<mt p="SoundVisualization" g="Patapon" w="{{R16by9W}}" h="{{R16by9H}}">The all visual representation pulses with the sound - from the most objective, as the rectangle in the border and the drums' onomatopoeias (mapping the [[Sound Input]]), to the more subtle, as the moves and details of the characters (which map and the [[Sound Input]] and the sound they echo themselves).</mt>
+
| ex1=<mt p="SoundVisualization" g="Patapon" w="{{R16by9W}}" h="{{R16by9H}}">The all visual representation pulses with the sound - from the most objective, as the rectangle in the border and the drums' onomatopoeias (mapping the [[Sound Input]]), to the more subtle, as the moves and details of the characters (which map and the [[Sound Input]] and the sound they echo themselves).</mt>
| ex3=<mt p="SoundVisualization" g="Cut The Rope" altg="Cut the Rope" w="{{ViPhoneW}}" h="{{ViPhoneH}}"></mt>
+
| ex2=<mt p="SoundVisualization" g="Cut The Rope" altg="Cut the Rope" w="{{ViPhoneW}}" h="{{ViPhoneH}}"></mt>
| ex5=<mt p="SoundVisualization" g="Ecco" altg="Ecco the Dolphin" w="{{RPS2W}}" h="{{RPS2H}}"></mt>
+
| ex3=<mt p="SoundVisualization" g="Ecco" altg="Ecco the Dolphin" w="{{RPS2W}}" h="{{RPS2H}}"></mt>
| ex_=<mt p="SoundVisualization" g="DevilsTuningFork" altg="Devil's Tuning Fork" w="{{R5by4W}}" h="{{R5by4H}}"></mt>
+
| ex4=<mt p="SoundVisualization" g="DevilsTuningFork" altg="Devil's Tuning Fork" w="{{R5by4W}}" h="{{R5by4H}}"></mt>
| ex1=<mt p="SoundVisualization" g="SingStar" w="{{R16by9W}}" h="{{R16by9H}}"></mt>
+
| ex5=<mt p="SoundVisualization" g="SingStar" w="{{R16by9W}}" h="{{R16by9H}}"></mt>
| ex2=<mt p="SoundVisualization" g="Spore" w="{{R4by3W}}" h="{{R4by3H}}"></mt>
+
| ex6=<mt p="SoundVisualization" g="Spore" w="{{R4by3W}}" h="{{R4by3H}}"></mt>
| ex6=<mt p="SoundVisualization" g="Ocarina Of Time" altg="The Legend of Zelda: Ocarina of Time" w="{{R4by3W}}" h="{{R4by3H}}"></mt>
+
| ex7=<mt p="SoundVisualization" g="Ocarina Of Time" altg="The Legend of Zelda: Ocarina of Time" w="{{R4by3W}}" h="{{R4by3H}}"></mt>
| ex7 =<mt p="Dialogue" g="Gadget" altg="iGadget" w="{{ViPhoneH}}" h="{{ViPhoneW}}">In this game, due to the option of not using [[Dialogue]], the subtitles </mt>
+
| ex8 =<mt p="Dialogue" g="Gadget" altg="iGadget" w="{{ViPhoneH}}" h="{{ViPhoneW}}">In this game, due to the option of not using [[Dialogue]], the subtitles </mt>
 
| showrefs=1
 
| showrefs=1
 
}}
 
}}

Revision as of 19:54, 21 December 2011

Front face Back face
The card's front face The card's back face

Synopsis

Graphical perception of the occurrence of sound.

Relationships

May relate to:
Sound Input , Rhythm Gameplay , Pitch Gameplay .
May use:
Subtitles and Captions .

Description

Sound Visualization consists in poviding graphical representations to accompany occurring sounds. There are some reasons for this to be interesting:

  • Emphasising some aspect of the sound, by providing a cross-modal reinforcement of the perception.
  • Enabling the game to be played and enjoyed without sound. In turn this is critical in several circumstances:
    • for playing in noisy environments (e.g. using mobile platforms)
    • for playing in places where the context obliges that the sound is mute or very low volume.
    • for hard-of-hearing or deaf players[1]
  • In the particular case of Dialogue: overcome language comprehension difficulties by reading subtitles, possibly in another language, as explored in Subtitles and Captions.

Most typical solutions adopted in games are (common too other other media):

  • Diegetic approaches:
    • Drawing sound waves, which allows to locate the source, and possibly the reach and the receptors of that sound, but does not allow to know the sound itself.
    • Drawing an onomatopoeia, possibly next to the source of the sound, which allows to learn what sound it is, and possibly the source.
  • Non-Diegetic approach:
    • as explored in Subtitles and Captions: Inscribe a descriptor of the occurring sounds as closed captions, possibly interweaved with subtitles, which allows a verbose description of the several aspects of the sound

Examples

Patapon: The all visual representation pulses with the sound - from the most objective, as the rectangle in the border and the drums' onomatopoeias (mapping the Sound Input), to the more subtle, as the moves and details of the characters (which map and the Sound Input and the sound they echo themselves).
Cut the Rope:
Ecco the Dolphin:
[show less examples...]
Devil's Tuning Fork:
SingStar:
Spore:
The Legend of Zelda: Ocarina of Time:
iGadget: In this game, due to the option of not using Dialogue, the subtitles

Additional Comments

For game reviews sensitive to their usage by deaf gamers see deafgamers.com[1]


References

  1. 1.01.1 Deaf Gamers http://www.deafgamers.com

Cite error: <ref> tag with name "pending" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "AlvesACE11" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Stockburger2006" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "otocky-1" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "isaza-rdr" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "mossarrows" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Sheffield" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Griffin" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Jones" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "TobinAndInfamous" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "HerbertAndLifeInADay" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Trier2000" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Baraka" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Stocco2012" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Hatch2011" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Spielberg" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Ament" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Messiaen" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Whalen2004" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "WhartonCollins2011" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "apologizetomymule" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "afistfulofdollars" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "theSilence" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Loughlin2010" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "AlvesAM11" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "AlvesAM09" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "AlvesAM10" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "AlvesCh11" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Augoyard" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Leeds" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Sonnenschein" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alexander79" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alexander77" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves2009" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves2011a" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Augoyard" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Bj.C3.B6rk" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Borchers" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Erl" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Frauenberger" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Gamma" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Gilliam" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Holowka" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Jackson" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Kunert" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Leeds" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Marks2009ch8" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Marks2009" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Pajitnov" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Peck2001" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Peck2007" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Smaragdis2009a" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Smaragdis2009b" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Sonnenschein" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "UESP._2010._Oblivion:NPCs" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Viers" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Vlissides" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alexander" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Borchers" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Erl" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Gamma" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Tidwell" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Bjork" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Frauenberger" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Holowka" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Peck" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Halskov" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Lucero" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Schell" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Nielsen" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Heylighen" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Aarseth" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Atwater" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Augoyard" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Barr" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Brewster" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Collins2008a" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Collins2008b" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Cs.C3.ADkszentmih.C3.A1lyi" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Cunningham" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Cunningham" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Dam.C3.A1sio" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Dam.C3.A1sio" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Dam.C3.A1sio" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Deutsch" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Ekman" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Ekman" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Farnell" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Follett" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Frauenberger" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Freeman" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Gouk" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Grimshaw2007" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Grimshaw2008" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Grimshaw2009" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Hassenzahl" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Hassenzahl" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Hermann" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "J.C3.B8rgensen" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "J.C3.B8rgensen" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "J.C3.B8rgensen" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Juslin" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Kallmann" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Kramer" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Lane" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Ledoux" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Leeds" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Lynch" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Mahlke" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Mahlke" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Marks.26Novak2009" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Nacke" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Nettle" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Norman" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Norman" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Parker" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Peck" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Peck" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Roque" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Schafer" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Schafer" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Schell" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Sider" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Sonnenschein" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Sotamaa" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "The_Curious_Team._1999._Curious_about_space:_Can_you_hear_sounds_in_space.3F_Ask_an_Astronomer._Retrieved_September_31" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Tinwell" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Truax" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Truax" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "World_soundscape_project._n.d.._Retrieved_September_31" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Wrightson" defined in <references> is not used in prior text. FakeX-front-v10.pngFakeX-back-v10.png