Difference between revisions of "Sound Visualization"

From SoundInGames.com - Sound Design in Games
Jump to: navigation, search
m
m
 
(9 intermediate revisions by the same user not shown)
Line 2: Line 2:
 
| name =Sound Visualization
 
| name =Sound Visualization
 
| deckversion =1.0
 
| deckversion =1.0
−
| synopsis =Graphical perception of the occurrence of sound
+
| v10synopsis =Graphical perception of the occurrence of sound
 +
| v20synopsis =Graphical perception of the occurrence of sound
 
| patternpresentation =
 
| patternpresentation =
 
| cardpresentation=
 
| cardpresentation=
Line 10: Line 11:
 
| v20backface =SoundVisualization-back-v20.png
 
| v20backface =SoundVisualization-back-v20.png
 
| screenshots=
 
| screenshots=
 +
| v10rel-tag1=May relate to:<br>
 +
| v10rel1=[[Sound Input]], [[Rhythm Gameplay]], [[Pitch Gameplay]]<br>
 +
| v10rel-tag2=May use:<br>
 +
| v10rel2=[[Subtitles and Captions]]<br>
 
| v20rel-tag1=May relate to:<br>
 
| v20rel-tag1=May relate to:<br>
 
| v20rel1=[[Sound Input]], [[Rhythm Gameplay]], [[Pitch Gameplay]]<br>
 
| v20rel1=[[Sound Input]], [[Rhythm Gameplay]], [[Pitch Gameplay]]<br>
Line 16: Line 21:
 
| revisions =Introduced in version 1.0
 
| revisions =Introduced in version 1.0
 
| description=
 
| description=
−
[[Sound Visualization]] consists in providing graphical representations to accompany occurring sounds. There are some reasons for this to be interesting:
+
[[Sound Visualization]] consists of providing graphical representations to accompany occurring sounds. There are some reasons for this to be interesting:
 
* Emphasizing some aspect of the sound, by providing a cross-modal reinforcement of the perception.
 
* Emphasizing some aspect of the sound, by providing a cross-modal reinforcement of the perception.
 
* Enabling the game to be played and enjoyed without sound. This is relevant in several circumstances:
 
* Enabling the game to be played and enjoyed without sound. This is relevant in several circumstances:
−
** for playing in noisy environments (e.g. using mobile platforms).
+
** for playing in noisy environments (e.g., using mobile platforms).
 
** for playing in places where the context obliges that the sound is mute or very low volume.
 
** for playing in places where the context obliges that the sound is mute or very low volume.
 
** for hard-of-hearing or deaf players<ref name="deafgamers"/>.
 
** for hard-of-hearing or deaf players<ref name="deafgamers"/>.
 
* In the particular case of [[Dialogue]]: overcome language comprehension difficulties by reading subtitles, possibly in another language, as explored in [[Subtitles and Captions]].
 
* In the particular case of [[Dialogue]]: overcome language comprehension difficulties by reading subtitles, possibly in another language, as explored in [[Subtitles and Captions]].
  
−
Most typical solutions adopted in games are (common too other other media):
+
Typical solutions adopted in games are (common to other media):
 
*Diegetic approaches:
 
*Diegetic approaches:
−
** Drawing sound waves, which allows to locate the source, and possibly the reach and the receptors of that sound, but does not allow to know the sound itself.
+
** Drawing sound waves, which allows locating the source, and possibly the reach and the receptors of that sound, but does not allow knowing the sound itself.
−
** Drawing an onomatopoeia, possibly next to the source of the sound, which allows to learn what sound it is, and possibly the source.
+
** Drawing an onomatopoeia, possibly next to the source of the sound, which allows learning what sound it is, and possibly the source.
 
*Non-Diegetic approach:
 
*Non-Diegetic approach:
−
** as explored in [[Subtitles and Captions]]: Inscribe a descriptor of the occurring sounds as closed captions, possibly interweaved with subtitles, which allows a verbose description of the several aspects of the sound.
+
** as explored in [[Subtitles and Captions]]: Inscribe a descriptor of the occurring sounds as closed captions, possibly embedded in subtitles, which allows a verbose description of the several aspects of the sound.
  
 
|additional=
 
|additional=
Line 35: Line 40:
  
 
| examples=
 
| examples=
−
| ex1=<mt p="SoundVisualization" g="Patapon" w="{{R16by9W}}" h="{{R16by9H}}">The all visual representation pulses with the sound - from the most objective, as the rectangle in the border and the drums' onomatopoeias (mapping the [[Sound Input]]), to the more subtle, as the moves and details of the characters (which map and the [[Sound Input]] and the sound they echo themselves).</mt>
+
| ex1=<mt p="SoundVisualization" g="Patapon" w="{{R16by9W}}" h="{{R16by9H}}">The whole visual representation pulses with the sound - from the most objective, as the rectangle in the border and the drums' onomatopoeias (mapping the [[Sound Input]]), to the more subtle, as the moves and details of the characters (which map and the [[Sound Input]] and the sound they echo themselves).</mt>
 
| ex2=<mt p="SoundVisualization" g="Cut The Rope" altg="Cut the Rope" w="{{ViPhoneW}}" h="{{ViPhoneH}}"></mt>
 
| ex2=<mt p="SoundVisualization" g="Cut The Rope" altg="Cut the Rope" w="{{ViPhoneW}}" h="{{ViPhoneH}}"></mt>
 
| ex3=<mt p="SoundVisualization" g="Ecco" altg="Ecco the Dolphin" w="{{RPS2W}}" h="{{RPS2H}}"></mt>
 
| ex3=<mt p="SoundVisualization" g="Ecco" altg="Ecco the Dolphin" w="{{RPS2W}}" h="{{RPS2H}}"></mt>
 
| ex4=<mt p="SoundVisualization" g="DevilsTuningFork" altg="Devil's Tuning Fork" w="{{R5by4W}}" h="{{R5by4H}}"></mt>
 
| ex4=<mt p="SoundVisualization" g="DevilsTuningFork" altg="Devil's Tuning Fork" w="{{R5by4W}}" h="{{R5by4H}}"></mt>
−
| ex5=<mt p="SoundVisualization" g="SingStar" w="{{R16by9W}}" h="{{R16by9H}}"></mt>
+
| ex5=<mt p="SoundVisualization" g="SingStar" altg="SingStar Vol.3" w="{{R16by9W}}" h="{{R16by9H}}"></mt>
 
| ex6=<mt p="SoundVisualization" g="Spore" w="{{R4by3W}}" h="{{R4by3H}}"></mt>
 
| ex6=<mt p="SoundVisualization" g="Spore" w="{{R4by3W}}" h="{{R4by3H}}"></mt>
 
| ex7=<mt p="SoundVisualization" g="Ocarina Of Time" altg="The Legend of Zelda: Ocarina of Time" w="{{R4by3W}}" h="{{R4by3H}}"></mt>
 
| ex7=<mt p="SoundVisualization" g="Ocarina Of Time" altg="The Legend of Zelda: Ocarina of Time" w="{{R4by3W}}" h="{{R4by3H}}"></mt>
−
| ex8 =<mt p="Dialogue" g="Gadget" altg="iGadget" w="{{ViPhoneH}}" h="{{ViPhoneW}}">In this game, due to the option of not using [[Dialogue]], the subtitles </mt>
+
| ex8 =<mt p="Dialogue" g="Gadget" altg="iGadget" w="{{ViPhoneH}}" h="{{ViPhoneW}}">In this game, due to the option of not voicing [[Dialogue]], the subtitles are the means to convey the discourse.</mt>
 
| showrefs=1
 
| showrefs=1
 
}}
 
}}

Latest revision as of 14:43, 19 July 2012

Deck←
Front face Back face
The card's front face The card's back face

Synopsis

Graphical perception of the occurrence of sound.

Relationships

May relate to:
 Sound Input , Rhythm Gameplay , Pitch Gameplay .
May use:
 Subtitles and Captions .

Description

Sound Visualization consists of providing graphical representations to accompany occurring sounds. There are some reasons for this to be interesting:

  • Emphasizing some aspect of the sound, by providing a cross-modal reinforcement of the perception.
  • Enabling the game to be played and enjoyed without sound. This is relevant in several circumstances:
    • for playing in noisy environments (e.g., using mobile platforms).
    • for playing in places where the context obliges that the sound is mute or very low volume.
    • for hard-of-hearing or deaf players[1].
  • In the particular case of Dialogue: overcome language comprehension difficulties by reading subtitles, possibly in another language, as explored in Subtitles and Captions.

Typical solutions adopted in games are (common to other media):

  • Diegetic approaches:
    • Drawing sound waves, which allows locating the source, and possibly the reach and the receptors of that sound, but does not allow knowing the sound itself.
    • Drawing an onomatopoeia, possibly next to the source of the sound, which allows learning what sound it is, and possibly the source.
  • Non-Diegetic approach:
    • as explored in Subtitles and Captions: Inscribe a descriptor of the occurring sounds as closed captions, possibly embedded in subtitles, which allows a verbose description of the several aspects of the sound.

Examples

Patapon: The whole visual representation pulses with the sound - from the most objective, as the rectangle in the border and the drums' onomatopoeias (mapping the Sound Input), to the more subtle, as the moves and details of the characters (which map and the Sound Input and the sound they echo themselves).
Cut the Rope:
Ecco the Dolphin:
[show less examples...]
Devil's Tuning Fork:
SingStar Vol.3:
Spore:
The Legend of Zelda: Ocarina of Time:
iGadget: In this game, due to the option of not voicing Dialogue, the subtitles are the means to convey the discourse.

Additional Comments

For game reviews sensitive to their usage by deaf gamers see deafgamers.com[1]


References

  1. ↑ 1.01.1 Deaf Gamers http://www.deafgamers.com

Cite error: <ref> tag with name "pending" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "AlvesACE11" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Stockburger2006" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "otocky-1" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "isaza-rdr" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "mossarrows" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Sheffield" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Griffin" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Jones" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "TobinAndInfamous" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "HerbertAndLifeInADay" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Trier2000" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Baraka" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Stocco2012" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Hatch2011" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Spielberg" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Ament" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Messiaen" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Whalen2004" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "WhartonCollins2011" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "apologizetomymule" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "afistfulofdollars" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "theSilence" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Loughlin2010" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "AlvesAM11" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "AlvesAM09" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "AlvesAM10" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "AlvesCh11" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Augoyard" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Leeds" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Sonnenschein" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alexander79" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alexander77" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves2009" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves2011a" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Augoyard" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Bj.C3.B6rk" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Borchers" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Erl" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Frauenberger" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Gamma" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Gilliam" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Holowka" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Jackson" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Kunert" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Leeds" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Marks2009ch8" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Marks2009" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Pajitnov" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Peck2001" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Peck2007" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Smaragdis2009a" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Smaragdis2009b" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Sonnenschein" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "UESP._2010._Oblivion:NPCs" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Viers" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Vlissides" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alexander" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Borchers" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Erl" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Gamma" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Tidwell" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Bjork" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Frauenberger" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Holowka" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Peck" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Halskov" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Lucero" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Schell" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Nielsen" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Heylighen" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Aarseth" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Alves" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Atwater" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Augoyard" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Barr" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Brewster" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Collins2008a" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Collins2008b" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Cs.C3.ADkszentmih.C3.A1lyi" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Cunningham" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Cunningham" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Dam.C3.A1sio" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Dam.C3.A1sio" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Dam.C3.A1sio" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Deutsch" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Ekman" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Ekman" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Farnell" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Follett" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Frauenberger" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Freeman" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Gouk" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Grimshaw2007" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Grimshaw2008" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Grimshaw2009" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Hassenzahl" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Hassenzahl" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Hermann" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "J.C3.B8rgensen" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "J.C3.B8rgensen" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "J.C3.B8rgensen" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Juslin" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Kallmann" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Kramer" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Lane" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Ledoux" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Leeds" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Lynch" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Mahlke" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Mahlke" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Marks.26Novak2009" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Nacke" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Nettle" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Norman" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Norman" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Parker" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Peck" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Peck" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Roque" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Schafer" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Schafer" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Schell" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Sider" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Sonnenschein" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Sotamaa" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "The_Curious_Team._1999._Curious_about_space:_Can_you_hear_sounds_in_space.3F_Ask_an_Astronomer._Retrieved_September_31" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Tinwell" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Truax" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Truax" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "World_soundscape_project._n.d.._Retrieved_September_31" defined in <references> is not used in prior text.
Cite error: <ref> tag with name "Wrightson" defined in <references> is not used in prior text. FakeX-front-v10.pngFakeX-back-v10.png

Retrieved from "https://soundingames.dei.uc.pt/index.php?title=Sound_Visualization&oldid=16490"