Visualizing emotion in lyricsSeptember 11, 2009
Joris Klerkx has built a visualizer of the emotions in lyrics. Joris has integrated a karaoke player and Synesketch, a framework for visualizing 6 basic emotions, defined by Ekman (happiness, anger, fear, surprise, sadness, disgust). The player takes a song, plays it, and with each line of text that plays in the lyrics, the strongest emotion of that line is visualized. In the image above, on the left hand side, you’ll see the 6 emotions and their visualization. On the right hand side, 2 screenshots of demo’s of the prototype.
Some video of the player in action:
- Thriller by Michael Jackson: emotions fear, angry, sad & disgust are well visible in the end.
- Shiny Happy People by REM: pretty happy.
Jorik points out that it can be interesting to see how the visualizations contrast with how the song sounds since offten times the emotion and mood of the lyrics of a song contrast with how the song sounds