Archive for the ‘3d’ Category


Metasyn – Interactive Information Visualizer

April 5, 2010

Metasyn is an interface that allows visitors to explore the collection of contemporary art in Roskiilde.  The visualization includes an interactive 3D browser that is among the best I’ve seen.  Items are organized in the space  as follows:

The objects are lined up vertically by year showing the distribution of objects over time. For a given object, its vertical order is a product of the ‘grade of dominance’ that the related artist has. The objects that are made by artists whose objects are commonly accruing in the collection are placed closer to the ground plane. This results in an organisation where the most dominant artists are represented close to ‘the core’ of the structure, while the less known artists ends up in the periphery. This decision was made to support the impression of exploring the unknown in the outer areas of the collection, and to increase chances additionally that the museum’s choice of popular artists are promoted.

For the patient, be sure to check out the hi-res version of the video

Created by: Cark Emil Carlsen
Project site: Metasyn


Using Visualizations for Music Discovery

October 22, 2009

Hot of the presses, here are the sides for the tutorial that Justin and Paul are presenting at ISMIR 2009 on October 26.

Note that the live presentation will include many demonstrations and videos of visualizations that just are not practical to include in a PDF.  If you have the chance, be sure to check out the tutorial at ISMIR in Kobe on the 26th.


Visualization for Analytical Music Discovery

October 15, 2009

The focus of our upcoming tutorial at ISMIR is on all the different ways that individuals have tried to represent music collections visually.  After a lengthy review of all the personal, popular, and academic music visualizations, we find the purpose of this process can range from artistic self expression to a more straight forward, utilitarian role.  One noticeably absent (or at least underrepresented) form of visualization is for analysis of music.  Rather than producing highly polished representations of music corpuses for public display, we want to talk about visualizations that can be used to help understand how computers are relating music relationships algorithmically, perhaps for the purposes of genre classification.  In general, we’re interested if we can better understand the behavior and performance of music information retrieval systems through visualization, enhancing the simple numeric measurements such as precision and recall.

Justin has produced a short video where he talks about a method for visualizing acoustic and tag based metadata using the open source statistical language R.

We are looking forward to Japan, and hope that you join us on the 26th!

Paul and Justin


FM4 Soundpark

September 8, 2009




The FM4 Soundpark is a web platform run by the Austrian public radio station FM4,  that visualizes an audio similarity music space.  Soundpark incorporates purely content-based rcommendations based upon a seed track and provides a 2D visualization based on audio similarity as well as an interactive 3D visualization based upon a combination of audio and metadata features.  Features of Soundpark:

  • Music Recommendation: The core of all applications is a content based music similarity function. The similarity is automatically computed and based on models of the songs’ audio content. Musical instruments and voices exhibit specific frequency patterns in the audio signal. These patterns are estimated with statistical models and used to compute the audio similarity.
  • Soundpark Player: Whenever a visitor of the Soundpark listens to a song, a recommendation of five or more similar songs is provided. These recommendations are visualized in a graph-based representation. Users can interactively explore the similarity space by clicking on songs in the recommendation graph.
  • Soundpark 3D: The entire database of songs in the Soundpark is visualized as an audio landscape of sea and islands. Songs from the same genre inhabit the same islands, within islands songs are grouped according to their audio similarity. Users can travel through the landscape and explore their own audio path through the data base.
  • Automatic generation of playlists: Visitors of the Soundpark can choose a start and an end song from the data base and a playlist of eight more songs “in-between” is automatically computed. The playlist is a smooth transition from the start to the end song. This functionality is not online any more.

More Info:




September 7, 2009




nepTune is an innovative user interface to music repositories. Given an arbitrary collection of digital music files, nepTune creates a virtual landscape which allows the user to freely navigate in this collection. This is accomplished by automatically extracting features from the audio signal and clustering the music pieces. The clustering is used to generate a 3D island landscape in which the user can freely navigate and hear the closest sounds with respect to his/her current position via a surround sound system. Additionally, knowledge extracted automatically from the Web is incorporated to enrich the landscape with semantic information. More precisely, nepTune displays words that describe the heard music and related images on the landscape to support the exploration.

Developed in 2006, 2007 by:

Knees, P., Schedl, M., Pohle, T., and Widmer, G from the Department of Computational Perception

Johannes Kepler Universität Linz

More Info


Search Inside the Music

September 7, 2009

Engaging visualizations and animations in SITM

Exploring the music space with SITM

Exploring the music space with SITM


The goal of the ‘Search Inside the Music’ project is to explore new methods of analyzing, categorizing, indexing and organizing large collections of music to allow us to build more effective tools to explore, discover and recommend music. This project extends music search to search ‘inside the music’, that is, to search not just titles, keywords and artists, but to search and recommend music by music content and context.

One goal of Search Inside the Music is to create new ways to help people explore and discover new music. In particular SITM is using interactive 3D visualizations of a music similarity space to allow a music listener to explore their music collection, to receive recommendations for new music, to generate interesting and coherent playlists and to interact with the album artwork of a music collection. The resulting user interface is arguably more engaging and enjoyable to use than currently available interfaces.


Sun Microsystems Research Lab including: Paul Lamere, Stephen Green, Jeff Alexander, Douglas Eck, Thierry Bertin-Mahieux, Francois Maillet, Rebecca Fiebrink, Kris West

More Info