slides - CompMusic - Universitat Pompeu Fabra

slides - CompMusic - Universitat Pompeu Fabra

CompMusic:
Current research and
initial results
Xavier Serra
Music Technology Group
Universitat Pompeu Fabra, Barcelona
http://compmusic.upf.edu
compmusic
CompMusic objectives
•  Promote culture specific approaches in Music
Computing research.
•  Advance in the automatic description of music.
•  Reduce the gap between audio signal descriptions and
semantic/cultural music concepts.
•  Develop information modeling techniques applicable
to the art music traditions of: India (Hindustani,
Carnatic), Turkey (Turkish-makam), Arab countries
(Andalusi), China (Han).
compmusic
CompMusic tasks
compmusic
Research topics
•  “Intonation”: Pitches used by a performer in a piece
(~tuning).
•  “Melody”: Temporal pitch variations performed in a
piece, organized in “motifs” of different temporal scales.
•  “Rhythm”: Arrangement of sounds and silences in time
establishing patterns of strong and weak events.
•  “Community”: Group of people sharing a cultural
tradition and common aesthetic values.
•  “Browsing”: Music discovery within a culture specific
music collection.
compmusic
Intonation
compmusic
Intonation
compmusic
Intonation
Comparison between makam templates and measured histograms
compmusic
Melody
Turkish-makam notation:
Pitch contour:
compmusic
Melody
Manual annotation of gamakas in Carnatic music
compmusic
Rhythm
Hierarchical structure of meter
compmusic
compmusic
so Re
cia inf
l a orc
ct e
ivi
ty
Freesound resources
Community modeling
and adaptation
re R
us ein
e, fo
cr rce
ea
tiv
ity
sa Im
m pr
pl ov
e e
de so
sc un
rip d
tio
ns
Communities
Tag cloud
Browsing
Server
Database
Audio
recordings
(file server)
compmusic
Audio
features
(computed)
Editorial
metadata
Semantic
information
(MusicBrainz)
(Wikipedia,…)
Ravi'Shankar8Raga'Mishra'Khamaj,'Slow'and'Fast'Gats'
CompMusic*browser*
Culture'specific'music'discovery'
Hindustani'
Carna4c'
Andalusi'
Turkish8makam'
Han'
Lead'
performer'
Lead'
instrument'
Performer'
accomp.'
Instrument'
accomp.'
Composer'
Release'
Title'
Year'of'
performance'
Lyricist'
Year'of''
release'
Form'
Raga'
Raga'4me'
Lay'
Tala'
Sec4on'
Gharana'
Solo'
Raga'4me:'
Evening'
And
Or
Recordings'
Not
Raga:'Mishra'
Khamaj'
And
!
Or
Details'
Release
Concert'For'Peace:'
Royal'Albert'Hall'
Not
Solo:'Tabla'
And
Analysis'
Or
!
Not
E8listen'
!
Similarity'
Recording
Artists
Raga
Tala
Raga'Mishra'Khamaj''
Slow'and'fast'Gats'
Ravi'Shankar'(Sitar)'
Mishra'Khamaj'
Teental'
Ravi'Shankar8Raga'Mishra'Khamaj,'Slow'and'Fast'Gats'
CompMusic*browser*
Culture'specific'music'discovery'
Hindustani'
Carna4c'
Andalusi'
Turkish8makam'
Han'
Lead'
performer'
Lead'
instrument'
Performer'
accomp.'
Instrument'
accomp.'
Composer'
Release'
Title'
Year'of'
performance'
Lyricist'
Year'of''
release'
Form'
Raga'
Raga'4me'
Lay'
Sec4on'
Tala'
Raga'4me:'
Evening'
And
Or
Raga:'Mishra'
Khamaj'
Not
Recordings'
And
!
Or
Details'
Solo:'Tabla'
And
Not
Analysis'
Not
E8listen'
!
Similarity'
Editorial*Metadata*
Ar5st*
Ravi'Shankar'
Concert*
Concert'for'peace:'Royal'Albert'Hall'
Place*
London'
Year*
1993'
Raga*
Mishra'Khamaj'
Raga*5me*
Evening'
Tala*
Teental'
Laya*
Vilambit,'Drut'
Performers*
Instrument*
Gharana*
Guru*
Ravi'Shankar'
Sitar'
Maihar'
Allauddin'Khan'
Zakir'Hussain'
Tabla'
Punjab'
Partho'Sarathy'
Sarod'
Maihar'
Gharana'
Recordings*in*the*release*
Disk1*
Solo'
Or
!
01'8'Raga'Jait'Alap8Jor8Jhala'
02'8'Raga'Jait'Gat'
03'8'Raga'Kirwani'Slow'And'Fast'Gats'
Disk2*
01'8'Raga'Mishra'Khamaj,'Slow'And'Fast'Gats'✔'
Release*Informa5on*
Date*
1995'
Country*
India'
Alla'Rakha'
Type*
Live'Concert'
Ravi'Shankar'
Format*
Audio'CD'
Disks*
2'
Label*
Moment'
Ravi'Shankar8Raga'Mishra'Khamaj,'Slow'and'Fast'Gats'
CompMusic*browser*
Culture'specific'music'discovery'
Hindustani'
Carna4c'
Andalusi'
Turkish8makam'
Han'
Lead'
performer'
Lead'
instrument'
Performer'
accomp.'
Instrument'
accomp.'
Composer'
Release'
Title'
Year'of'
performance'
Lyricist'
Year'of''
release'
Form'
Raga'
Raga'4me'
Lay'
Sec4on'
Tala'
Raga'4me:'
Evening'
And
Or
Raga:'Mishra'
Khamaj'
Not
Recordings'
And
!
Or
Details'
Solo:'Tabla'
And
Not
Analysis'
Not
E8listen'
!
Similarity'
Editorial*Metadata*
Ar5st*
Ravi'Shankar'
Concert*
Concert'for'peace:'Royal'Albert'Hall'
Place*
London'
Year*
1993'
Raga*
Mishra'Khamaj'
Raga*5me*
Evening'
Tala*
Teental'
Laya*
Vilambit,'Drut'
Performers*
Instrument*
Gharana*
Guru*
Ravi'Shankar'
Sitar'
Maihar'
Allauddin'Khan'
Zakir'Hussain'
Tabla'
Punjab'
Partho'Sarathy'
Sarod'
Maihar'
Gharana'
Recordings*in*the*release*
Disk1*
Solo'
Or
!
01'8'Raga'Jait'Alap8Jor8Jhala'
02'8'Raga'Jait'Gat'
03'8'Raga'Kirwani'Slow'And'Fast'Gats'
Disk2*
01'8'Raga'Mishra'Khamaj,'Slow'And'Fast'Gats'✔'
Release*Informa5on*
Date*
1995'
Country*
India'
Alla'Rakha'
Type*
Live'Concert'
Ravi'Shankar'
Format*
Audio'CD'
Disks*
2'
Label*
Moment'
Ravi'Shankar8Raga'Mishra'Khamaj,'Slow'and'Fast'Gats'
CompMusic*browser*
Culture'specific'music'discovery'
Hindustani'
Carna4c'
Andalusi'
Turkish8makam'
Han'
Lead'
performer'
Lead'
instrument'
Performer'
accomp.'
Instrument'
accomp.'
Composer'
Release'
Title'
Year'of'
performance'
Lyricist'
Year'of''
release'
Form'
Raga'
Raga'4me'
Lay'
Tala'
Sec4on'
Gharana'
Solo'
Raga'4me:'
Evening'
And
Or
Recordings'
Not
Raga:'Mishra'
Khamaj'
And
Details'
!
Or
Not
Analysis'
Solo:'Tabla'
And
Or
!
Not
E8listen'
!
Similarity'
Pesendide*Saz*Semaisi*8''Necdet'Yaşar,'Ruhi'Ayangil'
CompMusic*browser*
Culture'specific'music'discovery'
Hindustani'
Carna4c'
Andalusi'
Turkish8makam'
Han'
Lead'
performer'
Lead'
instrument'
Performer'
accomp.'
Instrument'
accomp.'
Release'
Title'
Year'of''
release'
Year'of'
performance'
Work'
Composer'
Lyricist'
Form'
Makam'
Usul'
Makam:'
Pesendide'
And
Or
Not
Recordings'
!
Details'
Analysis'
E8listen'
Recording
Artist
Makam
Pesendide'Saz'
Semaisi'
Necdet'Yaşar''
Ruhi'Ayangil'
Pesendîde'Saz'
Semaisi'
Similarity'
Form
Work
Pesendide'
Saz'Semaisi''
Pesendîde'Saz'
Semaisi''
İstanbul'Sazendeleri'
Pesendide'
Saz'Semaisi''
Pesendîde'Saz'
Semaisi''
Pesendîde'Saz'
Semâîsi'
Murat'Aydemir'
Derya'Türkan'
Pesendide'
Saz'Semaisi''
Pesendîde'Saz'
Semaisi''
Pesendide'Peşrevi'
Necdet'Yaşar''
Ruhi'Ayangil''
Ahmet'Şahin''
Derya'Türkan''
Serdar'Bişiren'
Pesendide'
Peşrev'
Pesendide'
Peşrevi'
Müşterek'
Pesendîde'ye'
Geçiş'Taksimi'
Murat'Aydemir''
Derya'Türkan'
Mahur'
Pesendide'
Taksim'
Müşterek'
Pesendîde'ye'
Geçiş'Taksimi'
Velvele'
Usul
Serbest'
Pesendide*Saz*Semaisi*8''Necdet'Yaşar,'Ruhi'Ayangil'
CompMusic*browser*
Culture'specific'music'discovery'
Hindustani'
Carna4c'
Andalusi'
Turkish8makam'
Han'
Lead'
performer'
Lead'
instrument'
Performer'
accomp.'
Instrument'
accomp.'
Release'
Title'
Year'of''
release'
Year'of'
performance'
Work'
Composer'
Lyricist'
Makam:'
Pesendide'
And
Or
Not
Recordings'
Work:'Pesendide'
Peşrevi'
And ! Or
Details'
Not
!
Analysis'
E8listen'
Similarity'
Editorial*Metadata*
Work*
Pesendide'Saz'Semaisi'
Score*
'(1'Score)'
Recordings*
'(3'Recordings)''
Composer*
Sultan'III.'Selim'
Lyricist*
Date*
Sultan*III.*Selim*
Scores*
Form'
Usul'
Makam'
Score*Title*
Composer*
Velvele'
Pesendide'Saz'
Semaisi'
Sultan'III.'
Selim'
Notated*by*/*
Source*
Makam*
Murat'Aydemir'
Pesendide'
Date*
Usul*
Form*
Saz'
Semaisi'
Related*Performances*
Recording*
Ar5sts*
Makam*
Usul*
Form*
Pesendide'
Saz'Semaisi'
Necdet'Yaşar'(tanbur)'
Ruhi'Ayangil'(kanun)'
Pesendide'
Saz'Semaisi'
Pesendîde'Saz'
Semaisi'
İstanbul'Sazendeleri'
Pesendide'
Saz'Semaisi'
Pesendîde'Saz'
Semâîsi'
Murat'Aydemir'(tanbur)'
Derya'Türkan'(kemenche)'
Pesendide'
Saz'Semaisi'
Pesendide*Saz*Semaisi*8''Necdet'Yaşar,'Ruhi'Ayangil'
CompMusic*browser*
Culture'specific'music'discovery'
Hindustani'
Carna4c'
Andalusi'
Turkish8makam'
Han'
Lead'
performer'
Lead'
instrument'
Performer'
accomp.'
Instrument'
accomp.'
Release'
Title'
Year'of''
release'
Year'of'
performance'
Work'
Composer'
Lyricist'
Makam:'
Pesendide'
And
Or
Not
Recordings'
Work:'Pesendide'
Peşrevi'
And ! Or
Details'
Not
!
Analysis'
E8listen'
Similarity'
Editorial*Metadata*
Work*
Pesendide'Saz'Semaisi'
Score*
'(1'Score)'
Recordings*
'(3'Recordings)''
Composer*
Sultan'III.'Selim'
Lyricist*
Date*
Sultan*III.*Selim*
Scores*
Form'
Usul'
Makam'
Score*Title*
Composer*
Velvele'
Pesendide'Saz'
Semaisi'
Sultan'III.'
Selim'
Notated*by*/*
Source*
Makam*
Murat'Aydemir'
Pesendide'
Date*
Usul*
Form*
Saz'
Semaisi'
Related*Performances*
Recording*
Ar5sts*
Makam*
Usul*
Form*
Pesendide'
Saz'Semaisi'
Necdet'Yaşar'(tanbur)'
Ruhi'Ayangil'(kanun)'
Pesendide'
Saz'Semaisi'
Pesendîde'Saz'
Semaisi'
İstanbul'Sazendeleri'
Pesendide'
Available'in'English'and'
Türkçe'
Saz'Semaisi'
Pesendîde'Saz'
Semâîsi'
Murat'Aydemir'(tanbur)'
Derya'Türkan'(kemenche)'
Pesendide'
Saz'Semaisi'
Pesendide*Saz*Semaisi*8''Necdet'Yaşar,'Ruhi'Ayangil'
CompMusic*browser*
Culture'specific'music'discovery'
Hindustani'
Carna4c'
Andalusi'
Turkish8makam'
Han'
Lead'
performer'
Lead'
instrument'
Performer'
accomp.'
Instrument'
accomp.'
Release'
Title'
Year'of''
release'
Year'of'
performance'
Work'
Composer'
Lyricist'
Form'
Makam'
Usul'
Velvele'
Makam:'
Pesendide'
And
Or
Recordings'
Work:'Pesendide'
Peşrevi'
Not
And ! Or
Details'
Not
Analysis'
!
E8listen'
2'komas'
Onset'
Func4on'
Pitch'
Track'
Similarity'
1'koma'