DropNotes 1,a) 1,b) 1,c) 2,d) DropNotes Abstract: We have focused on audio recording and editing manipulation, and developed an interface Drop- Notes in which bottles and droplets are used to record and edit sound sources. Through this interface, we have been proposing a music creation environment in which intuitive interfaces for various kinds of audio manipulation are seamlessly integrated. This paper reports on a usability test on the proposed system. Participants were asked to use the system, and their behavior was recorded. Based on the test, this paper considers accomplishments and problems of the system in the point of view of suitability for audio recording and editing manipulation. 1. Tangible Uer Interface(TUI)[1] TUI 1 The Department of Intermedia Art and Science, Waseda University 2 The Department of Intermedia Art and Science, Waseda University 3 The Department of Human Centered Design and Engineering, University of Washington a) 634.nakajima@aoni.waseda.jp b) bjp-nct@suou.waseda.jp c) chgm@uw.edu d) ykanno@waseda.jp [4][5][6] DAW [5][6][7] 1
DropNotes 1 DropNotes 2. [2] [3] ReacTable*[4] The Table is The Score[5], BeatBearing[6] Music Bottles[7] Audio Shaker[8] 1 Fig. 1 DropNotes DropNotes 3. DropNotes DropNotes 3.1 Web PC 2 ipad, ( 1 ) 3 PC ( 2 ) 4 PC ( 3 ) 5 Web 2
Fig. 2 2 System Configurations Diagram Fig. 5 5 Dropping the Liquid on the Glass Table 3 Fig. 3 Recording 6 Fig. 6 Projected Animation Fig. 4 4 Choosing and Picking up Sources 7 Fig. 7 Interfusing Color to Alter Filter Function 6 ( 4 ) 7 RGB 3.2 8 LED Arduino PC PC LED 3
Fig. 8 8 The Structure of the Bottle Stand 9 Fig. 9 Pitch and Playback Timing PC LED 3.3 Web OSC[9] OpenCV Processing ( 1 ) ( 2 ) ( 3 ) RGB θ 0 θ 180 ( 4 ) 3.4 Pure Data Audio Unit Mac App ( 1 ) Pure Data ( 2 ) Mac App ( 3 ) ( 4 ) RGB R G B ( 5 ) ( 6 ) ( 7 ) 0 θ 180 2 ( 8 ) 4
Fig. 11 11 The Instruments Used in the Experiment 10 Fig. 10 ipad ipad App for Instruction 4.1 3.5 Processing OSC 4.2 2 21 23 ipad 5 3.6 ipad ipad ipad 5 10 4. DropNotes [10][11][12] 4.3 4.3.1 5 3 2 2 ipad ipad 4.3.2 5 2 5
1 ipad ipad ipad 5. DropNotes DropNotes 5 2 [1] Hiroshi Ishii, BryggUllmer,: Tangible bits: towards seamless interfaces between people, bits and atoms, Proceedings of the SIGCHI conference on Human factors in computing systems, p.234-241, Atlanta, Georgia, March 22-27, 1997. [2] Blaine, Tina, and Sidney Fels.: Collaborative musical experiences for novices., Journal of New Music Research 32.4 (2003): 411-428. [3] Klügel, Niklas, et al.: An approach to collaborative music composition., Proceedings of the international conference on new interfaces for musical expression. 2011. [4] Jordà, S., Kaltenbrunner M., Geiger G., Bencina R.,: The reactable*, Proceedings of the international computer music conference (ICMC 2005), Barcelona, Spain, pp.579-582, Aug 2005. [5] Levin, G.,: The Table is The Score: An Augmented- Reality Interface for Real-Time, Tangible, Spectrographic Performance., Proceedings of the International Conference on Com-puter Music 2006 (ICMC 06). New Orleans, November 6-11, 2006. [6] Peter Bennett, Sile OModhrain,: The BeatBearing: a Tangible Rhythm Sequencer, Proc. of NordiCHI. Vol. 2008. 2008. [7] Hiroshi Ishii, Ali Mazalek, Jay Lee,: Bottles as a minimal interface to access digital information, Proceeding of the CHI EA 01, CHI 01 Extended Abstracts on Human Factors in Computing Systems, pp.187-188, New York, NY, US, 2001. [8] Andy Cameron, Systems Design Limited,: The Art of Experimental Interaction Design, Gingko Press, 2005. [9] Wright, Matthew.,: Open Sound Control-A New Protocol for Communicationg with Sound Synthesizers., Proceedings of the 1997 International Computer Music Conference. 1997. [10]. (< > )., 54.8 (2004): 391-397. [11].., 74.2 (2008): 111-114. [12].., / / : 45.5 (2001): 269-276. 6