1,a) 1,2,b) 3,c) 1,d) 3D 1. 2.5 * 1*2 2.5 1 Graduate School of Engineering, Kobe University 2 PRESTO, Japan Science and Technology Agency 3 School of Information Science and Engineering, Ritsumeikan University a) taiga-tanaka@stu.kobe-u.ac.jp b) tsutomu@eedept.kobe-u.ac.jp c) murao@cs.ritsumei.ac.jp d) tuka@kobe-u.ac.jp *1 2.5 https://www.j25musical.jp/ *2 : 2.5 ( ) http://dic.nicovideo.jp/a/2.5 [1] 3D 3D 2 3 4 5 2. c 2017 Information Processing Society of Japan 1
2.1 Ondrej [1] 3D 3D [2] [3] [4] [5] Rhodin [6] 2.2 [7] HMD [8] [9] 3D 3D [10] CCD 3D 3D 2.3 [11] 3D 3D Kuratate [12] 3. 3.1 TV *3 1. *3 TV http://www.tv-asahi.co.jp/doraemon/ c 2017 Information Processing Society of Japan 2
3.2 2 3.3 Microsoft Kinect Kinect 3.4 1 Xsens Xsens MVN * 4 *4 Xsens MVN: Products - Xsens 3D motion tracking https://www.xsens.com/products/xsens-mvn/ 17 17 3D 3D 17 3D 2 3D 3D PC Unity *5 Xsens MVN MVN Studio *6 Unity MVN LIVE Animation *7 PC 3D 3D 3D PC 3D 2 T PC 3D 3D 4. *5 Unity - Game Engine http://japan.unity3d.com/ *6 MVN Studio (Pro) Software https://www.xsens.com/mvn-studio-pro/ *7 MVN Live Animation - - Asset Store - Unity https://www.assetstore.unity3d.com/jp/content/11338 c 2017 Information Processing Society of Japan 3
身 5.5 cm RightHandEnd RightHand Mvn Studio PositionRo PitchYaw MVN Studio 1 Head RightShouder LeftShouder RightArm Spine RightUpLeg RightLeg RightFoot 2 Spine PC LeftArm LeftUpLeg LeftLeg LeftFoot LeftHand LeftHandEnd Unity Head RightShouder RightEbow RightWrist RightArm Torso RightHip RightKnee RightFoot 4.1 PC MVN Live Animation 3D 示 LeftShouder LeftArm Torso LeftHip LeftKnee LeftFoot 非 LeftEbow LeftWrist 4 1234 2127 4 ABCD 2122 2 EF 1 3 1 *8 2 * 9 3 * 10 4 * 11 *8 TV http://www.tbs.co.jp/rozen-maiden/part2/ (c)1995-2017, Tokyo Broadcasting System Television, Inc. *9 TV http://nonnontv.com/ (c)2015 KADOKAWA / *10 TV http://www.idolmaster-anime.jp/tv/index2.html (c)bngi/ PROJECT im@s *11 TV http://www.tv-tokyo.co.jp/anime/pripara/ (c)t-arts/ syn Sophia/ / PP3 1 2 3 4 3 1234 3D 3D * 12 * 13 4 1 2 1 1 3D 6 1. 2. 3. 4. 5. 5 1 24 17 1. 2. 3. 4. 5. 5 AF 1. 2. 3. 4. 5. 5 *12 http://www.nicovideo.jp/ *13 http://seiga.nicovideo.jp/ c 2017 Information Processing Society of Japan 4
1 1 2 3 4 A B C D E F 手 (a) 3D 手 (a) 1 * 14 (b) 2 * 15 (b) 4 (c) 3 * 16 (d) 4 * 17 3 3D 4.2 4.2.1 1 5 5 2 2.80 3.07 2.60 3.20 3 2.47 2.73 4.2.2 2 3 4 2 3.44 3.00 2.67 2.75 3 2.08 2.67 4.2.3 3 4 6 *14 MMD http://seiga.nicovideo.jp/seiga/im3487392 *15 MMD http://seiga.nicovideo.jp/seiga/im5097865 *16 MMD 1 Ver.2.0a http://www.nicovideo.jp/watch/sm18223228 *17 16 MMD :WAVE http://www.nicovideo.jp/watch/sm28208081 c 2017 Information Processing Society of Japan 5
2 1 2 3 4 A, C, F B, D, E A,D,F B,C,E A,C,E,F B, D B,C A,D,E,F 3 2.80 3.07 3.44 3.00 3.13 3.13 2.20 2.95 2.60 3.20 2.67 2.75 2.92 2.25 2.39 2.86 1 2 3 4 A, C, F B, D, E A,D,F B,C,E A,C,E,F B, D B,C A,D,E,F 2.47 2.73 2.08 2.67 2.83 2.33 2.11 2.86 2 3.13 3.13 2.92 2.25 3 2.83 2.33 4.2.4 4 5 9 2 2.20 2.95 2.39 2.86 3 2.11 2.86 4.3 1234 17 24 2 2 4 4 1 2 3 5 3 5 3 BD 3 4 4.4 6 5 6 3D 5. 3D 3D 6 4 35 49 c 2017 Information Processing Society of Japan 6
5 3 A B C D E F (a) 5 3 A B C D E F (b) 5 5 JST CREST(JPMJCR16E1) JST (JPMJPR15D4) [1] J. Ondrej, C. Ennis, and N. Merriman: FrankenFolk: Distinctiveness and Attractiveness of Voice and Motion, Journal of ACM Transactions on Applied Perception (TAP 2016), Vol. 13, No. 4, p. 20 (July 2016). [2], :, (2012-HCI-146), Vol. 2012, No. 13, pp. 1 6 (Jan. 2012). [3] :,, Vol. 21, pp. 27 40 (Mar. 2015). [4],, :,, Vol. 72, No., pp. 891 892 (Mar. 2010). [5], :, Visual computing CAD 2003, pp. 75 80 (June 2003). [6] H. Rhodin, J. Tompkin, K. In Kim, E. de Aguiar, H. Pfister, H. Seidel, and C. Theobalt: Generalizing wave gestures from sparse examples for real-time character control, ACM Transactions on Graphics (TOG 2015), Vol. 34, No. 6, p. 181 (Nov. 2015). [7], : MR-Cyborg Soldiers, 2013, pp. 227 231 (Sep. 2013). [8],,,, :, 78, Vol. 4, pp. 521 522 (Mar. 2016). [9],, : 3 (),, 2000-CG-102, pp. 25 30 (Feb. 2001). [10],,, :,, pp. 61 67 (Feb. 1997). [11],,, :,, Vol. 39, No. 2, pp. 3 10(Aug. 2005). [12] K. Takaaki, V. Eric, and Y. H. Camille: Cross-subject face animation driven by facial motion mapping, International Conference on Concurrent Engineering(ISPE 2003), pp. 971 979 (Jan. 2003). c 2017 Information Processing Society of Japan 7