3D, 3DCG., 3D. 3DCG 3D,,,,., 3D,, 3D., 2. 3D,,.,,.,,.,,,.,, 3D., 500 3D. 3D,, i

27 3D Semi-automatic 3D modeling system of a character s face from color illustrations 1160309 2016 2 26

3D, 3DCG., 3D. 3DCG 3D,,,,., 3D,, 3D., 2. 3D,,.,,.,,.,,,.,, 3D., 500 3D. 3D,, i

Abstract Semi-automatic 3D modeling system of a character s face from color illustrations Sayaka Kubouchi In recent years, 3D computer graphics are widely used, e.g., many computer games and movies. Moreover today, digital modeling and fabrication is becoming popular, which means that more and more people create their works using 3D models. In contrast to increasing demands in 3DCG and 3D models, it s difficult for people who don t have knowledge about a computer, graphics, mathematical theory, and how to use a software, to make complicated 3D models. Here we have proposed that semi-automatic 3D-modeling system of a character s face. The purpose of this study is to help making complicated 3D models from illustrations of anime-ish characters. We estimate the shape of character s face by two images, character s frontal face and side face. First, we detect character s eyes from frontal face. Next we find closed area in frontal face and fit ellipse to contour. We approximate facial depth by regarding character s face as half-ellipsoid. After that, we assign detail of depth for eyes, nose, and mouth by eyes position and feature points calculated from side face. Pupils of 3D models of an anime-ish character are made as dent in the model. Finally, we generate the character s 3D face model by gaussian smoothing. As a result we were able to generate the 3D model with few user inputs under 500ms computational time by the developed application based on proposed method. key words 3D modeling, Sketch-based modeling, Illustlation ii

1 1 1.1............................. 1 1.2................................. 2 2 3 2.1 3D.............................. 3 2.1.1 (Curve modeling).................. 3 2.1.2 (Digital sculpting).............. 3 2.1.3 (Polygonal modeling)............. 4 2.2 3D.............................. 4 2.2.1 (Image-based modeling)....... 4 2.2.2 (Sketch-based modeling)....... 5 2.3................................... 5 3 7 3.1................................... 8 3.2.................................... 9 3.3.......................... 9 3.4............................ 10 3.5.............................. 14 3.6.............................. 15 3.6.1.......................... 15 3.6.2....................... 16 3.7............................ 18 iii

3.8 3D................. 19 4 20 4.1................................ 20 4.2 3D.............................. 21 4.2.1 1...................... 21 4.2.2 2...................... 23 4.2.3 3...................... 26 4.2.4 4...................... 28 4.2.5 5...................... 31 4.2.6 6...................... 33 4.3.................................. 36 5 38 39 40 iv

3.1................................ 8 3.2 : 547 703pixel........... 9 3.3............................ 10 3.4 10%.......................... 10 3.5 C s................................. 13 3.6 [ ] ( ), [ ]... 14 3.7 θ......................... 16 3.8 A, B, P ( )....................... 17 3.9 A, B, P ( )....................... 18 4.1 1................................... 21 4.2 1........................... 22 4.3 1......................... 22 4.4 M 1............................... 22 4.5 1 3D................... 23 4.6 1............................. 23 4.7 2................................... 24 4.8 2........................... 24 4.9 2......................... 24 4.10 M 2............................... 25 4.11 2 3D................... 25 4.12 2............................. 26 4.13 3................................... 26 4.14 3........................... 27 v

4.15 3......................... 27 4.16 M 3............................... 27 4.17 3 3D................... 28 4.18 3............................. 28 4.19 4................................... 29 4.20 4........................... 29 4.21 4......................... 29 4.22 M 4............................... 30 4.23 4 3D................... 30 4.24 4............................. 31 4.25 5................................... 31 4.26 5........................... 32 4.27 5......................... 32 4.28 M 5............................... 32 4.29 5 3D................... 33 4.30 5............................. 33 4.31 6................................... 34 4.32 6........................... 34 4.33 6......................... 34 4.34 M 6............................... 35 4.35 6 3D................... 35 4.36 6............................. 36 vi

4.1.................................... 20 vii

1,,. 1.1,,, 3D., 3D,. Web 3D, HTML5 API 1 WebGL[1], 3D., ( ), 3D [2].. 3D, 3D. 3D 3D, 3D. 3D,. 3D,,,., 2 1

1.2, 3D 3D., 3D 3D, 3D, 3D. 1.2. 2, 3D,. 3,, 3D. 4,. 5,. 2

2, 3D.,. 2.1 3D 3D,,, 3.. 2.1.1 (Curve modeling), NURBS,,.,., SolidWorks[3] 3 CAD.,. 2.1.2 (Digital sculpting),., 3D., 3

2.2 3D,. 2.1.3 (Polygonal modeling),.,.,,. Maya[4], 3ds Max[5], Blender[6],, 3D., 3D,. 2.2 3D 3D,. 2.2.1 (Image-based modeling), 2 3D 3. 2,,. Autodesk 123D Catch[7],, 3-Sweep[8] 3D. 4

2.3 2.2.2 (Sketch-based modeling), 3D. 2. 1, Curvy3D[9] Teddy[10],.,. 2, 3D.,. 2.3, 3D. Igarashi,, 3D Teddy [10].,, [11]., 2,., 2, 2.5D [12]. Furusawa, 2 2 [13].,, 2 2 3D. 5

2.3, Live2D[14] Emotional Motion Technology[15], 2D 3D., 3D, 2D. 3D,,,,.,, 3D, 3D., 3D, 2 3D., 2, 3D., 3D,.,. 6

3, 2, 3D.,,. 3.1.,,.,,.,,,.., 3D,.,.,.,.,.,.,., 3D. 7

3.1 3.1 3.1., 3.2. 2,. 1000 1000pixel. *.jpg, *.jpeg, *.png, *.bmp.,.,..,.,,.,,. 8

3.2 3.2 : 547 703pixel 3.2 3D,, 3D.,,., Haar-like. 5574, Positive( ) 1895, Negative( ) 3679. Bing Search API. 3.3 2,. 2.,., 250.. 2, 5. 2., 9

3.4,., 4 1.,,.,, 10%.,. 3.3, 3.4. c. 3.3 3.4 10% 3.4 3.3,,., n, n 10 ( ).,, n 10. 1, n n 10. i = (x i, y i ), c = (c x, c y ), r C s. 10

3.4, (x a) 2 + (y b) 2 = r 2 i, c,. {(xi c x ) 2 + (y i c y ) 2 r 2 } 2 = 0 (3.1) (3.1) (x 2 i + y 2 i + Ax i + By i + C) 2 = 0 (3.2), A = 2c x (3.3) B = 2c y (3.4) C = c 2 x + c 2 y r 2 (3.5). (3.2) A, B, C A = A x 2 i + B x i y i + C x i + x 3 i + x i yi 2 = 0 (3.6) B = A x i y i + B yi 2 + C y i + x 2 i y i y 3 i = 0 (3.7) C = A x i + B y i + C 1 + x 2 i + yi 2 = 0 (3.8) (3.6) (3.8) x 2 i xi y i xi xi y i y 2 i yi n xi yi 10 A B C = (x 3 i + x iy 2 i ) (x 2 i y + y3 i ) (x 2 i + y2 i ) (3.9) A B C = x 2 i xi y i xi xi y i y 2 i yi xi yi n 10 1 (x 3 i + x iy 2 i ) (x 2 i y + y3 i ) (x 2 i + y2 i ) (3.10) A, B, C, (3.3) (3.5) c x, c y, r. (3.10) c x = A 2 (3.11) c y = B (3.12) 2 r = c 2 x + c 2 y C (3.13) 11

3.4 (3.13) r, C s. C s = r 1 (3.14) C s,,.,. 3.5..,.,,., 4, a 1, a 2, a 3, a 4., [16]. a 1 a 2, a 2 a 3, a 3 a 4.,., 3, b 1, b 2, b 3. 3.6. 12

3.4 3.5 C s 13

3.5 3.6 [ ] ( ), [ ] 3.5 3.2,., A.,,., 3.2. p = (x p, y p ), c = (x c, y c ), pc d. d = (x p x c, y p y c ) = (x d, y d ) (3.15) 14

3.6 x d, y d, A p = (x p, y p ) A(p). A(p) = t(1 x d w 2 y d h 2 ) (3.16), w, h., t,. 3.6,., 3.5 A, 3.1, 3.4. 3.6.1 3D,., 3D., 3.1,, p = (x p, y p ) E(p). E(p) = r 2 c p 2 rρ (3.17), r 3.1, c = (x Ec, y Ec ) 3.1., ρ,. 15

3.6 3.6.2, 3.4., a n b n a n a n+1 θ, tan θ. 3.7 a n b n a n a n+1 2 θ. m1 = y a n y bn x an x bn (3.18) m2 = y a n y an+1 x an x an+1 tan θ = m1 m2 1 + m1m2, tan θ.,., y,.,.,., a 1, a 2, a 3 tan θ α. α 3.7 θ, α = 4.0, α = 7.0.,.,.,., A = (A x, A y, A z ), B = (B x, B y, B z ), 3 AB P = (P x, P y, P z ) P z, 16

3.6. A, B, P 3.8. P z = (P x A x )(A z B z ) (A x B x ) + A z (3.19) 3.8 A, B, P ( ), A = (A x, A y, A z ), B = (B x, B y, B z ), 3 AB P = (P x, P y, P z ) P z,. A, B, P 3.9. P z = (P y A y )(A z B z ) (A y B y ) + A z (3.20) 17

3.7 3.9 A, B, P ( ) p = (x p, y p ) E(p), N(p), L(p), D(p). D(p) = N(p) + L(p) E(p) (3.21) 3.7 M(p) = A(p) + D(p), 3.6., M., 0., σ 0.8. 18

3.8 3D 3.8 3D 3.7 M, 3D. M, x, y z 3.,. 19

4,,.,. 4.1 C++, Microsoft Visual Studio Express 2012 for Windows Desktop., OpenCV., Python., 3D, OpenGL GLUT. 4.1. 4.1 OS 64bit Windows 7 Enterprise Service Pack 1 CPU Intel(R) Core(TM) i5-4570 3.20GHz 16.0GB NVIDIA Quadro FX 1800 20

4.2 3D 4.2 3D,,,,, 3D,., 5,. 4.2.1 1 1 4.1, 4.2, 4.3, M 1 4.4, 3D 4.5., 1 4.6. 1, 547 703pixel. 4.1 1 21

4.2 3D 4.2 1 4.3 1 4.4 M 1 22

4.2 3D 4.5 1 3D 4.6 1 4.2.2 2 2 4.7, 4.8, 4.9, M 2 4.10, 3D 4.11., 2 4.12. 2, 600 685pixel. 23

4.2 3D 4.7 2 4.8 2 4.9 2 24

4.2 3D 4.10 M 2 4.11 2 3D 25

4.2 3D 4.12 2 4.2.3 3 3 4.13, 4.14, 4.15, M 3 4.16, 3D 4.17., 3 4.18. 3, 460 518pixel. 4.13 3 26

4.2 3D 4.14 3 4.15 3 4.16 M 3 27

4.2 3D 4.17 3 3D 4.18 3 4.2.4 4 4 4.19, 4.20, 4.21, M 4 4.22, 3D 4.23., 4 4.24. 4, 28

4.2 3D 600 674pixel. 4.19 4 4.20 4 4.21 4 29

4.2 3D 4.22 M 4 4.23 4 3D 30

4.2 3D 4.24 4 4.2.5 5 5 4.25, 4.26, 4.27, M 5 4.28, 3D 4.29., 5 4.30. 5, 500 500pixel. 4.25 5 31

4.2 3D 4.26 5 4.27 5 4.28 M 5 32

4.2 3D 4.29 5 3D 4.30 5 4.2.6 6 6 4.31, 4.32, 4.33, M 6 4.34, 3D 4.35., 6 4.36. 6, 649 767pixel. 33

4.2 3D 4.31 6 4.32 6 4.33 6 34

4.2 3D 4.34 M 6 4.35 6 3D 35

4.3 4.36 6 4.3,., 500, 3D., 3D,. 3D,,,. 4.7,., 4.7,,.,,, 4.14,.,, 36

4.3.,,. 37

5, 3D, 3D, 3D. 3D, 3D,, 3D.,. 2, 2., 3D.,. 4.3,,.,.,,.,,. 38

,,,,.,,., 5..,,. 39

[1] Khronos Group, WebGL, https://www.khronos.org/webgl/, 2016 1 31. [2], 2 3D, 27, pp.301-303, 2015. [3] Dassault Systmes SolidWorks, SolidWorks, http://www.solidworks.co.jp/, 2016 2 1. [4] Autodesk, MAYA, http://www.autodesk.co.jp/products/maya/overview, 2016 1 31. [5] Autodesk, 3ds Max, http://www.autodesk.co.jp/products/3ds-max/overview, 2016 1 31. [6] Blender Foundation, blender.org, https://www.blender.org/, 2016 1 31. [7] Autodesk, Autodesk 123D Catch, http://www.123dapp.com/catch, 2016 2 1. [8] Tao Chen, Zhe Zhu, Ariel Shamir, Shi-Min Hu, Daniel Cohen-Or, 3-Sweep: Extracting Editable Objects from a Single Photo, ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2013), Vol.32, No.6, Article 195, 2013. [9] The Curvy Team, Aartform Curvy 3D: Sculpting Software for Artists, http://www.curvy3d.com/, 2016 1 31. [10] Takeo Igarashi, Satoshi Matsuoka, Hidehiko Tanaka, Teddy: A Sketching Interface for 3D Freeform Design, in Proc. of SIGGRAPH 99, pp.409-416, 1999. [11],,,, 3D,, pp.13-16, 2013. 40

[12],,, 2.5D,, No.7, pp.1-6, 2014. [13] Chie Furusawa, Tsukasa Fukusato, Narumi Okada, Tatsunori Hirai, Shigeo Morishima, Quasi 3D Rotation for Hand-Drawn Characters, in Proc. of SIGGRAPH 2014, 2014. [14] Live2D, Live2D, http://www.live2d.com/, 2016 1 31. [15] M2, E-mote ( ), http://emote.mtwo.co.jp/, 2016 1 31. [16],,,, C( ), 119 6, pp.691-699, 11. 41