ShadowingPlane_CamereReady.dvi

Similar documents
3 3 3 Knecht (2-3fps) AR [3] 2. 2 Debevec High Dynamic Range( HDR) [4] HDR Derek [5] 2. 3 [6] 3. [6] x E(x) E(x) = 2π π 2 V (x, θ i, ϕ i )L(θ

& Vol.5 No (Oct. 2015) TV 1,2,a) , Augmented TV TV AR Augmented Reality 3DCG TV Estimation of TV Screen Position and Ro

(a) 1 (b) 3. Gilbert Pernicka[2] Treibitz Schechner[3] Narasimhan [4] Kim [5] Nayar [6] [7][8][9] 2. X X X [10] [11] L L t L s L = L t + L s

1 Kinect for Windows M = [X Y Z] T M = [X Y Z ] T f (u,v) w 3.2 [11] [7] u = f X +u Z 0 δ u (X,Y,Z ) (5) v = f Y Z +v 0 δ v (X,Y,Z ) (6) w = Z +

IPSJ SIG Technical Report iphone iphone,,., OpenGl ES 2.0 GLSL(OpenGL Shading Language), iphone GPGPU(General-Purpose Computing on Graphics Proc

IPSJ SIG Technical Report Vol.2009-DPS-141 No.20 Vol.2009-GN-73 No.20 Vol.2009-EIP-46 No /11/27 1. MIERUKEN 1 2 MIERUKEN MIERUKEN MIERUKEN: Spe

Vol. 44 No. SIG 9(CVIM 7) ) 2) 1) 1 2) 3 7) 1) 2) 3 3) 4) 5) (a) (d) (g) (b) (e) (h) No Convergence? End (f) (c) Yes * ** * ** 1

Q [4] 2. [3] [5] ϵ- Q Q CO CO [4] Q Q [1] i = X ln n i + C (1) n i i n n i i i n i = n X i i C exploration exploitation [4] Q Q Q ϵ 1 ϵ 3. [3] [5] [4]

さぬきの安全2016-cs5-出力.indd

看護学科案内'16／表紙

proc.dvi

IPSJ SIG Technical Report Vol.2012-CG-148 No /8/29 3DCG 1,a) On rigid body animation taking into account the 3D computer graphics came

3D VR CAD 3D CAD CAD [1] CAD 3DCG [2] [3] CAD 3D NC CG [4] Ccurve XY C curve α C curve [5], [6], [7], [8], [9] 2 [10] 1 [11], [12] 2.2 [13] Tcu

1 3DCG [2] 3DCG CG 3DCG [3] 3DCG 3 3 API 2 3DCG 3 (1) Saito [4] (a) 1920x1080 (b) 1280x720 (c) 640x360 (d) 320x G-Buffer Decaudin[5] G-Buffer D

258 5) GPS 1 GPS 6) GPS DP 7) 8) 10) GPS GPS ) GPS Global Positioning System

proc.dvi

2016東奥義塾高等学校スクールガイド

Journal of Geography 116 (6) Configuration of Rapid Digital Mapping System Using Tablet PC and its Application to Obtaining Ground Truth

Input image Initialize variables Loop for period of oscillation Update height map Make shade image Change property of image Output image Change time L

1 May 2011

Vol. 23 No. 4 Oct Kitchen of the Future 1 Kitchen of the Future 1 1 Kitchen of the Future LCD [7], [8] (Kitchen of the Future ) WWW [7], [3

2006 [3] Scratch Squeak PEN [4] PenFlowchart 2 3 PenFlowchart 4 PenFlowchart PEN xdncl PEN [5] PEN xdncl DNCL 1 1 [6] 1 PEN Fig. 1 The PEN

光学

美唄市広報メロディー2014年1月号

( )

IPSJ SIG Technical Report Secret Tap Secret Tap Secret Flick 1 An Examination of Icon-based User Authentication Method Using Flick Input for

Silhouette on Image Object Silhouette on Images Object 1 Fig. 1 Visual cone Fig. 2 2 Volume intersection method Fig. 3 3 Background subtraction Fig. 4

1 Web [2] Web [3] [4] [5], [6] [7] [8] S.W. [9] 3. MeetingShelf Web MeetingShelf MeetingShelf (1) (2) (3) (4) (5) Web MeetingShelf

01.P28-01

20 Method for Recognizing Expression Considering Fuzzy Based on Optical Flow

(3.6 ) (4.6 ) 2. [3], [6], [12] [7] [2], [5], [11] [14] [9] [8] [10] (1) Voodoo 3 : 3 Voodoo[1] 3 ( 3D ) (2) : Voodoo 3D (3) : 3D (Welc

「hoge」

1 Table 1: Identification by color of voxel Voxel Mode of expression Nothing Other 1 Orange 2 Blue 3 Yellow 4 SSL Humanoid SSL-Vision 3 3 [, 21] 8 325

B HNS 7)8) HNS ( ( ) 7)8) (SOA) HNS HNS 4) HNS ( ) ( ) 1 TV power, channel, volume power true( ON) false( OFF) boolean channel volume int

DPA,, ShareLog 3) 4) 2.2 Strino Strino STRain-based user Interface with tacticle of elastic Natural ObjectsStrino 1 Strino ) PC Log-Log (2007 6)

IPSJ SIG Technical Report Vol.2014-CG-155 No /6/28 1,a) 1,2,3 1 3,4 CG An Interpolation Method of Different Flow Fields using Polar Inter

(MIRU2008) HOG Histograms of Oriented Gradients (HOG)


dews2004-final.dvi

DEIM Forum 2012 E Web Extracting Modification of Objec

NAIST-IS-MT

2003/3 Vol. J86 D II No Fig. 1 An exterior view of eye scanner. CCD [7] CCD PC USB PC PC USB RS-232C PC

4. C i k = 2 k-means C 1 i, C 2 i 5. C i x i p [ f(θ i ; x) = (2π) p 2 Vi 1 2 exp (x µ ] i) t V 1 i (x µ i ) 2 BIC BIC = 2 log L( ˆθ i ; x i C i ) + q

IPSJ SIG Technical Report Vol.2014-GN-90 No.16 Vol.2014-CDS-9 No.16 Vol.2014-DCC-6 No /1/24 1,a) 2,b) 2,c) 1,d) QUMARION QUMARION Kinect Kinect

橡最新卒論

2). 3) 4) 1.2 NICTNICT DCRA Dihedral Corner Reflector micro-arraysdcra DCRA DCRA DCRA 3D DCRA PC USB PC PC ON / OFF Velleman K8055 K8055 K8055

IPSJ SIG Technical Report Vol.2012-MUS-96 No /8/10 MIDI Modeling Performance Indeterminacies for Polyphonic Midi Score Following and


17 Proposal of an Algorithm of Image Extraction and Research on Improvement of a Man-machine Interface of Food Intake Measuring System

5104-toku3.indd

2013 M

IEEE HDD RAID MPI MPU/CPU GPGPU GPU cm I m cm /g I I n/ cm 2 s X n/ cm s cm g/cm

EQUIVALENT TRANSFORMATION TECHNIQUE FOR ISLANDING DETECTION METHODS OF SYNCHRONOUS GENERATOR -REACTIVE POWER PERTURBATION METHODS USING AVR OR SVC- Ju

5) 2. Geminoid HI-1 6) Telenoid 7) Geminoid HI-1 Geminoid HI-1 Telenoid Robot- PHONE 8) RobotPHONE 11 InterRobot 9) InterRobot InterRobot irt( ) 10) 4

Virtual Window System Virtual Window System Virtual Window System Virtual Window System Virtual Window System Virtual Window System Social Networking

IPSJ SIG Technical Report Vol.2014-HCI-158 No /5/22 1,a) 2 2 3,b) Development of visualization technique expressing rainfall changing conditions

MORALITY LEARNING AMBITION 2 KASUMIGAOKA

23 Fig. 2: hwmodulev2 3. Reconfigurable HPC 3.1 hw/sw hw/sw hw/sw FPGA PC FPGA PC FPGA HPC FPGA FPGA hw/sw hw/sw hw- Module FPGA hwmodule hw/sw FPGA h

Vol.54 No (July 2013) [9] [10] [11] [12], [13] 1 Fig. 1 Flowchart of the proposed system. c 2013 Information

IPSJ SIG Technical Report 1,a) 1,b) 1,c) 1,d) 2,e) 2,f) 2,g) 1. [1] [2] 2 [3] Osaka Prefecture University 1 1, Gakuencho, Naka, Sakai,

1 Fig. 1 Extraction of motion,.,,, 4,,, 3., 1, 2. 2.,. CHLAC,. 2.1,. (256 ).,., CHLAC. CHLAC, HLAC. 2.3 (HLAC ) r,.,. HLAC. N. 2 HLAC Fig. 2

7,, i

xx/xx Vol. Jxx A No. xx 1 Fig. 1 PAL(Panoramic Annular Lens) PAL(Panoramic Annular Lens) PAL (2) PAL PAL 2 PAL 3 2 PAL 1 PAL 3 PAL PAL 2. 1 PAL

IPSJ SIG Technical Report Vol.2010-MPS-77 No /3/5 VR SIFT Virtual View Generation in Hallway of Cybercity Buildings from Video Sequen

THE INSTITUTE OF ELECTRONICS, INFORMATION AND COMMUNICATION ENGINEERS TECHNICAL REPORT OF IEICE.

HP cafe HP of A A B of C C Map on N th Floor coupon A cafe coupon B Poster A Poster A Poster B Poster B Case 1 Show HP of each company on a user scree

スライド 1

Abstract This paper concerns with a method of dynamic image cognition. Our image cognition method has two distinguished features. One is that the imag

[1] [3]. SQL SELECT GENERATE< media >< T F E > GENERATE. < media > HTML PDF < T F E > Target Form Expression ( ), 3.. (,). : Name, Tel name tel

IPSJ-CVIM

Gaze Head Eye (a) deg (b) 45 deg (c) 9 deg 1: - 1(b) - [5], [6] [7] Stahl [8], [9] Fang [1], [11] Itti [12] Itti [13] [7] Fang [1],

A Feasibility Study of Direct-Mapping-Type Parallel Processing Method to Solve Linear Equations in Load Flow Calculations Hiroaki Inayoshi, Non-member

14 2 5

1., 1 COOKPAD 2, Web.,,,,,,.,, [1]., 5.,, [2].,,.,.,, 5, [3].,,,.,, [4], 33,.,,.,,.. 2.,, 3.., 4., 5., ,. 1.,,., 2.,. 1,,

2. CABAC CABAC CABAC 1 1 CABAC Figure 1 Overview of CABAC 2 DCT 2 0/ /1 CABAC [3] 3. 2 値化部 コンテキスト計算部 2 値算術符号化部 CABAC CABAC

IPSJ SIG Technical Report 1, Instrument Separation in Reverberant Environments Using Crystal Microphone Arrays Nobutaka ITO, 1, 2 Yu KITANO, 1

IPSJ SIG Technical Report Vol.2011-MUS-91 No /7/ , 3 1 Design and Implementation on a System for Learning Songs by Presenting Musical St

,,,,., C Java,,.,,.,., ,,.,, i

IPSJ SIG Technical Report Vol.2010-CVIM-170 No /1/ Visual Recognition of Wire Harnesses for Automated Wiring Masaki Yoneda, 1 Ta

IPSJ SIG Technical Report Vol.2012-CG-149 No.13 Vol.2012-CVIM-184 No /12/4 3 1,a) ( ) DB 3D DB 2D,,,, PnP(Perspective n-point), Ransa

MDD PBL ET 9) 2) ET ET 2.2 2), 1 2 5) MDD PBL PBL MDD MDD MDD 10) MDD Executable UML 11) Executable UML MDD Executable UML

IPSJ SIG Technical Report Vol.2014-EIP-63 No /2/21 1,a) Wi-Fi Probe Request MAC MAC Probe Request MAC A dynamic ads control based on tra

情報処理学会研究報告 IPSJ SIG Technical Report Vol.2015-CVIM-195 No /1/22 AR マーカ除去のための実時間背景画像変形 *1 1 1 Abstract 本稿では, 拡張現実感で用いられる AR マーカの違和感のない視覚的除去を実現するた

JFE.dvi

25 AR 3 Property of three-dimensional perception in the wearable AR environment

yoo_graduation_thesis.dvi

MEISEI HEROES HERO HERO HERO MEISEI HEROES

07-二村幸孝・出口大輔.indd

IPSJ SIG Technical Report Vol.2017-ARC-225 No.12 Vol.2017-SLDM-179 No.12 Vol.2017-EMB-44 No /3/9 1 1 RTOS DefensiveZone DefensiveZone MPU RTOS

Web Basic Web SAS-2 Web SAS-2 i

Vol1-CVIM-172 No.7 21/5/ Shan 1) 2 2)3) Yuan 4) Ancuti 5) Agrawal 6) 2.4 Ben-Ezra 7)8) Raskar 9) Image domain Blur image l PSF b / = F(

1(a) (b),(c) - [5], [6] Itti [12] [13] gaze eyeball head 2: [time] [7] Stahl [8], [9] Fang [1], [11] 3 -

2011上宮太子_高校_学校案内

11) 13) 11),12) 13) Y c Z c Image plane Y m iy O m Z m Marker coordinate system T, d X m f O c X c Camera coordinate system 1 Coordinates and problem

28 Horizontal angle correction using straight line detection in an equirectangular image

新製品開発プロジェクトの評価手法

2007/8 Vol. J90 D No. 8 Stauffer [7] 2 2 I 1 I 2 2 (I 1(x),I 2(x)) 2 [13] I 2 = CI 1 (C >0) (I 1,I 2) (I 1,I 2) Field Monitoring Server

知能と情報, Vol.30, No.5, pp

ï\éÜA4*

(4) ω t(x) = 1 ω min Ω ( (I C (y))) min 0 < ω < C A C = 1 (5) ω (5) t transmission map tmap 1 4(a) t 4(a) t tmap RGB 2 (a) RGB (A), (B), (C)

Transcription:

Fast Shading and Shadowing of Virtual Obects Using Shadowing Planes in Mixed Reality y yy yy Tetsuya Kakuta y,takeshi Oishi yy and Katsushi Ikeuchi yy Abstract We have developed a fast shading and shadowing method that uses the shadowing planes and the images in mixed reality (MR). The method is model-based and computable in real time by using a standard graphics processing unit (GPU) making it particularly effective when used with an outdoor MR application. To express the shadows of obects, we map the shadow images that are synthesized from the images rendered offline with the lights onto the shadowing planes, and we compute alpha blending with the obects. The shadowing planes are generated from convex hulls of obects. We obtain the radiance parameters of the real scene from an omnidirectional image and compute the linear sum of the radiance parameters and the images on the GPU. We applied this shadowing method to both an indoor and outdoor MR application and found it to be effective. 1. CG MR: Mixed Reality 1)3) MR HMD CG CG MR MR 4) Shade 2007 9 28 2008 1 17 2008 2 20 y DC 113 0033 7 3 1TEL 03 5841 5938 yy 113 0033 7 3 1TEL 03 5841 5938 y Graduate School of Interdisciplinary Information Studies, The University oftokyo, JSPS Researc Fellow (7 3 1, Hongo, Bunkyo-ku, Tokyo 113 0033, Japan) yy Interfaculty Initiative in Information Studies, The University of Tokyo (7 3 1, Hongo, Bunkyo-ku, Tokyo 113 0033, Japan) Shadow CG 5)7) MR CG 1 2 3 MR 8) 9) 10) 11) 12) 13) 14) 15) 16) 11) 9) 17) Vol. 62, No. 5, pp. 18 (2008) (1) 1

1 Shadowing using shadowing planes. MR 3 ffl ffl GPU 1 9) 17) GPU 2 3 GPU 4 5 6 2. 2 a 3D b c 2 Flowchart of the proposed method. d e f GPU g h 3. 3. 1 3 3 3D 1 MR 2 (2) Vol. 62, No. 5 (2008)

4 Offset of shadowing plane. 14) 3 Generation of shadowing planes. 5.3 3. 2 3 3 18) 19) 3b 3D 3c 3. 3 4 Z-fighting Z Z OpenGL Z near nfar f Z Z ob Z Z ndc 2fn Z ndc = + f + n (1) (f n)z ob f n near 0far 1 Z ob d d = Z ndc +1 2 2fn = + f + n (f n)z ob 2(f n) + 1 2 (2) (3) 3 OpenGL glpolygonoffset 3. 4 E P shadow E 0 E 0 P I P d 10) P I E 0 = E P (4) d I shadow P I P d I shadow =1 (5) (3) 3

ΣI shadow I Σd shadow I P shadow S 1 I,1 S 2 I,2 S n d,1 S 1 d,1 S 2 d,1 S n ΣI Σd 6 Linear combination of luminance parameters and images and diffuse components. 0 i 5 Generation of shadow images and mapping onto shadowing planes. 5 I shadow 1 0 5 a 5b P shadow I shadow 0 E 0 E 0 = E(1 I shadow )+P shadow I shadow (6) 6 P shadow 0 P shadow I shadow =0 E 0 = E(1 I shadow ) (7) 7 5 4 3. 5 GPU m P shadow f = 1; 2;:::;mg n L i fi = 1; 2;:::;ng P shadow I ;i P shadow d ;i v S 1 S 2 S 3 S 4 u S n-3 S n-2 S n-1 S n 7 Synthesis of images using fragment shader. S i 6a P shadow I ;i S i P I 6 b d ;i P d 7 GPU L i m d ;i S i UV 4 (4) Vol. 62, No. 5 (2008)

N L d A B S i d 8 Hemispheric surface light source. 10 Estimation of light distribution from omnidirectional image. N Geodesic Dome i Li i P shadow I,i n 9 Generation of images. 11 MR Apparance of MR-system. 4. 4. 1 8 A A A ffi L( ; ffi) A ( ; ffi) (d ; dffi) B A E 20) E = Z ß Z ß ß 0 2 L( ; ffi)sin cos d dffi (8) 21) Geodesic Dome Geodesic Dome 3 22) 23) 9a Geodesic Dome L i A E L i 4. 2 9 P shadow Geodesic Dome L i I ;i d ;i 4. 3 10 Geodesic Dome L i 2550:0 ο 1:0 S i 3.5 5. MR (5) 5

GPU RGBA 5. 1 MR MR MR Platform 24) MR Platform HMDPolhemus 6 FASTRAK HMD 640 480 FIT FI-19 CCD Victor KY-57 PC OS: Windows XPSP2CPU: Core2Duo E6850 3.0GHzRAM: 4GBGPU: nvidia GeForce8800GTS 640MB MR 11 5. 2 12 1 40 128 128 40 12a 12b 12c 12d 12 1 0.93 5. 3 13 13a 13b 36 40 1520 MR 5m 50000 1 1.46 13b36 21 1 1.29 13% VRMR CG 25) 26) 2333 13 13 19 7 17: 13c 22% 6. MR 1 2 GPU Geodesic Dome 6 (6) Vol. 62, No. 5 (2008)

12 Comparison of shading and shadowing of virtual obect indoors. 13 Comparison of shading and shadowing of virtual obect outdoors. 1 523pp.266-272 (March 1997) 2R. Azuma ASurvey of Augmented Reality Presence: Teleoperators and Virtual Environments64pp.355-385 (August 1997) 3R. AzumaY. BaillotR. BehringerS. FeinerS. Julierand B. MacIntyre Recent Advances in Augmented Reality IEEE Computer Graphics and Applications216, pp.34-47 (November 2001) 4 44pp.623-630 (December 1999) 5A. WooP. Poulinand A. Fournier A Survey of Shadow Algorithms IEEE Computer Graphics and Applications106 pp.13-32 (November 1990) 6F. Crow Shadow Algorithms for Computer Graphics Proc. SIGGRAPH'77pp.242-248 (1977) 7J. M. HasenfratzM. LapierreN. Holzschuchand F.X. Sillion ASurvey of Real-time Soft Shadows Algorithms Computer Graphics Forumpp.753-774 (December 2003) 8K. Jacobs and C. Loscos Classification of Illumination Methods for Mixed Reality Proc. Eurographics State of the Art Report(STAR)pp.95-118 (September 2004) 9 D-IIJ-84-D-II81234-1242(August 2001) 10I. SatoY. Satoand K. IkeuchiAcquiring a Radiance Distribution to Superimpose Virtual Obects onto a Real Scene IEEE Trans. on Visualization and Computer Graphics51pp.1-12 (January-March 1999) 11P. Debevec Rendering Synthetic Obects into Real Scenes: Bridging Traditional and Image-Based Graphics with Global Ilumination and High Dynamic Range Photography Proc. SIG- GRAPH '98pp.189-198(July 1998) 12M. Kanbara and N. Yokoya Geometric and photometric registration for real-time augmented reality Proc. Int. Symp. on Mixed and Augmented Reality (ISMAR02)pp.279-280 (September 2002) 13H. MatsuokaA. Onozawa and E. HosoyaEnvironment Mapping for Obects in the Real World: a Trial Using ARToolkit Proc. Int. Augmented Reality Toolkit Workshop (September 2002) 14I. SatoY. Sato and K. Ikeuchi Illumination from Shadows IEEE Trans. on Pattern Analysis and Machine Intelligence25 3pp.290-300 (March 2003) 15M. HallerS. Drab and W. Hartmann A Real-Time Shadow Approach for an Augmented Reality Application Using Shadow Volumes Proc. Symp. on ACM Virtual Reality Software and Technology(VRST'03)pp.56-65 (October 2003) 16 MIRU2005pp.297-304 (July 2005) 17J. S. NimeroffE. Simoncelli and J. Dorsey Efficient Re- (7) 7

Rendering of Naturally Illuminated Environments Proc. Eurographics Workshop on Rendering (EGWR94)pp.359-373 (June 1994) 18M. LevoyK. PulliB. CurlessS. RusinkiewiczD. KollerL. PereiraM. GinztonS. AndersonJ. DavisJ. GinsbergJ. Shadeand D. FulkThe Digital Michelangelo Proect: 3D Scanning of Large Statues Proc. SIGGRAPH'00pp.131-144 (July 2000) 19K. Ikeuchi Modeling from Reality Proc. Third International Conference on 3D Digital Imaging and Modeling (3DIM'01) pp.177 (May 2001) 20B. K. P. Horn Robot Vision The MIT Press (March 1986) 21P. P. SloanJ. KautzJ. SnyderPrecomputed Radiance Transfer for Real-Time Rendering in Dynamic, Low-Frequency Lighting Environments Proc. SIGGRAPH'02pp.527-536 (July 2002) 22A. Pugh Polyhedra: a Visual Approach University of California Press (September 1976) 23K. IkeuchiRecognition of 3D Obect using the Extended Gaussian Image Proc. 7th International Joint Conference on Artificial Intelligencepp.595-600 (August 1981) 24S. UchiyamaK. TakemotoK. SatohH. Yamamotoand H. Tamura MR Platform: A Basic Body on Which Mixed Reality Applications Are Built Proc. Int. Symp. on Mixed and Augmented Reality (ISMAR02)pp.246-253 (September 2002) 25 1995 pp.263 (March 1995) 26 2007 pp.169 (March 2007) 2002 2005 DC 1999 2002 2005 2006 2007 1978 MIT CMU 1996 2000 8 (8) Vol. 62, No. 5 (2008)

2024 © docsplayer.net プライバシー | 利用規約 | フィードバック