& Vol.5 No (Oct. 2015) TV 1,2,a) , Augmented TV TV AR Augmented Reality 3DCG TV Estimation of TV Screen Position and Ro

Similar documents
IPSJ SIG Technical Report Vol.2009-DPS-141 No.20 Vol.2009-GN-73 No.20 Vol.2009-EIP-46 No /11/27 1. MIERUKEN 1 2 MIERUKEN MIERUKEN MIERUKEN: Spe

IPSJ SIG Technical Report iphone iphone,,., OpenGl ES 2.0 GLSL(OpenGL Shading Language), iphone GPGPU(General-Purpose Computing on Graphics Proc

258 5) GPS 1 GPS 6) GPS DP 7) 8) 10) GPS GPS ) GPS Global Positioning System

ID 3) 9 4) 5) ID 2 ID 2 ID 2 Bluetooth ID 2 SRCid1 DSTid2 2 id1 id2 ID SRC DST SRC 2 2 ID 2 2 QR 6) 8) 6) QR QR QR QR

IPSJ SIG Technical Report Secret Tap Secret Tap Secret Flick 1 An Examination of Icon-based User Authentication Method Using Flick Input for

Vol.53 No (Mar. 2012) 1, 1,a) 1, 2 1 1, , Musical Interaction System Based on Stage Metaphor Seiko Myojin 1, 1,a

28 Horizontal angle correction using straight line detection in an equirectangular image

Vol.54 No (July 2013) [9] [10] [11] [12], [13] 1 Fig. 1 Flowchart of the proposed system. c 2013 Information

2. CABAC CABAC CABAC 1 1 CABAC Figure 1 Overview of CABAC 2 DCT 2 0/ /1 CABAC [3] 3. 2 値化部 コンテキスト計算部 2 値算術符号化部 CABAC CABAC

1_26.dvi

Fig. 3 Flow diagram of image processing. Black rectangle in the photo indicates the processing area (128 x 32 pixels).

1 Fig. 1 Extraction of motion,.,,, 4,,, 3., 1, 2. 2.,. CHLAC,. 2.1,. (256 ).,., CHLAC. CHLAC, HLAC. 2.3 (HLAC ) r,.,. HLAC. N. 2 HLAC Fig. 2

1 Web [2] Web [3] [4] [5], [6] [7] [8] S.W. [9] 3. MeetingShelf Web MeetingShelf MeetingShelf (1) (2) (3) (4) (5) Web MeetingShelf

[2] OCR [3], [4] [5] [6] [4], [7] [8], [9] 1 [10] Fig. 1 Current arrangement and size of ruby. 2 Fig. 2 Typography combined with printing

IPSJ SIG Technical Report Vol.2011-EC-19 No /3/ ,.,., Peg-Scope Viewer,,.,,,,. Utilization of Watching Logs for Support of Multi-

IPSJ SIG Technical Report Vol.2012-CG-148 No /8/29 3DCG 1,a) On rigid body animation taking into account the 3D computer graphics came

DPA,, ShareLog 3) 4) 2.2 Strino Strino STRain-based user Interface with tacticle of elastic Natural ObjectsStrino 1 Strino ) PC Log-Log (2007 6)

情報処理学会研究報告 IPSJ SIG Technical Report Vol.2016-MBL-80 No.11 Vol.2016-CDS-17 No /8/ (VR) (AR) VR, AR VR, AR Study of a Feedback Method fo

VRSJ-SIG-MR_okada_79dce8c8.pdf

2). 3) 4) 1.2 NICTNICT DCRA Dihedral Corner Reflector micro-arraysdcra DCRA DCRA DCRA 3D DCRA PC USB PC PC ON / OFF Velleman K8055 K8055 K8055

IPSJ SIG Technical Report Vol.2012-HCI-149 No /7/20 1 1,2 1 (HMD: Head Mounted Display) HMD HMD,,,, An Information Presentation Method for Weara

1 4 4 [3] SNS 5 SNS , ,000 [2] c 2013 Information Processing Society of Japan

IPSJ SIG Technical Report Vol.2016-CE-137 No /12/ e β /α α β β / α A judgment method of difficulty of task for a learner using simple

(a) 1 (b) 3. Gilbert Pernicka[2] Treibitz Schechner[3] Narasimhan [4] Kim [5] Nayar [6] [7][8][9] 2. X X X [10] [11] L L t L s L = L t + L s

Vol.55 No (Jan. 2014) saccess 6 saccess 7 saccess 2. [3] p.33 * B (A) (B) (C) (D) (E) (F) *1 [3], [4] Web PDF a m

5104-toku3.indd

Input image Initialize variables Loop for period of oscillation Update height map Make shade image Change property of image Output image Change time L

知能と情報, Vol.30, No.5, pp

Virtual Window System Virtual Window System Virtual Window System Virtual Window System Virtual Window System Virtual Window System Social Networking

17 Proposal of an Algorithm of Image Extraction and Research on Improvement of a Man-machine Interface of Food Intake Measuring System

2006 [3] Scratch Squeak PEN [4] PenFlowchart 2 3 PenFlowchart 4 PenFlowchart PEN xdncl PEN [5] PEN xdncl DNCL 1 1 [6] 1 PEN Fig. 1 The PEN

Vol.11-HCI-15 No. 11//1 Xangle 5 Xangle 7. 5 Ubi-WA Finger-Mount 9 Digitrack 11 1 Fig. 1 Pointing operations with our method Xangle Xa

０１３８５８，繊維学会誌ファイバー１月／報文－０２－古金谷

xx/xx Vol. Jxx A No. xx 1 Fig. 1 PAL(Panoramic Annular Lens) PAL(Panoramic Annular Lens) PAL (2) PAL PAL 2 PAL 3 2 PAL 1 PAL 3 PAL PAL 2. 1 PAL

<95DB8C9288E397C389C88A E696E6462>

2. Twitter Twitter 2.1 Twitter Twitter( ) Twitter Twitter ( 1 ) RT ReTweet RT ReTweet RT ( 2 ) URL Twitter Twitter 140 URL URL URL 140 URL URL

IPSJ SIG Technical Report Vol.2015-CVIM-196 No /3/6 1,a) 1,b) 1,c) U,,,, The Camera Position Alignment on a Gimbal Head for Fixed Viewpoint Swi

3D UbiCode (Ubiquitous+Code) RFID ResBe (Remote entertainment space Behavior evaluation) 2 UbiCode Fig. 2 UbiCode 2. UbiCode 2. 1 UbiCode UbiCode 2. 2

第６２巻　第１号　平成２４年４月／石こうを用いた木材ペレット

& Vol.2 No (Mar. 2012) 1,a) , Bluetooth A Health Management Service by Cell Phones and Its Us

Table 1. Assumed performance of a water electrol ysis plant. Fig. 1. Structure of a proposed power generation system utilizing waste heat from factori

ActionScript Flash Player 8 ActionScript3.0 ActionScript Flash Video ActionScript.swf swf FlashPlayer AVM(Actionscript Virtual Machine) Windows

A Feasibility Study of Direct-Mapping-Type Parallel Processing Method to Solve Linear Equations in Load Flow Calculations Hiroaki Inayoshi, Non-member

HP cafe HP of A A B of C C Map on N th Floor coupon A cafe coupon B Poster A Poster A Poster B Poster B Case 1 Show HP of each company on a user scree

27 VR Effects of the position of viewpoint on self body in VR environment

特-3.indd

1 3DCG [2] 3DCG CG 3DCG [3] 3DCG 3 3 API 2 3DCG 3 (1) Saito [4] (a) 1920x1080 (b) 1280x720 (c) 640x360 (d) 320x G-Buffer Decaudin[5] G-Buffer D

,,.,.,,.,.,.,.,,.,..,,,, i

25 D Effects of viewpoints of head mounted wearable 3D display on human task performance

Core Ethics Vol.

The 15th Game Programming Workshop 2010 Magic Bitboard Magic Bitboard Bitboard Magic Bitboard Bitboard Magic Bitboard Magic Bitboard Magic Bitbo

22 Google Trends Estimation of Stock Dealing Timing using Google Trends

, (GPS: Global Positioning Systemg),.,, (LBS: Local Based Services).. GPS,.,. RFID LAN,.,.,.,,,.,..,.,.,,, i

.,,, [12].,, [13].,,.,, meal[10]., [11], SNS.,., [14].,,.,,.,,,.,,., Cami-log, , [15], A/D (Powerlab ; ), F- (F-150M, ), ( PC ).,, Chart5(ADIns

( ) [1] [4] ( ) 2. [5] [6] Piano Tutor[7] [1], [2], [8], [9] Radiobaton[10] Two Finger Piano[11] Coloring-in Piano[12] ism[13] MIDI MIDI 1 Fig. 1 Syst

Web Web Web Web Web, i

EQUIVALENT TRANSFORMATION TECHNIQUE FOR ISLANDING DETECTION METHODS OF SYNCHRONOUS GENERATOR -REACTIVE POWER PERTURBATION METHODS USING AVR OR SVC- Ju

TF-IDF TDF-IDF TDF-IDF Extracting Impression of Sightseeing Spots from Blogs for Supporting Selection of Spots to Visit in Travel Sat

(3.6 ) (4.6 ) 2. [3], [6], [12] [7] [2], [5], [11] [14] [9] [8] [10] (1) Voodoo 3 : 3 Voodoo[1] 3 ( 3D ) (2) : Voodoo 3D (3) : 3D (Welc

28 TCG SURF Card recognition using SURF in TCG play video

Vol.54 No (Mar. 2013) 1,a) , A Case Study of the Publication of Information on the Japan Earthquake Naoto Matsumoto 1,a

IPSJ SIG Technical Report Vol.2009-DPS-141 No.23 Vol.2009-GN-73 No.23 Vol.2009-EIP-46 No /11/27 t-room t-room 2 Development of

12) NP 2 MCI MCI 1 START Simple Triage And Rapid Treatment 3) START MCI c 2010 Information Processing Society of Japan

7,, i

IPSJ SIG Technical Report Vol.2012-MUS-96 No /8/10 MIDI Modeling Performance Indeterminacies for Polyphonic Midi Score Following and

The copyright of this material is retained by the Information Processing Society of Japan (IPSJ). The material has been made available on the website

3 1 Table 1 1 Feature classification of frames included in a comic magazine Type A Type B Type C Others 81.5% 10.3% 5.0% 3.2% Fig. 1 A co

日本感性工学会論文誌

1., 1 COOKPAD 2, Web.,,,,,,.,, [1]., 5.,, [2].,,.,.,, 5, [3].,,,.,, [4], 33,.,,.,,.. 2.,, 3.., 4., 5., ,. 1.,,., 2.,. 1,,

FUJII, M. and KOSAKA, M. 2. J J [7] Fig. 1 J Fig. 2: Motivation and Skill improvement Model of J Orchestra Fig. 1: Motivating factors for a

日本感性工学会論文誌

ディスプレイと携帯端末間の通信を実現する映像媒介通信技術

HIS-CCBASEver2

IPSJ SIG Technical Report Vol.2010-NL-199 No /11/ treebank ( ) KWIC /MeCab / Morphological and Dependency Structure Annotated Corp

( 1) 3. Hilliges 1 Fig. 1 Overview image of the system 3) PhotoTOC 5) 1993 DigitalDesk 7) DigitalDesk Koike 2) Microsoft J.Kim 4). 2 c 2010

Core1 FabScalar VerilogHDL Cache Cache FabScalar 1 CoreConnect[2] Wishbone[3] AMBA[4] AMBA 1 AMBA ARM L2 AMBA2.0 AMBA2.0 FabScalar AHB APB AHB AMBA2.0

B HNS 7)8) HNS ( ( ) 7)8) (SOA) HNS HNS 4) HNS ( ) ( ) 1 TV power, channel, volume power true( ON) false( OFF) boolean channel volume int

第 55 回自動制御連合講演会 2012 年 11 月 17 日,18 日京都大学 1K403 ( ) Interpolation for the Gas Source Detection using the Parameter Estimation in a Sensor Network S. T

IPSJ SIG Technical Report Vol.2011-MUS-91 No /7/ , 3 1 Design and Implementation on a System for Learning Songs by Presenting Musical St

1 UD Fig. 1 Concept of UD tourist information system. 1 ()KDDI UD 7) ) UD c 2010 Information Processing S

1 7.35% 74.0% linefeed point c 200 Information Processing Society of Japan

MDD PBL ET 9) 2) ET ET 2.2 2), 1 2 5) MDD PBL PBL MDD MDD MDD 10) MDD Executable UML 11) Executable UML MDD Executable UML

1 [1, 2, 3, 4, 5, 8, 9, 10, 12, 15] The Boston Public Schools system, BPS (Deferred Acceptance system, DA) (Top Trading Cycles system, TTC) cf. [13] [

Vol. 48 No. 3 Mar PM PM PMBOK PM PM PM PM PM A Proposal and Its Demonstration of Developing System for Project Managers through University-Indus

System to Diagnosis Concrete Deterioration with Spectroscopic Analysis IHI IHI IHI The most popular method for inspecting concrete structures for dete

2007/8 Vol. J90 D No. 8 Stauffer [7] 2 2 I 1 I 2 2 (I 1(x),I 2(x)) 2 [13] I 2 = CI 1 (C >0) (I 1,I 2) (I 1,I 2) Field Monitoring Server

1: A/B/C/D Fig. 1 Modeling Based on Difference in Agitation Method artisoc[7] A D 2017 Information Processing

WikiWeb Wiki Web Wiki 2. Wiki 1 STAR WARS [3] Wiki Wiki Wiki 2 3 Wiki 5W1H Wiki Web 2.2 5W1H 5W1H 5W1H 5W1H 5W1H 5W1H 5W1H 2.3 Wiki 2015 Informa

Mimehand II[1] [2] 1 Suzuki [3] [3] [4] (1) (2) 1 [5] (3) 50 (4) 指文字, 3% (25 個 ) 漢字手話 + 指文字, 10% (80 個 ) 漢字手話, 43% (357 個 ) 地名 漢字手話 + 指文字, 21

日本感性工学会論文誌

1 Fogg Fogg Behavior Model [1] information cascade [2] TPO [3] Fig. 2 Target area of this paper. 1 Fig. 1 Fogg b

[2] 2. [3 5] 3D [6 8] Morishima [9] N n 24 24FPS k k = 1, 2,..., N i i = 1, 2,..., n Algorithm 1 N io user-specified number of inbetween omis

11) 13) 11),12) 13) Y c Z c Image plane Y m iy O m Z m Marker coordinate system T, d X m f O c X c Camera coordinate system 1 Coordinates and problem

パナソニック技報

ネットワーク化するデジタル情報家電の動向

JOURNAL OF THE JAPANESE ASSOCIATION FOR PETROLEUM TECHNOLOGY VOL. 66, NO. 6 (Nov., 2001) (Received August 10, 2001; accepted November 9, 2001) Alterna

DEIM Forum 2009 B4-6, Str

IPSJ SIG Technical Report 1, Instrument Separation in Reverberant Environments Using Crystal Microphone Arrays Nobutaka ITO, 1, 2 Yu KITANO, 1

log F0 意識 しゃべり 葉の log F0 Fig. 1 1 An example of classification of substyles of rap. ' & 2. 4) m.o.v.e 5) motsu motsu (1) (2) (3) (4) (1) (2) mot

( )

Transcription:

TV 1,2,a) 1 2 2015 1 26, 2015 5 21 Augmented TV TV AR Augmented Reality 3DCG TV Estimation of TV Screen Position and Rotation Using Mobile Device Hiroyuki Kawakita 1,2,a) Toshio Nakagawa 1 Makoto Sato 2 Received: January 26, 2015, Accepted: May 21, 2015 Abstract: We have studied on a new TV service, named augmented TV, which is able to augment representation of TV programs beyond the TV screen. We have proposed a system in which animated 3DCG content interlocked with TV programs is overlaid on live video from the mobile device camera in the mobile device screen by augmented reality techniques. In the system, the representation of having a TV character coming out of the screen can be provided. To achieve such a representation, it is needed always accurately to estimate position and rotation of the TV in the mobile device. We have proposed an estimation method using the camera and the gyro sensor. This paper shows the details of our method and that it is effective by experiments using the demo content. Keywords: augmented reality, 3DCG, augmented TV, position & rotation estimation, gyro sensor 1. 60 TV 16:9 2 1 1 NHK NHK Science & Technology Research Laboratories, Setagaya, Tokyo 157 8510, Japan 2 Tokyo Institute of Technology, Yokohama, Kanagawa 226 8503, Japan a) kawakita.h-dq@nhk.or.jp Augmented TV [1], [2], [3] Augmented TV Augmented TV Augmented TV TV AR Augmented Reality [4] c 2015 Information Processing Society of Japan 61

1 Augmented TV Fig. 1 Service model of augmented TV. 1 TV TV 3DCG TV TV 1 TV 3DCG 3DCG TV 3DCG TV Augmented TV 1 [5] [1] TV [2], [3] 2. TV 2.1 [1] TV Augmented TV TV 2 TV Fig. 2 Cue to detect TV screen. TV [4] 2 (a) TV TV TV TV TV TV TV [1] TV 2.2 2.1 2K 4K 30 fps 60 fps AR PC 3DCG c 2015 Information Processing Society of Japan 62

TV 2.1 TV TV TV TV Fig. 3 3 Flow chart of the estimation. 3. 3.1 TV TV TV [6] TV Augmented TV TV TV TV TV 2(a) TV 2(b) 2 TV 3.2 TV TV TV 3 TV TV 2 TV TV 3 TV 3 Perspective-n-Point PnP 4 4 OpenCV [7] cv::solvepnp() 3.3 3 1 TV c 2015 Information Processing Society of Japan 63

1 Table 1 Estimation method. 3.4 TV [1] TV ON/OFF 3.5 3 3.6 3.5 TV 3.6.1 1 N O(N) O(N 2 ) 4 Fig. 4 Search path of TV frame. [5], [8], [9], [10] [8] 1/100 [8] [9] [9] 61% 93% 3 [5], [10] TV TV 3.6.2 4 (1) 3.5 (2) c 2015 Information Processing Society of Japan 64

Fig. 6 6 2 Rotation correction at detection of 2 vertices. 5 Fig. 5 Classification of captures of TV frame. (7) (3) (2) (7) (4) (3) (3) 8 2 (5) (4) (3) (4) (6) 3 (3) 2 2 3 3.5.3 (4) (7) (7) (1) (2) 3.6.3 TV 3.6.2 4 TV 2 3 5 3 2 3.6.3.1 3 3 3.6.2 2 5 4 3.6.3.2 2 2 3 2 A) B) TV A 6 A 2 M 2 3 4 2 4 A B A B 2 c 2015 Information Processing Society of Japan 65

TV 3DCG TV TV TV 6 2 A TV 1 A B 2 A B 4. TV 2 4.1 3.6 7 CG Augmented TV CPU 1ms 10 1 OpenCV cv::houghlinesp() 8 OpenCV cv::canny() 6.8 ms 30.2 ms 10 2 30 fps 1 33 ms 1 2ms 4.2 2 2 TV TV Table 2 2 Specification and parameters of implementation. Fig. 7 7 Processing time of the frame recognition. Fig. 8 8 Example of the results of Hough transformation. c 2015 Information Processing Society of Japan 66

5.2 TV 2 4 5. 5.1 3.6.1 O(N) 2K 4K 640 480 px 3 6 2ms 6ms 12 ms 60 fps 16 ms 2.2 Augmented TV HMD Head Mount Display [11] HMD [11] 4.1 2 5.2 4.2 3 [10] TV / TV 0.5 2.0 4.2 TV TV TV TV 3.6.2 6. c 2015 Information Processing Society of Japan 67

9 Fig. 9 NHK State of NHK Science Stadium. 11 3DTV Fig. 11 Model image of search results by a word 3DTV. 10 Fig. 10 Schematic diagram of the demo content. NHK [12] 2 9 10 1 16 2 TV 5 TV TV 150 2 2 TV TV TV TV TV TV 7. Augmented TV TV 50 [13] CM [14] TV TV 3DTV 3DTV 11 3DTV TV 3DTV Augmented TV TV 5.1 TV TV 8. Augmented TV TV TV c 2015 Information Processing Society of Japan 68

TV Augmented TV TV TV 1989 NHK 2012 [1] Augmented TV TV Vol.19, No.3, pp.319 328 (2014). [2] TV 2014 13 1 (2014). [3] TV 2014 4 12 (2014). [4] ARToolKit Vol.101, No.652, pp.79 86 (2002). [5] AR Visual SyncAR 41 R6-2 (2013). [6] Klein, G. and Murray, D.: Parallel Tracking and Mapping for Small AR Workspaces, 6th IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR), pp.1 10 (2007). [7] OpenCV ver2.4.10, available from http://opencv.jp. [8] i D-II, Vol.J88, No.6, pp.1035 1046 (2005). [9] FIT2005, J-027 (2005). [10] Vol.106, No.351, pp.1 6 (2006). [11] BP pp.5 33 (2014). [12] NHK http://www.nhkp.co.jp/event/detail.php?id=423. [13] (1965). [14] (1998). 1973 3 1978 3 4 1986 3 VR SPIDAR VR 2004 NHK NHK 2007 c 2015 Information Processing Society of Japan 69

2024 © docsplayer.net プライバシー | 利用規約 | フィードバック