1,a) 1 2 3 3 Evaluation of a system to analize long-term images from a stationary camera Abstract: Images which are recorded for a long term by a stationary camera contain much information. However, it is difficult to view or analyze throughout the images. Hence we developed a system to analyze those images by showing areas and period in which images are changing. In this paper we evaluated this system by carrying out a discovery experiment and revealed user s analyzing process and their awareness provided by each functions. 1. [1 3] 1 Department of Computer Science, Graduate School of Systems and Information Engineering, University of Tsukuba 2 College of Media, Arts, Science and Technology, School of Informatics, University of Tsukuba 3 Faculty of Engineering, Information and Systems, University of Tsukuba a) abe@iplab.cs.tsukuba.ac.jp 1 visual analytics [4, 5] [6,7] c 2015 Information Processing Society of Japan 1
3. 2 A B NAS 1 Fig. 1 Omni-directional camera image. 2. Romero Viz-A-Vis 3D [8] [9] [9] Romero 3D 2D 2 TotalRecall [10] 10 VERT [11] VERT DeCamp [12] 11 3D Buono [13] Zensors [14] Zensors 3.1 NAS LZOP3551 1632 1224 608 608 360 68 NAS QNAP TS-859 Pro A TS-859 Pro+ B MacBookPro 13-inch Late 2011 CPU 2.8GHz Intel Core i7 8GB OS OS X Lion 10.7.5 13 A Retina 15-inch Early 2013 CPU 2.7GHz Intel Core i7 16GB OS OS X 10.8.2 15 B 2 A B A 7.50 m 7.75 m 58 m 2 2.5 m B 7.5 m 15.0 m 113 m 2 2.7 m Qt OpenCV 1fps NAS 3.2 2 A E D A B C D E F G B C c 2015 Information Processing Society of Japan 2
画像提示部 A 時刻操作部 C D E B ヒートマップ操作部 H I J F G 2 Fig. 2 Interface of viewing system. F G D D A C F H I J 2 H On/Off I J A 3 2014 8 7 11 33 2014 8 2014 9 8 3a 9 3b 8 9 3c 2 Qt OpenCV I A c b a 3 Fig. 3 Heatmap image. B 1 1 C F 4. c 2015 Information Processing Society of Japan 3
4.1 4 3 1 22 23 A 4.2 MacBookPro 13-inch Mid 2010 CPU 2.4GHz Core 2 Duo 4GB OS OS X 10.9.5 13 4.3 B 2015 4 1 2015 5 31 2 B 30 A 2014 7 1 2014 12 31 6 A 1 5. 5.1 P1 P4 96 24 SD = 13.7 P1 41 P2 31 P3 20 P4 4 4 Overviewing Focusing Environment 4 Fig. 4 The number of observations by qualities Suggestion Other Overviewing Focusing Environment Suggestion Other 5 5 1 2 HM/all HM/part 5 P1 P1 P1 Suggestion Other 4 P2 Focusing Overviewing 5 P2 HM/part P2 2 c 2015 Information Processing Society of Japan 4
7 Fig. 7 Did you use our system with ease? Fig. 5 5 The number of uses by functions 8 Fig. 8 Do you want to use our system in the future? 6 Fig. 6 The number of observations by functions P3 P2 P2 P3 4 5 P4 Overviewing HM/all P4 HM/all 96 11 11.4%2 P3 P4 6 HM/all Focusing HM/part Focusing Environment Focusing Overviewing 2 5 7 8 P2 P2 P1 P3 2 5.2 P1 P4 7 8 9 P1 9 10 16 16 Focusing P1 7 12 9 15 11 15 27 16 13 P2 10 Focusing P2 c 2015 Information Processing Society of Japan 5
情報処理学会研究報告 でなく とぎれとぎれになっていることに気付いた よっ て 上記の結論に至った P3 は図 11 に示す画面を見て 自身が 8 月後半から 9 月 にかけて研究室によく滞在していることに気付いた この 気付きの分類は Focusing カレンダー HM/part であ る また この気付きも自身に関する気付きである P3 は P2 と同様 実験開始後に自身の席を矩形選択した 次に 7 月から 12 月までカレンダーを操作した結果 8 月後半か ら 9 月にかけてカレンダーの色が濃くなっていることに気 付いた よって 上記の結論に至った 図 11 P3 は自身が 8 月後半から 9 月にかけて研究室によく滞在し ていることに気付いた Fig. 11 P3 was aware that he was frequently in the labratory from late August to early September. さらに P3 は図 12 に示す画面を見て 2 箇所のディスプ レイ 図 12 緑丸印 に動きが集中していることに気付い た この気付きの分類は Environment HM/all である P3 は カレンダーをひと通り見終わった後 新しい気付き を探す過程においてヒートマップの対象期間を 1 日とした とき 特に 2 つの画面のヒートマップが濃く表示されたた 図 9 P1 はある人物が研究室の棚の上に物を設置した時間について め 上記の結論に至った さらに これらのディスプレイ 気付いた のうち一方は常にスクリーンセーバーが流れており 他方 Fig. 9 P1 was aware of the time when a student placed some- は時計が表示されている事にも気付いた thing on the shelf in the labratory. 図 12 図 10 P2 は自身が研究室に滞在している時によく席を立っている ことに気付いた Fig. 10 P2 was aware that he often stood up from his sheet P3 は 2 箇所のディスプレイに常に動きがみられることに気 付いた Fig. 12 P3 was aware that the screens of those two monitors are frequently changing. when he was in the labratory. c 2015 Information Processing Society of Japan 6
P4 13 Overviewing HM/all P4 7 12 7 12 Fig. 13 13 P4 P4 was aware that some students were in the labratory at the end of the year. 6. 6 30 A 2014 6 24 B 2015 4 [1] Corporation, N.: Fieldanalyst: http://www. nec-solutioninnovators.co.jp/sl/fieldanalyst/. [2] Xing, Y., Wang, Z. and Qiang, W.: Face tracking based advertisement effect evaluation, in Image and Signal Processing, 2009. CISP 09. 2nd International Congress on, pp. 1 4 (2009). [3] Leykin, A.: Visual human tracking and group activity analysis: A video mining system for retail marketing, PhD thesis, Department of Computer Science and Cognitive Science, Indiana University (2007). [4] Wong, P. C. and Thomas, J.: Visual analytics, IEEE Computer Graphics and Applications, No. 5, pp. 20 21 (2004). [5] Thomas, J. J., Cook, K., et al.: A visual analytics agenda, Computer Graphics and Applications, IEEE, Vol. 26, No. 1, pp. 10 13 (2006). [6] Nogami, R., Shizuki, B., Hosobe, H. and Tanaka, J.: An Exploratory Analysis Tool for a Long-Term Video from a Stationary Camera, in Proceedings of the 5th IEEE International Symposium on Monitoring & Surveillance Research, Vol. 2 of ISMSR 12, pp. 32 37 (2012). [7],,,, pp. 523 526, (2011). [8] Romero, M., Summet, J., Stasko, J. and Abowd, G.: Viz-A-Vis: Toward Visualizing Video through Computer Vision, Visualization and Computer Graphics, IEEE Transactions on, Vol. 14, No. 6, pp. 1261 1268 (2008). [9] Romero, M., Vialard, A., Peponis, J., Stasko, J. and Abowd, G.: Evaluating Video Visualizations of Human Behavior, in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 11, pp. 1441 1450, New York, NY, USA (2011), ACM. [10] Kubat, R., DeCamp, P. and Roy, B.: TotalRecall: Visualization and Semi-automatic Annotation of Very Large Audio-visual Corpora, in Proceedings of the 9th International Conference on Multimodal Interfaces, ICMI 07, pp. 208 215, New York, NY, USA (2007), ACM. [11] Li, Y. and Merialdo, B.: VERT: Automatic Evaluation of Video Summaries, in Proceedings of the International Conference on Multimedia, MM 10, pp. 851 854, New York, NY, USA (2010), ACM. [12] DeCamp, P., Shaw, G., Kubat, R. and Roy, D.: An Immersive System for Browsing and Visualizing Surveillance Video, in Proceedings of the International Conference on Multimedia, MM 10, pp. 371 380, New York, NY, USA (2010), ACM. [13] Buono, P. and Moro, A.: Analyzing Video Produced by a Stationary Surveillance Camera, in Proceedings of the International Conference on Distributed Multimedia Systems, DMS 2011, pp. 140 145 (2011). [14] Laput, G., Lasecki, W. S., Wiese, J., Xiao, R., Bigham, J. P. and Harrison, C.: Zensors: Adaptive, Rapidly Deployable, Human-Intelligent Sensor Feeds, in Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 15, pp. 1935 1944, New York, NY, USA (2015), ACM. c 2015 Information Processing Society of Japan 7