22 A Study of Framework for Semantic Filesystem

Size: px

Start display at page:

Download "22 A Study of Framework for Semantic Filesystem"

しょうりはかまや
5 years ago
Views:

1 22 A Study of Framework for Semantic Filesystem

2 (SFS) Linux FreeBSD Unix OS Windows OS SFS SFS SFS Ruby FUSE SFS Ruby 2 FUSE Ruby SFS i

3 Abstract A Study of Framework for Semantic Filesystem Hiroki MIYAMOTO The number of files installed on the computer have been increasing according to increase of the application and appearance of new device. The file increase raise an increased cost that the user classify the files by their purposes, usages, etc. However, it is difficult to reduce time in the classification by a static conventional tree structure. Therefore, the semantic file system (SFS) have been proposed, it adopts the semantic information extracted from the file to classify the file. But there is no implementation of the semantic files system on the conventional OS such as Linux based distribution, FreeBSD, Windows, Mac OS, etc. We have pointed out major reason for no implementation, that is difficult to update the classification rules and extract the necessary semantic information among the files. In this thesis, a script language Ruby and an interface library FUSE are used to solve the problem and implement the function of SFS. We propose the framework that make semantic information change scheme easy. Moreover, we have evaluated the framework that the semantic file system implemented by Ruby is useful from two view points (the processing time and the extensibility). key words Semantic Filesystem Filesystem FUSE Ruby SFS ii

4 iii

5 25 A 27 A B 28 B.1 FLAC B.2 MP B.3 C B.4 ls B.5 cp iv

6 2.1 VFS FUSE DRAM SFS Daemon SFS ls vim A v

7 Benchmark 10 Files Benchmark 1920 Files vi

8 1 [3] Windows Nautilus 1

9 Unix OS Windows OS SFS Windows Windows Linux locate Tracker OS [7] (SFS) [1] Linux FreeBSD Unix OS Windows OS SFS SFS SFS Ruby Filesystem in Userspace(FUSE) SFS Ruby 2 2

10 2 SFS

11 2 2.1 OS Virtual File System(VFS) FUSE VFS 2.1 ext2 ext3 ReiserFS Network File System(NFS) VFS API ext3 ReiserFS 4

12 2.1 System Call (open, read, write,...) FUSE Application User Kernel VFS ext3 xfs NFS FUSE Block Device Network 2.1 VFS FUSE VFS NFS SFS VFS VFS NFS FUSE VFS Linux Kernel FUSE 2.1 VFS FUSE WikipediaFS [5] NTFS-3G [6] Linux FreeBSD Unix OS Windows ext3 FAT NTFS SFS 5

13 2.2 SFS SFS 2.2 SFS NTFS ext3 2.1 Javadoc Doxygen SFS SFS SFS OS SFS Unix OS Windows OS SFS Windows Windows Linux locate Tracker OS 6

14 DRAM SFS SFS C CPU API 7

15 2.3 API 10 CPU [8] [18] API FUSE Web Ruby Python Java C Tomcat JSP Java Java C SFS 8

16 (.c) (.rb) (.jpg) ISO GPS (.mp3,.flac) 9

17 SFS Daemon API FUSE SFS Daemon 3.2 SFS Daemon SFS Daemon Transducer 2 SFS Daemon FUSE Transducer User Program SFS Daemon ruby./sfs.rb RDB ls /mount_point_of_sfs VFS libfuse User Space Program Kernel Space Program ext3 NFS FUSE

18 3.1 FUSE Interface Kernel User File Add/Update/Delete Notification Original Files File Data System Calls SFS Daemon Transducer RDB Attributes 3.2 SFS Daemon 3.3 SFS SFS FUSE 3.3 SFS Daemon Transducer SFS Transducers Transducers 11

19 ls 3.5 vim 3.2 SFS 3.1 SFS Daemon Transducer ls 3.4 ls 12

20 3.3 Original Directory music0.flac music1.flac music2.flac Symbolic Links Artists Genres Artist A Artist B music0.flac music2.flac music1.flac Semantic Filesystem Directory 3.6 VFS FUSE SFS Daemon SFS Daemon ls vim 3.5 vim 3.5 ext3 inotify SFS Daemon SFS Daemon Transducer SFS Original Directory Semantic Filesystem Directory Semantic Filesystem Directory

21 3.4 SFS Original Directory Artists Genres Semantic Filesystem Directory 3.4 SFS NTFS ext3 FUSE OS SFS FUSE open read write VFS FUSE fuse operations FUSE fuse operations open read write Ruby FUSE FUSE Ruby Ruby Ruby FUSE FuseFS 3.1 open 3.1 FUSE Ruby 14

22 FUSE API Ruby Binding open open read file read read write write write to readdir readdir directory? utime utime touch mkdir mkdir mkdir rmdir rmdir rmdir rename rename delete, write to FUSE Open Ruby read file Ruby open read SFS vim Emacs 2 cp link mv 15

23 SFS ls /mount_point_of_sfs/:artists ls /mount_point_of_sfs/:artists/artist0 Artist0 FileName SFS 4 16

24 3.5 <sfs-path> <pn> ::= /<pn> <pn> ::= <name> <attribute> <field-name> <name>/<pn> <attribute>/<pn> <attribute> ::= field: <field-name>/<value> <field-name> ::= <string>: <value> <name> ::= <string> ::= <string> Unix OS / \0 Windows < > " * SFS 17

25 3.5 File Create Consistency Problem File Update Consistency Problem File Delete Consistency Problem File Operation Time SFS Database Add SFS Database Update SFS Database Delete SFS Operation 3.8 SFS Linux inotify OS inotify SFS Daemon SFS 18

26 4 4.1 Windows7 OS 32bit Fedora Linux Ruby ext3 SFS ls ext3 4.1 CPU Host Memory Guest Memory Intel Core 2 Duo E6600(2.4GHz) Dual-Channel DDR GB 1GB Virtual Machine VMware Player Host OS Guest OS Windows 7 Professional(64bit) Fedora Linux 14(32bit) Database SQLite

27 Benchmark 10 Files Filesystem second/10k count second/count ext SFS Benchmark 1920 Files Filesystem second/10k count second / count ext SFS SFS Extensions Lines.mp3 18.flac 13.c 27 20

28 SFS Ruby C C 21

29 5 SFS Linux FreeBSD Unix OS Windows OS SFS SFS SFS Ruby FUSE SFS Ruby FUSE ext Ruby FUSE Ruby SFS 22

30 Ruby YAML XML YAML XML 23

31 24

32 [1] David K. Gifford, Pierre Jouvelot, Mark A. Sheldon, and James W. O Toole, Jr., Semantic File Systems, ACM Operating Systems Review, pp , Oct [2] Bryan Mills, Metadata Driven Filesystem, uploads/metafs/bmills-final.pdf, Sept. 15, [3], Linux 2.6,, p.253, [4] John K. Ousterhout, Scripting: Higher Level Programming for the 21st Century, IEEE Computer, Volume 31 Issue No.3, pp [5] Mathieu Blondel, WikipediaFS, Jan. 12, [6] Tuxera Inc., NTFS-3G, Jan. 12, [7] The GNOME Project, Tracker, Jan. 12, [8] ITRS, ITRS 2000 Update, Process Integration, Devices, and Structures, Jan. 12, [9] ITRS, ITRS 2001 Edition, Process Integration, Devices, and Structures, Jan. 12, [10] ITRS, ITRS 2002 Update, Process Integration, Devices, and Structures, Jan. 12, [11] ITRS, ITRS 2003 Edition, Process Integration, Devices, and Structures, Jan. 12,

33 [12] ITRS, ITRS 2004 Update, Process Integration, Devices, and Structures, Jan. 12, [13] ITRS, ITRS 2005 Edition, Process Integration, Devices, and Structures, Jan. 12, [14] ITRS, ITRS 2006 Update, Process Integration, Devices, and Structures, pdf, Jan. 12, [15] ITRS, ITRS 2007 Edition, Process Integration, Devices, and Structures, Jan. 12, [16] ITRS, ITRS 2008 Update, Process Integration, Devices, and Structures, Jan. 12, [17] ITRS, ITRS 2009 Edition, Process Integration, Devices, and Structures, PIDS.pdf, Jan. 12, [18] ITRS, ITRS 2010 Update, Process Integration, Devices, and Structures, PIDS_FOCUS_C_ITRS.xls, Jan. 12,

34 A A.1 A.1 27

35 B B.1 FLAC require rubygems require flacinfo class Flac < Transducer def run_parse flac = FlacInfo.new(@path) hash0 = Hash["artist", flac.tags[ ARTIST ], "genre", flac.tags[ GENRE ]] ary = ["filename", File::basename(@path), "attr", hash0] return Hash[*ary] end end 28

36 B.2 MP3 B.2 MP3 require rubygems require mp3info require kconv class Mp3 < Transducer def run_parse mp3 = Mp3Info.open(@path) artist = mp3.tag.artist == nil? "none" : mp3.tag.artist artist = Kconv.toutf8(artist) genre = mp3.tag.genre_s == nil? "none" : mp3.tag.genre_s genre = Kconv.toutf8(genre) hash0 = Hash["artist", artist, "genre", genre] ary = ["filename", File::basename(@path), "attr", hash0] return Hash[*ary] end end 29

37 B.3 C B.3 C require rubygems require lpt require File.dirname( FILE ) + "/transducer.rb" class Clang < Transducer def run_parse ) { fd clang_file = fd.read() tokenizer = LPT::CTokenizer.new( ) tokenizer.parse( clang_file ) languagescanner = LPT::CLanguageScanner.new() languagescanner.parse( tokenizer.tokens ) ary0 = Array.new(); languagescanner.prototypes.each{ proto ary0 << proto.method_name.to_s } hash0 = Hash["functions", ary0] ary = ["filename", File::basename(@path), "attr", hash0] return Hash[*ary] } end end 30

38 B.4 ls B.4 ls #!/bin/bash cd /tmp/dbfs for i in seq do ls FileName >& /dev/null done cd /tmp B.5 cp #!/bin/bash cd /tmp/dbfs/artists/various for i in seq do cp music2.flac /tmp/ done cd /tmp 31

Web Web Web Web Web, i

22 Web Research of a Web search support system based on individual sensitivity 1135117 2011 2 14 Web Web Web Web Web, i Abstract Research of a Web search support system based on individual sensitivity