Dockerの商用サービスでの利用事例紹介

Size: px

Start display at page:

Download "Dockerの商用サービスでの利用事例紹介"

るるみうなだ
5 years ago
Views:

1 1 Docker

2 Docker 2015 Internet Initiative Japan Inc.

4 Internet Initiative Japan Inc.

5 IIJ GIO & REST API(AWS S3 ) + Hadoop/Hive 2015 Internet Initiative Japan Inc.

6 IIJ GIO data storage API data data data query analysis API container 2015 Internet Initiative Japan Inc.

7 Hadoop + Hive 2015 Internet Initiative Japan Inc.

8 ( ) DN analysis API query NN RM Hive metastore NM task DN NM task storage API NN: Name Node RM: Resouce Manager DN: Data Node NM: Node Manager 2015 Internet Initiative Japan Inc.

9 2015 Internet Initiative Japan Inc.

10 Hypervisor Hive (UDF )

11 Docker?? Linux Namespaces, Cgroups, Capabilities

12 vs App A App B Bins/Libs Bins/Libs Guest OS Guest OS Hypervisor Host OS Server Hypervisor App A App B Bins/Libs Bins/Libs Docker Engine Host OS Server Docker OS

13 Docker MapReduce HiveQL Docker

14 Docker

15 Docker

16 Docker ( )

18 Container Container Container Docker Container Container Docker Container Container Container Docker Container Container Container

19 Docker Swarm Kubernetes Apache Mesos Fleet Nomad...

20 doma(docker manager)? Docker analysis API

21 doma analysis API HTTP LB(nginx) master API IP etc request / response master DB (MySQL MHA) HTTP HTTP over Unix domain socket slave slave API Docker Remote API Docker daemon query Container docker

22 master ( ) Ruby + Rack + EventMachine

1 1 1 2 3 Docker Container Container Docker Container

23 Docker Container Container Docker Container Container Container Docker Container Container Container

24 master docker CPU IP 1 ( )IP

25 (CPU ) docker

26 slave Docker daemon wrapper master Docker daemon API slave API Go master HTTP over Unix domain socket slave Docker Remote API Docker daemon

27 Docker Remote API HTTP REST JSON docker API Docker client docker pull docker run docker... Docker Remote API HTTP over Unix domain socket TCP Host Docker daemon container container container

28 slave iptables

30 cgroup CPU cpuset memory cgroup

31 CPU (Docker Remote API )cgroup cpuset.cpus CPU : "CpusetCpus":"0-2,7" CPU

32 loopback mount mkfs sparse tar mount( ) 1

34 Docker container network namespace eth0 eth0 (veth) host network namespace vetha vethb docker0 NIC

35 Docker eth0 eth0 eth0 eth0 vetha vethb vetha vethb docker0 docker0 NIC NIC ( EXPOSE Hadoop )

36 pipework weave flannel libnetwork overlay driver...

37 docker ("NetworkDisabled": true) slave

38 docker eth0 eth0 container network namespace eth0 eth0 vetha vethb vetha vethb docker0 host network IP namespace NIC NIC bridge0 host-veth IP host-geth

39 eth0 eth0 host-geth eth0 eth0 host-geth IP master slave

40 iptables CAP_NET_RAW

42 Docker Docker HUB repository :tag (docker 1.6 は Content Addressable Image Identifiers ) OS febootstrap CentOS 6 OS JDK, Hive, Hadoop Dockerfile

43 ( ) fluentd ( ) ( Docker log driver )

44 doma analysis API

45 slave cgroup /proc/net/dev ( cadvisor )

46 コンテナのモニタリング CPU Accounting Network traffic Memory 46

47 OS CentOS 6 Docker 1.8 CentOS 6 Red Hat Docker RHEL 6 OS CoreOS, Project Atomic, Snappy, RancherOS

48 Hadoop/Hive Docker Docker

49 doma(docker manager) Kubernetes, Swarm, Mesos libnetwork, flannel, weave fluentd docker log driver cadvisor CentOS 6 CoreOS, Atomic Host

IIJ Technical WEEK 2013 - アプリ開発を楽にするRuby PaaS「MOGOK」について

IIJ Technical WEEK 2013 - アプリ開発を楽にするRuby PaaS「MOGOK」について Ruby PaaS MOGOK 2013/11/19 1 IIJ PaaS MOGOK MOGOK PaaS 2 IIJ PaaS MOGOK PaaS MOGOK MOGOK 3 IIJ PaaS 4 IIJ Internet, Backbone, Mobile IIJ GIO 5 IIJ IaaS IIJ GIO SaaS PaaS 6 PaaS Platform