P P P P P P P OS... P P P P P P

Size: px

Start display at page:

Download "P P P P P P P OS... P P P P P P"

いちえいだいほうじ
5 years ago
Views:

1 SAS Visual Analytics on MapR Converged Data Platform

2 P P P P P P P OS... P P P P P P P14 1

3 SAS Visual Analytics SASVA MapR Converged Data Platform OS MapR SAS Hadoop SASVA MapR MapR Apache Hadoop SAS Institute Japan 1.2. SASVA SASVA MapR US SASVA 256GB 4 TB 128GB 4 512GB SASVA MapR URL 2

4 2 2.1 SASVA MapR SASVA SASVA MapR 10GB 440GB CSV SAS Hadoop Apache Hadoop MapR 2 ID TEST01 11GB 19,571, CSV UTF8 TEST02 54GB 159,012, CSV UTF8 TEST03 88GB 195,714, CSV UTF8 TEST04 175GB 391,429, CSV UTF8 TEST05 264GB 587,144, CSV UTF8 TEST06 352GB 782,859, CSV UTF8 TEST07 440GB 978,574, CSV UTF8 HDD MapR Apache Hadoop MapR-FS HDD10 MapR RAW MapR MapR-FS HDFS 3 3 XFS HDD10 32TB OS XFS XFS HDFS 2 2 HadoopNameNode Mapr02 Mpar03 Mapr04 3 Apache01 1 3

5 Apache Hadoop MapR 100GB 300GB Apache Hadoop SASVA SASVA MapR Apache Hadoop Hadoop No SIZE, MapR Apache Hadoop TEST01 11GB 00: :58.5 TEST02 54GB 04: :27.5 TEST03 88GB 06: :47.3 TEST04 175GB 13: :45.7 TEST05 264GB 19: :24.6 TEST06 352GB 26:12.8 ApacheHadoop TEST07 440GB 32:27.4 MapR Apache Hadoop 4

6 SASVA 11GB MapR 11GB データ転送 43sec Apache Hadoop 11GB データ転送 58sec 5

7 SASVA MapR MapR CUI MapR MapR SASVA UCS SASVA (MPP: ) HDD 12 OS SAS OS OS Apache Hadoop MapR 100GB 300GB Apache Hadoop SASVA SASVA MapR Apache Hadoop 6

8 SASVA MapR NameNode Master (Mapr03) NFS MapR03 Mapr02/MapR03 Mapr04 Mapr01 MapR MapR01 MapR MapR02 MapR04 Mapr01 Mapr02 Namenode(Sub) Mapr03 Namenode(Mst) Mapr04 Namenode(Sub) A A3 A1 A2 B B2 B3 B1 C C1 C2 C3 SASVA Apache Hadoop NameNode Master Apache01 (Apache01) Apache02 Apache04 Mapr01 Mapr02 Mapr03 Mapr04 A A1 A2 B B2 B1 C C1 C2 NameNode(Mst) A B C 1 3 A B C A1 A2 A3 7

9 TEST03 WorkerNode3 Mapr03 vs Apache03 HDD MapR 1,100,000 Apache Hadoop 250,000 4 TEST03 Mapr03 1,100, ,000 TEST03 Apache03 250, ,000 8

10 TEST02 WorkerNode2 Mapr02 vs Apache02 MapR HDD HDD ApacheHadoop OS TEST02 Mapr02 HDD TEST02 Apache02 HDD MapR 2 9

11 2.3 SASVA No 1 00, DEPOT 3 Hadoop Hadoop /MapR NFS 4 5 SASVA HighPerformanceAnalytics FTP NFS SAMBA MapR 2 Apache Hadoop 100GB Apache Hadoop 2 MapR 3 MapR 2 NameNode Apache Hadoop 1 MapR NameNode 3 2 SASVA MapR Apache Hadoop 10

12 OS MapR Apache Hadoop MapR Apache Hadoop MapR 検証用環境 Mapr01 Mapr02 Mapr03 Mapr04 Xeon2.0GHz 2 HDD SAS 4TB 12 (64Bit) (64Bit) (64Bit) (64Bit) 10Gb 検証用外部データ検証用 PC Intel i5 4Core Memory 8GB HDD 1TB Windows 7(64Bit) 1Gb 10Gb Switch 10Gb Lux01 (64Bit) 10Gb Apache01 Apache02 Apache03 Apache04 (64Bit) (64Bit) (64Bit) (64Bit) Apache Hadoop 検証用環境 11

13 3.2 SASVA Mapr MaprM5 Mapr02 Mapr04 NameNode NFS Mapr01 Mapr SAS MapR 検証用 Software 環境 Mapr01 SASVA 7.3 Mapr02 Mapr03 Mapr04 SAS9.4 BASE SAS LASR Moniter SAS LASR Server SAS LASR Server SAS LASR Server Mapr Client Mapr M5(NN,NFS) Mapr M5 (NN, NFS) Mapr M5(NN, NFS) SASVA ApacheHadoop HDFS HDFS Apache01 NameNode SAS Apache 検証用 Software 環境 Apache01 SASVA 7.3 Apache02 Apache03 Apache04 SAS9.4 BASE SAS LASR Moniter SAS LASR Server SAS LASR Server SAS LASR Server Apache Namenode Apache HDFS Apache HDFS Apache HDFS 12

14 3.3 No IP CPU OS 1 Mapr01 UCS Server Xeon E GHz x 2 128GB MapR 2 Mapr02 UCS Server Xeon E GHz x 2 128GB MapR #1 3 Mapr03 UCS Server Xeon E GHz x 2 128GB MapR #2 4 Mapr04 UCS Server Xeon E GHz x 2 128GB MapR #3 5 Apache01 UCS Server Xeon E GHz x 2 128GB ApacheHadoop 6 Apache02 UCS Server Xeon E GHz x 2 128GB ApacheHadoop #1 7 Apache03 UCS Server Xeon E GHz x 2 128GB ApacheHadoop #2 8 Apache04 UCS Server Xeon E GHz x 2 128GB ApacheHadoop #3 9 Lux01 UCS Server Xeon E GHz x 2 128GB 10 Vmx01 UCS Server Xeon E GHz x 2 128GB VMware Windows 2 NIC No 1 Cisco UCS 6248UP No Build 1 SAS VisualAnalytics 7.3 SAS9.4 TS1M3 15W30 No Build 1 RedHat Enterprise Linux No Build 1 MapR M No Build 1 Apache Hadoop

15 3.5 No Patch 1 SAS Institute Japan Management Colsole 9.3 C:\Program files\sashome 2 Microsoft Intenet Exproler 10 C:\Program files 3.6 No Patch 1 Microsoft Intenet Exproler 10 C:\Program files Adobe Flash 11 C:\Program files 3.7 MapR No 1 Mapr01 Sashpcmc /opt/webmin 2 Mapr01 Mapr04 MapR /MapR HADOOP 3 Mapr01 Mapr04 LASRMonitor /opt/tkgrid Grid 4 Mapr01 Mapr04 IRStudio 5 Mapr01 Mapr04 SASDeploymentAgent /opt/sas/sasconfig/ Lev1/Applications /opt/sas/sashome/ SASDeploymentAgent 6 Mapr01 Mapr04 SAS Server /opt/sas/sasconfig/lev1 ApacheHadoop No 1 Apache01 sashpcmc /opt/webmin 2 Apache01 Apache04 Hadoop /hadoop HADOOP 3 Apache01 Apache04 LASRMonitor /opt/tkgrid Grid 4 Apache01 IRStudio 5 Apache01 SASDeploymentAgent /opt/sas/sasconfig/ Lev1/Applications /opt/sas/sashome/ SASDeploymentAgent 6 Apache01 SAS Server /opt/sas/sasconfig/lev1 14

HPE Moonshot System　～ビッグデータ分析＆モバイルワークプレイスを新たなステージへ～

HPE Moonshot System　～ビッグデータ分析＆モバイルワークプレイスを新たなステージへ～ Brochure HPE Moonshot System HPE Moonshot System 4.3U 45 HPE Moonshot System Xeon & HPE Moonshot System HPE Moonshot System HPE HPE Moonshot System &IoT & SoC Xeon D-1500 Broadwell-DE HPE ProLiant m510