Clos IP Fabrics with QFX5100 Switches

Size: px

Start display at page:

Download "Clos IP Fabrics with QFX5100 Switches"

れいがあんさい
5 years ago
Views:

2 IP x x 10 GbE IP BGP IBGP...10 EBGP BGP...12 BGP IP...13 BGP...13 BGP...14 ECMP...16 BGP...16 BGP...16 BGP Ping...19 Traceroute S L / x 10 GbE x 10 GbE IP IP EBGP IP IBGP IBGP EBGP BGP AS IP IP BGP Copyright 2014, Juniper Networks, Inc.

3 QFX5100 IP Clos IP QFX5100 Clos IP Clos IP IP Clos IP IP OTT Over The Top IP 3 IP 2 IP IP IP 1?? 1 2 VM 2 3 IT 3 VLAN 1,670 Contrail VMware NSX MAC VTEP MAC VM VTEP MAC VM MAC 100% 80% 20% 1 VTEP Copyright 2014, Juniper Networks, Inc. 3

4 コントローラスイッチスイッチWHITEPAPER QFX5100 Clos IP 物理サーバー SDN VTEP スイッチサーバーサーバー VTEP IP ファブリック VTEP ハイパーバイザハイパーバイザ VM VM VM VM VTEP から VTEP へのトンネル VM からの物理的なデータフロー SDN コントロールプレーン 1 1 IP VTEP VTEP MAC IP VTEP MAC VTEP IP IP 2 3 OTT IP IP VTEP VM MAC VTEP Copyright 2014, Juniper Networks, Inc.

6 768 x 10 1 QFX IP 4 Junos バーチャルシャーシファブリック 32 x 40 GbE S1 S2 S3 S4 L1 L2 L15 L16 48 x 10 GbE 768 x 10 GbE スパイン = QFX Q リーフ = QFX S x 10 GbE 4 QFX Q 32 x 40 GbE 48 x 10 GbE 6 x 40 GbE QFX S 4 4 x 40 GbE x 10 GbE x 10 GbE 3 IP 3072 x 10 GbE IP QFX Q QFX S 3 IP QFX S 32 x 40 GbE QFX S 96 x 10 GbE 8 x 40 GbE 5 QFX Q QFX S 3072 x 10 GbE IP 6 Copyright 2014, Juniper Networks, Inc.

7 3072 x 10 GbE 32 x 40 GbE S1 S2 S7 S8 L1 L2 L31 L32 96 x 10 GbE スパイン = QFX Q リーフ = QFX S 3072 x 10 GbE x 10 GbE IP QFX S 8 x 40 GbE GbE 1 40 GbE IP GbE GbE IP IP 1 IP IP IP IP 1 1 IP OSPF IS-IS BGP IP OSPF IS-IS BGP OSPF IS-IS SPF BGP Copyright 2014, Juniper Networks, Inc. 7

8 IP OSPF IS-IS BGP MED IP 1 1 IP OSPF IS-IS BGP BGP IP BGP IP BGP BGP 1 IBGP EBGP IP ECMP 1 ECMP EBGP ECMP IBGP ECMP BGP AddPath IP EBGP 6 AS IP ASN 1 ASN 2 EGBP ASN 3 ASN 4 ASN 5 ASN 6 6 IP EBGP IP EBGP EBGP AS IBGP IP IP IBGP IP 7 BGP BGP ECMP ECMP BGP AddPath BGP ECMP 単一 ASN IBGP スパイン BGP RR スパイン BGP RR リーフリーフリーフリーフ 7 IP IBGP 8 Copyright 2014, Juniper Networks, Inc.

9 QFX5100 IBGP EBGP BGP EBGP 3 IP EBGP BGP AddPath IP IP IPAM BGP IP IP IP IP IP IP IP IP IP IP IP IP IP IP VTEP 3 IP IP IP IP IP IP / /24 2 IP /24 IP 32 BGP AS IP AS BGP AS EBGP BGP IP IP IP BGP IP 4 4 ECMP IP IP IP 1 IBGP EBGP ASN 2 1 JNCIE CCIE IBGP EBGP IBGP EBGP IBGP IBGP IBGP BGP EBGP BGP BGP AS Copyright 2014, Juniper Networks, Inc. 9

10 IBGP IP IBGP IBGP BGP IP BGP BGP S1 RR S2 RR L1 クライアント L2 クライアント L3 クライアント L4 クライアント 8 IBGP 8 BGP L1 L4 BGP IBGP BGP QFX5100 BGP IBGP ECMP BGP 4 ECMP 1 ECMP BGP IETF draft-ietf-idr-add-paths BGP AddPath ECMP IBGP IP BGP Add Path QFX5100 BGP Add Path BGP IP BGP BGP Add Path IBGP IBGP IP 1 AS EBGP 1 EBGP IP EGBP IP 9 EGBP BGP BGP Add Path AS 100 AS 101 AS 200 AS 201 L3 202 L EBGP BGP AS 10 Copyright 2014, Juniper Networks, Inc.

11 IP BGP AS BGP AS BGP 64,512 65, BGP AS IP 1023 BGP AS 32 AS EBGP IP 1 10 ASN 701 ASN 174 ASN 65,512 ASN 209 ASN 701 ISP1 ISP2 MPLS ISP3 ISP4 ASN 21,870 エッジエッジエッジエッジ ASN 14,203 AS 100 AS /18 AS AS / AS 200 AS 201 L3 202 L4 204 AS 200 AS 201 L3 202 L4 204 IP ファブリックデータセンター 1 IP ファブリックデータセンター 2 10 IP 2 BGP AS IP BGP AS 2 2 ISP MPLS EBGP AS MPLS AS 200 BGP BGP AS AS MPLS PE AS 21, /18 AS 14, / /18 BGP AS 65,512 14,203 IP 1 BGP BGP Copyright 2014, Juniper Networks, Inc. 11

12 IP 0/0 ISP IP IP ISP IP BGP IP IP? BGP?? BGP Junos OS S /32 S / / / / /31.1 L / / / L / L /32 L3 ゲートウェイ /24 L3 ゲートウェイ /24 11 IP BGP L3 ゲートウェイ /24 10/ / IP /24 BGP IP L3 BGP AS 2 12 Copyright 2014, Juniper Networks, Inc.

13 2 BGP L3 BGP AS S /32 None 100 S /32 None 101 L / / L / / L / / IP 3 IP 3 IP IP L1 xe-0/0/ /31 S1 xe-0/0/14.0 L1 xe-0/0/ /31 S2 xe-0/0/15.6 L2 xe-0/0/ /31 S1 xe-0/0/16.2 L2 xe-0/0/ /31 S2 xe-0/0/17.8 L3 xe-0/0/ /31 S1 xe-0/0/18.10 L3 xe-0/0/ /31 S2 xe-0/0/19.0 IP IP 1 1 IP IP 1 BGP 1 EBGP Junos OS BGP 1 BGP AS IP S1 BGP protocols { bgp { log-updown; import bgp-clos-in; export bgp-clos-out; graceful-restart; group CLOS { type external; mtu-discovery; bfd-liveness-detection { minimum-interval 350; multiplier 3; session-mode single-hop; multipath multiple-as; neighbor { peer-as 200; neighbor { peer-as 201; Copyright 2014, Juniper Networks, Inc. 13

14 neighbor { peer-as 202; IP AS IP CLOS 1 BGP BGP log-updown BGP IP IP graceful-restart BGP Junos OS graceful-restart CLOS BGP 1 type external EBGP BGP IP EBGP mtu-discovery BGP MTU BFD BFD multipath multiple-as ECMP EBGP multipath multiple-as BGP IP BGP BGP BGP policy-options { policy-statement bgp-clos-out { term loopback { from { protocol direct; route-filter /24 orlonger; then { next-hop self; accept; term server-l3-gw { from { protocol direct; route-filter /12 orlonger; then { next-hop self; 14 Copyright 2014, Juniper Networks, Inc.

15 accept; term loopback BGP 10/24 IP IP next-hop self IP IP term server-l3-gw /12 next-hop self 1 BGP EBGP EBGP IBGP BGP reject IP BGP policy-options { policy-statement bgp-clos-in { term loopbacks { from { route-filter /24 orlonger; then accept; term server-l3-gw { from { route-filter /12 orlonger; then accept; term reject { then reject; term loopbacks IP 10/8 term server-l3-gw 3 IP /12 term reject reject 3 IP IP Copyright 2014, Juniper Networks, Inc. 15

16 ECMP multipath multiple-as ECMP RIB RIB ECMP FIB ECMP FIB routing-options { forwarding-table { export PFE-LB; policy-options { policy-statement PFE-LB { then { load-balance per-packet; FIB ECMP PFE-LB PFE-LB FIB PFE-LB BGP IP Show IP BGP BGP S1 BGP dhanks@s1> show bgp summary Groups: 1 Peers: 3 Down peers: 0 Table Tot Paths Act Paths Suppressed History Damp State Pending inet Peer AS InPkt OutPkt OutQ Flaps Last Up/Dwn State #Active/Received/Accepted/Damped d 21:11:35 2/2/2/0 0/0/0/ d 21:11:35 2/2/2/0 0/0/0/ d 21:11:35 2/2/2/0 0/0/0/0 BGP 2 active received accepted 3 ECMP BFD dhanks@s1> show bgp neighbor Peer: AS 200 Local: AS 100 Type: External State: Established Flags: <Sync> Last State: OpenConfirm Last Event: RecvKeepAlive Last Error: Cease 16 Copyright 2014, Juniper Networks, Inc.

17 Export: [ bgp-clos-out ] Import: [ bgp-clos-in ] Options: <Preference LogUpDown PeerAS Multipath Refresh> Options: <MtuDiscovery MultipathAs BfdEnabled> Holdtime: 90 Preference: 170 Number of flaps: 3 Last flap event: Stop Error: Cease Sent: 1 Recv: 1 Peer ID: Local ID: Active Holdtime: 90 Keepalive Interval: 30 Group index: 1 Peer index: 0 BFD: enabled, up Local Interface: xe-0/0/14.0 NLRI for restart configured on peer: inet-unicast NLRI advertised by peer: inet-unicast NLRI for this session: inet-unicast Peer supports Refresh capability (2) Stale routes from peer are kept for: 300 Peer does not support Restarter functionality NLRI that restart is negotiated for: inet-unicast NLRI of received end-of-rib markers: inet-unicast NLRI of all end-of-rib markers sent: inet-unicast Peer supports 4 byte AS extension (peer-as 200) Peer does not support Addpath Table inet.0 Bit: RIB State: BGP restart is complete Send state: in sync Active prefixes: 2 Received prefixes: 2 Accepted prefixes: 2 Suppressed due to damping: 0 Advertised prefixes: 3 Last traffic (seconds): Received 1 Sent 25 Checked 42 Input messages: Total 12381Updates 3Refreshes 0Octets Output messages: Total 12334Updates 7Refreshes 0Octets Output Queue[0]: 0 2 BGP ECMP MTU BFD BGP BGP BGP BGP S1 L1 dhanks@s1> show route advertising-protocol bgp extensive inet.0: 53 destinations, 53 routes (52 active, 0 holddown, 1 hidden) * /32 (1 entry, 1 announced) BGP group CLOS type External Nexthop: Self Flags: Nexthop Change AS path: [100] I * /32 (1 entry, 1 announced) Copyright 2014, Juniper Networks, Inc. 17

18 BGP group CLOS type External Nexthop: Self (rib-out ) AS path: [100] 201 I * /32 (1 entry, 1 announced) BGP group CLOS type External Nexthop: Self (rib-out ) AS path: [100] 202 I * /24 (1 entry, 1 announced) BGP group CLOS type External Nexthop: Self (rib-out ) AS path: [100] 201 I * /24 (1 entry, 1 announced) BGP group CLOS type External Nexthop: Self (rib-out ) AS path: [100] 202 I S1 5 L /32 S1 L /32 L2 L1 AS [100] 201 I AS L /32 L3 L /24 L2 3 L /24 L3 3 L1 dhanks@s1> show route receive-protocol bgp inet.0: 53 destinations, 53 routes (52 active, 0 holddown, 1 hidden) Prefix Nexthop MED Lclpref AS path * / I * / I dhanks@s1> show route receive-protocol bgp inet.0: 53 destinations, 53 routes (52 active, 0 holddown, 1 hidden) Prefix Nexthop MED Lclpref AS path * / I * / I dhanks@s1> show route receive-protocol bgp inet.0: 53 destinations, 53 routes (52 active, 0 holddown, 1 hidden) Prefix Nexthop MED Lclpref AS path * / I * / I 3 18 Copyright 2014, Juniper Networks, Inc.

19 RIB L1 L3 ECMP show route /24 exact inet.0: 54 destinations, 58 routes (53 active, 0 holddown, 1 hidden) + = Active Route, - = Last Active, * = Both /24 *[BGP/170] 3d 10:55:14, localpref 100, from AS path: I > to via xe-0/0/14.0 to via xe-0/0/15.0 [BGP/170] 3d 10:55:14, localpref 100 AS path: I > to via xe-0/0/14.0 L1 L3 2 multipath multiple-as BGP RIB L1 L3 dhanks@l1> show route forwarding-table destination Routing table: default.inet Internet: Destination Type RtRef Next hop Type Index NhRef Netif /24 user 0 ulst ucst xe-0/0/ ucst xe-0/0/15.0 S1 (xe-0/0/14) S2 (xe-0/0/15) 2 Ping L1 2 ping source L3 ping dhanks@l1> ping source count 5 PING ( ): 56 data bytes 64 bytes from : icmp_seq=0 ttl=63 time=3.009 ms 64 bytes from : icmp_seq=1 ttl=63 time=2.163 ms 64 bytes from : icmp_seq=2 ttl=63 time=2.243 ms 64 bytes from : icmp_seq=3 ttl=63 time=2.302 ms 64 bytes from : icmp_seq=4 ttl=63 time=1.723 ms ping statistics packets transmitted, 5 packets received, 0% packet loss round-trip min/avg/max/stddev = 1.723/2.288/3.009/0.414 ms 3 ping source L3 L1 Copyright 2014, Juniper Networks, Inc. 19

20 Traceroute traceroute IP traceroute source traceroute to ( ) from , 30 hops max, 40 byte packets http://bb06-cclab-lo0.spglab.juniper.net/ ( ) ms ms ( ) ms ( ) ms ms ms traceroute S2 L3 L1 traceroute IP 1 S1 interfaces { xe-0/0/14 { mtu 9216; unit 0 { family inet { mtu 9000; address /31; xe-0/0/16 { mtu 9216; unit 0 { family inet { mtu 9000; address /31; xe-0/0/18 { mtu 9216; unit 0 { family inet { mtu 9000; address /31; lo0 { unit 0 { family inet { address /32; routing-options { router-id ; autonomous-system 100; forwarding-table { 20 Copyright 2014, Juniper Networks, Inc.

21 export PFE-LB; protocols { bgp { log-updown; import bgp-clos-in; export bgp-clos-out; graceful-restart; group CLOS { type external; mtu-discovery; bfd-liveness-detection { minimum-interval 350; multiplier 3; session-mode single-hop; multipath multiple-as; neighbor { peer-as 200; neighbor { peer-as 201; neighbor { peer-as 202; policy-options { policy-statement PFE-LB { then { load-balance per-packet; policy-statement bgp-clos-in { term loopbacks { from { route-filter /24 orlonger; then accept; term server-l3-gw { from { route-filter /12 orlonger; then accept; term reject { then reject; policy-statement bgp-clos-out { term loopback { from { protocol direct; route-filter /24 orlonger; then { next-hop self; Copyright 2014, Juniper Networks, Inc. 21

22 accept; term server-l3-gw { from { protocol direct; route-filter /12 orlonger; then { next-hop self; accept; L1 interfaces { interface-range ALL-SERVER { member-range xe-0/0/0 to xe-0/0/13; member-range xe-0/0/16 to xe-0/0/47; unit 0 { family ethernet-switching { interface-mode access; vlan { members SERVER; xe-0/0/14 { mtu 9216; unit 0 { family inet { mtu 9000; address /31; xe-0/0/15 { mtu 9216; unit 0 { family inet { mtu 9000; address /31; lo0 { unit 0 { family inet { address /32; irb mtu 9216; unit 1 { 22 Copyright 2014, Juniper Networks, Inc.

23 family inet { mtu 9000; address /24; routing-options { router-id ; autonomous-system 200; forwarding-table { export PFE-LB; protocols { bgp { log-updown; import bgp-clos-in; export bgp-clos-out; graceful-restart; group CLOS { type external; mtu-discovery; bfd-liveness-detection { minimum-interval 350; multiplier 3; session-mode single-hop; multipath multiple-as; neighbor { peer-as 100; neighbor { peer-as 101; policy-options { policy-statement PFE-LB { then { load-balance per-packet; policy-statement bgp-clos-in { term loopbacks { from { route-filter /24 orlonger; then accept; term server-l3-gw { from { route-filter /12 orlonger; then accept; term reject { then reject; Copyright 2014, Juniper Networks, Inc. 23

24 policy-statement bgp-clos-out { term loopback { from { protocol direct; route-filter /24 orlonger; then { next-hop self; accept; term server-l3-gw { from { protocol direct; route-filter /12 orlonger; then { next-hop self; accept; term reject { then reject; vlans { SERVER { vlan-id 1; l3-interface irb.1; IP IP IP BGP IP BGP BGP IP IP VMware NSX Contrail 3 IP BFD IP QFX Juniper Networks Technical Library The QFX Series Technical Library 24 Copyright 2014, Juniper Networks, Inc.

25 F FAX URL Juniper Networks, Inc North Mathilda Avenue Sunnyvale, CA USA 888-JUNIPER FAX URL Juniper Networks International B.V. Boeing Avenue PZ Schiphol-Rijk Amsterdam, The Netherlands FAX Copyright 2014 Juniper Networks, Inc. All rights reserved. Juniper Networks Junos NetScreen Screen OS Juniper Networks Juniper Networks, Inc JP Copyright 2014, Juniper Networks, Inc. 25

PowerPoint プレゼンテーション

PowerPoint プレゼンテーション ADD-PATH の基本的な設定例と検討課題インターネットマルチフィード ( 株 ) 技術部 Interop tokyo 2013 NOC 金井瑛 1 Interop Tokyo 2013 と ADD-PATH 今年度の Interop Tokyo 2013 では ADD-PATH の相互接続検証を行いました MX80, MX480, CRS-X, ASR9006