一、业务影响
托管机房全部是物理机器,跑的全部是hadoop集群居多,当时大二层架构,使用级联架构,到第五个交换机时,后面接入新添datanode节点时,第五个级联口千兆口已经达到了峰值,根本无法工作起来。
二、服务器群集hadoop平台,实现平台海量的数据交互。改造思路如下:
1.网络可用性和弹性。要部署一个高冗余性和可扩展的网络,支持Hadoop 集群的增长。在Datanode之间部署多条链路的技术要比那些有单点失效或两点失效的技术要好。交换机和路由器已经在业界被证明能够为服务器提供网络可用性。
2. Burst 流量突发处理和队列深度。HDFS 的有些操作和MapReduce Job 会产生突发流量,如向HDFS加载文件或者把结果文件写入HDFS 都需要通过网络。网络如果处理不了突发流量,就会丢弃数据包,所以适当的缓存可以缓解突发流量的影响。确保选择使用缓存和队列的交换机和路由器,来有效处理流量突发。hadoop应用群集 3. 网络过载比。一个好的网络设计需要考虑到网络中关键节点的拥塞情况。一个ToR 交换机从服务器接收20Gbps 的数据,但是只有2 个1Gbps 的上联口会造成数据包丢失(10:1 的过载比),严重影响集群的性能。过度配置的网络的价格又非常昂贵。一般情况下,服务器接入层可以接受的过载比在4:1 左右,接入层和汇聚层之间,或者核心层的过载比在2:1左右。 4. Datanode 网络接入。要基于集群工作负荷来推荐带宽配置。一般集群中的节点有1 到2 根1GB 的上联口。是否选择10Gbps 的服务器要权衡价格和性能。 5. 网络延迟。交换机和路由器延迟的变化对集群性能的影响有限。相比网络延迟,应用层延迟对任务的影响比例更大。但是网络的延迟会对应用系统造成潜在的影响,例如造成不必要的应用切换等。
三、拓扑图
注:此拓扑图针对我们的现有环境,由于服务器较多,画的一个简易的拓扑图服务器通过内网线、外网线直接连接至核心交换机S7006设备,然后再通过连接至交换机的公网线路跟外网进行数据交换机。
四、7503E-A设备配置
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
| [S7006-A]
#
sysname S7006-A//设备命名名称
#
domain default enable system
#
telnet server enable
#
switch-modestandard
switch-mode normalslot 2//显示交换机板卡模式状态正常模式
switch-mode normalslot 3
switch-mode normalslot 4
#
switch-mode route-normal
#
password-recovery enable
#
vlan 1
#
l2vpn
#
domain system
access-limit disable
state active
idle-cut disable
self-service-url disable
#
user-group system
group-attribute allow-guest
#
|
2.开启telnet,并设置密码
1
2
3
4
5
| local-user admin //设备远程Telnet管理的用户名
password cipher$c$3$HB052PWptl1QmbzwY5QQGOBPFgOtTSlPlkKh //设备远程Telnet管理的密码,命令行显示以加密形式显示,以防安全。
authorization-attribute level 3 //显示用户身份等级,此处为最高
service-type telnet terminal //开启telnet操作服务
#
|
3.配置trunk口
1
2
3
| interfaceBridge-Aggregation1 //聚合端口
port link-type trunk //端口设置成trunk
port trunk permit vlan all //允许端口所有vlan通过
|
4.NULL0主要用于防止路由环路或用于过滤数据包
NULL0是属于路由器的逻辑接口,NULL0接口总是处于Up状态,但不转发任何报文。当NULL0接口接收到报文后,会把报文丢弃。不能在NULL0接口上配置IP地址,也不能在NULL0接口上封装任何链路层协议
1
| interface NULL0 //进入该视图后,配置Null 0接口的相关属性
|
5.配置虚拟接口
1
2
| interfaceVlan-interface1 //VLAN1虚拟接口
ip address 192.168.1.252 255.255.255.0 //设备接口管理地址
|
6.配置互联端口
1
2
3
4
5
| interfaceGigabitEthernet2/0/1 //与B设备互联端口
port link-mode bridge
port link-type trunk
port trunk permit vlan all
port link-aggregation group 1 //将端口加入聚合组1
|
7.设置以太网端口G2/0/2的链路类型为trunk
1
2
3
4
5
| interfaceGigabitEthernet2/0/2
port link-mode bridge
port link-type trunk
port trunk permit vlan all //将Trunk端口加入到指定的VLAN。undo port trunk permit vlan命令用来将Trunk端口从指定的VLAN中删除。Trunk端口可以属于多个VLAN。如果多次使用port trunk permit vlan命令,那么Trunk端口上允许通过的VLAN是这些vlan-id-list的集合。
port link-aggregation group 1
|
8.把其他物理端口,设为桥接模式,表示二层接口
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
| interfaceGigabitEthernet2/0/3
port link-mode bridge //物理端口的模式为桥模式,表示二层接口
#
interfaceGigabitEthernet2/0/4
port link-mode bridge
#
interfaceGigabitEthernet2/0/5
port link-mode bridge
#
interfaceGigabitEthernet2/0/6
port link-mode bridge
#
interfaceGigabitEthernet2/0/7
port link-mode bridge
#
interface GigabitEthernet2/0/8
port link-mode bridge
#
interfaceGigabitEthernet2/0/9
port link-mode bridge
#
interfaceGigabitEthernet2/0/10
port link-mode bridge
#
interfaceGigabitEthernet2/0/11
port link-mode bridge
#
interfaceGigabitEthernet2/0/12
port link-mode bridge
#
interfaceGigabitEthernet2/0/13
port link-mode bridge
#
interfaceGigabitEthernet2/0/14
port link-mode bridge
#
interfaceGigabitEthernet2/0/15
port link-mode bridge
#
interfaceGigabitEthernet2/0/16
port link-mode bridge
#
interface GigabitEthernet2/0/17
port link-mode bridge
shutdown
#
interfaceGigabitEthernet2/0/18
port link-mode bridge
shutdown
#
interfaceGigabitEthernet2/0/19
port link-mode bridge
shutdown
#
interfaceGigabitEthernet2/0/20
port link-mode bridge
#
interface GigabitEthernet2/0/21
port link-mode bridge
#
interfaceGigabitEthernet2/0/22
port link-mode bridge
#
interfaceGigabitEthernet2/0/23
port link-mode bridge
shutdown
#
interfaceGigabitEthernet2/0/24
port link-mode bridge
shutdown
#
interfaceGigabitEthernet2/0/25
port link-mode bridge
port link-type trunk
port trunk permit vlan all
port link-aggregation group 1
#
interfaceGigabitEthernet2/0/26
port link-mode bridge
port link-type trunk
port trunk permit vlan all
port link-aggregation group 1
#
interfaceGigabitEthernet2/0/27
port link-mode bridge
port access vlan 23
#
interfaceGigabitEthernet2/0/28
port link-mode bridge
shutdown
#
interfaceGigabitEthernet2/0/29
port link-mode bridge
shutdown
#
interfaceGigabitEthernet2/0/30
port link-mode bridge
shutdown
#
interfaceGigabitEthernet2/0/31
port link-mode bridge
#
interfaceGigabitEthernet2/0/32
port link-mode bridge
port access vlan 23
shutdown
#
interfaceGigabitEthernet3/0/1
port link-mode bridge
#
interfaceGigabitEthernet3/0/2
port link-mode bridge
#
interfaceGigabitEthernet3/0/3
port link-mode bridge
#
interfaceGigabitEthernet3/0/4
port link-mode bridge
#
interfaceGigabitEthernet3/0/5
port link-mode bridge
#
interfaceGigabitEthernet3/0/6
port link-mode bridge
#
interfaceGigabitEthernet3/0/7
port link-mode bridge
#
interfaceGigabitEthernet3/0/8
port link-mode bridge
#
interfaceGigabitEthernet3/0/9
port link-mode bridge
#
interfaceGigabitEthernet3/0/10
port link-mode bridge
#
interfaceGigabitEthernet3/0/11
port link-mode bridge
#
interfaceGigabitEthernet3/0/12
port link-mode bridge
#
interfaceGigabitEthernet3/0/13
port link-mode bridge
#
interfaceGigabitEthernet3/0/14
port link-mode bridge
#
interfaceGigabitEthernet3/0/15
port link-mode bridge
#
interface GigabitEthernet3/0/16
port link-mode bridge
#
interfaceGigabitEthernet3/0/17
port link-mode bridge
#
interfaceGigabitEthernet3/0/18
port link-mode bridge
#
interfaceGigabitEthernet3/0/19
port link-mode bridge
#
interfaceGigabitEthernet3/0/20
port link-mode bridge
#
interfaceGigabitEthernet3/0/21
port link-mode bridge
#
interfaceGigabitEthernet3/0/22
port link-mode bridge
#
interfaceGigabitEthernet3/0/23
port link-mode bridge
#
interfaceGigabitEthernet3/0/24
port link-mode bridge
#
interfaceGigabitEthernet3/0/25
port link-mode bridge
#
interfaceGigabitEthernet3/0/26
port link-mode bridge
#
interfaceGigabitEthernet3/0/27
port link-mode bridge
#
interfaceGigabitEthernet3/0/28
port link-mode bridge
#
interfaceGigabitEthernet3/0/29
port link-mode bridge
#
interfaceGigabitEthernet3/0/30
port link-mode bridge
#
interfaceGigabitEthernet3/0/31
port link-mode bridge
#
interfaceGigabitEthernet3/0/32
port link-mode bridge
#
interfaceGigabitEthernet3/0/33
port link-mode bridge
#
interfaceGigabitEthernet3/0/34
port link-mode bridge
#
interfaceGigabitEthernet3/0/35
port link-mode bridge
#
interfaceGigabitEthernet3/0/36
port link-mode bridge
#
interfaceGigabitEthernet3/0/37
port link-mode bridge
#
interfaceGigabitEthernet3/0/38
port link-mode bridge
#
interfaceGigabitEthernet3/0/39
port link-mode bridge
#
interfaceGigabitEthernet3/0/40
port link-mode bridge
#
interfaceGigabitEthernet3/0/41
port link-mode bridge
#
interfaceGigabitEthernet3/0/42
port link-mode bridge
#
interfaceGigabitEthernet3/0/43
port link-mode bridge
#
interfaceGigabitEthernet3/0/44
port link-mode bridge
#
interfaceGigabitEthernet3/0/45
port link-mode bridge
#
interfaceGigabitEthernet3/0/46
port link-mode bridge
#
interfaceGigabitEthernet3/0/47
port link-mode bridge
#
interfaceGigabitEthernet3/0/48
port link-mode bridge
#
interfaceGigabitEthernet4/0/1
port link-mode bridge
#
interfaceGigabitEthernet4/0/2
port link-mode bridge
#
interfaceGigabitEthernet4/0/3
port link-mode bridge
#
interfaceGigabitEthernet4/0/4
port link-mode bridge
#
interfaceGigabitEthernet4/0/5
port link-mode bridge
#
interfaceGigabitEthernet4/0/6
port link-mode bridge
#
interfaceGigabitEthernet4/0/7
port link-mode bridge
#
interface GigabitEthernet4/0/8
port link-mode bridge
#
interfaceGigabitEthernet4/0/9
port link-mode bridge
#
interfaceGigabitEthernet4/0/10
port link-mode bridge
#
interfaceGigabitEthernet4/0/11
port link-mode bridge
#
interfaceGigabitEthernet4/0/12
port link-mode bridge
#
interfaceGigabitEthernet4/0/13
port link-mode bridge
#
interfaceGigabitEthernet4/0/14
port link-mode bridge
#
interfaceGigabitEthernet4/0/15
port link-mode bridge
#
interfaceGigabitEthernet4/0/16
port link-mode bridge
#
interface GigabitEthernet4/0/17
port link-mode bridge
#
interfaceGigabitEthernet4/0/18
port link-mode bridge
#
interfaceGigabitEthernet4/0/19
port link-mode bridge
#
interfaceGigabitEthernet4/0/20
port link-mode bridge
#
interfaceGigabitEthernet4/0/21
port link-mode bridge
#
interfaceGigabitEthernet4/0/22
port link-mode bridge
#
interfaceGigabitEthernet4/0/23
port link-mode bridge
#
interfaceGigabitEthernet4/0/24
port link-mode bridge
#
interfaceGigabitEthernet4/0/25
port link-mode bridge
#
interfaceGigabitEthernet4/0/26
port link-mode bridge
#
interfaceGigabitEthernet4/0/27
port link-mode bridge
#
interfaceGigabitEthernet4/0/28
port link-mode bridge
#
interfaceGigabitEthernet4/0/29
port link-mode bridge
#
interfaceGigabitEthernet4/0/30
port link-mode bridge
#
interfaceGigabitEthernet4/0/31
port link-mode bridge
#
interfaceGigabitEthernet4/0/32
port link-mode bridge
#
interfaceGigabitEthernet4/0/33
port link-mode bridge
#
interfaceGigabitEthernet4/0/34
port link-mode bridge
#
interfaceGigabitEthernet4/0/35
port link-mode bridge
#
interfaceGigabitEthernet4/0/36
port link-mode bridge
#
interfaceGigabitEthernet4/0/37
port link-mode bridge
#
interfaceGigabitEthernet4/0/38
port link-mode bridge
#
interfaceGigabitEthernet4/0/39
port link-mode bridge
#
interfaceGigabitEthernet4/0/40
port link-mode bridge
#
interfaceGigabitEthernet4/0/41
port link-mode bridge
#
interfaceGigabitEthernet4/0/42
port link-mode bridge
#
interfaceGigabitEthernet4/0/43
port link-mode bridge
#
interfaceGigabitEthernet4/0/44
port link-mode bridge
#
interfaceGigabitEthernet4/0/45
port link-mode bridge
#
interfaceGigabitEthernet4/0/46
port link-mode bridge
#
interfaceGigabitEthernet4/0/47
port link-mode bridge
#
interfaceGigabitEthernet4/0/48
port link-mode bridge
|
9.设置静态路由(注意了,这个如果你虚拟子网IP是公网的,这个就可以设置一下,由于我这里配的内网IP,来连接登录的,所以没必要,但可以写出来这个配置)
1
2
3
| interfaceM-Ethernet0/0/0
#
ip route-static 0.0.0.0 0.0.0.0119.147.212.241//静态路由,下一跳为外网地址
|
10.关闭文件日志特性
1
| undo info-center logfile enable
|
11.开启snmp
1
2
3
4
| snmp-agent //开启设备的snmp
snmp-agent local-engineid800063A2033897D64ECAAF
snmp-agent community write hdcx //设置snmp wirte关键字为hdcx
snmp-agent sys-info version v3 //设置snmp版本为version3
|
12.加载网页配置
1
| load tr069-configuration
|
13.设置Telnet管理接口认证
1
2
3
4
| user-interface aux0 1
user-interface vty0 4//设置Telnet管理接口认证为scheme模式
authentication-mode scheme
user-interface vty5 15
|
14.退回系统视图
五、由于用户特殊的业务环境,数据包的流量较大,通过此命令关闭设备对相应数据包的限制,实现用户的网络更好的数据交换,具体的调试步骤如下。
步骤一、进入diag配置模式
步骤二、关闭硬件ICMP限制
1
2
3
4
5
6
7
8
9
10
| [S7006-B-diagnose]debug rxtx rxacl globaldisable icmp 0
Disable Protocol Pkt : ICMP for Global Ret = 13
[S7006-B-diagnose]debug rxtx rxacl globaldisable icmp 1
Disable Protocol Pkt : ICMP for Global Ret = 13
[S7006-B-diagnose]debug rxtx rxacl globaldisable icmp 2
Disable Protocol Pkt : ICMP for Global Ret = 13
[S7006-B-diagnose]debug rxtx rxacl globaldisable icmp 3
Disable Protocol Pkt : ICMP for Global Ret = 13
[S7006-B-diagnose]debug rxtx rxacl globaldisable icmp 4
Disable Protocol Pkt : ICMP for Global Ret = 13
|
步骤三、关闭软件限制
1
| [S7006-B-diagnose]debug rxtx softcar 41 disable 0
|
1
| [S7006-B-diagnose]debug rxtx softcar 41 disable 1
|
1
| [S7006-B-diagnose]debug rxtx softcar 41 disable 2
|
1
| [S7006-B-diagnose]debug rxtx softcar 41 disable 3
|
1
| [S7006-B-diagnose]debug rxtx softcar 41 disable 4
|
步骤四、查看修改结果
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
| S7006-B-diagnose]debug rxtx softcar show 3
The softcar pps auto-adjust switch: On
ID Type Pkt_PSec DisPkt_All Pps Dynamic Switch Hash ACLmax
0 ROOT 0 0 200 S On SMAC 0
1 ISIS 0 0 200 D On SMAC 8
2 ESIS 0 0 100 S On SMAC 8
3 CLNP 0 0 100 S On SMAC 8
4 VRRP 0 0 300 S On SMAC 8
5 UNKNOWN_IPV4MC 0 0 100 S On SMAC 8
6 UNKNOWN_IPV6MC 0 0 100 S On SMAC 8
7 IPV4_MC_RIP 0 0 150 D On SMAC 8
8 IPV4_BC_RIP 0 0 150 D On SMAC 8
9 MCAST_NTP 0 0 100 S On SMAC 8
10 BCAST_NTP 0 0 100 S On SMAC 8
11 IPV4_MC_OSPF_5 0 0 100 S On SMAC 8
12 IPV4_MC_OSPF_6 0 0 100 S On SMAC 8
13 IPV4_UC_OSPF 0 0 200 S On SMAC 8
14 IPV4_MC_PIM 0 0 200 D On SMAC 8
15 IPV4_UC_PIM 0 0 200 D On SMAC 8
16 IPV4_IGMP 0 0 400 S On SMAC 8
17 LDP 0 0 400 S On SMAC 8
18 IPV6_MC_PIM 0 0 100 D On SMAC 8
19 IPV6_UC_PIM 0 0 100 D On SMAC 8
20 IPV6_MLD 0 0 200 S On SMAC 8
21 IPV6_RIPNG 0 0 100 D On SMAC 8
22 IPV6_UC_OSPFV3 0 0 200 S On SMAC 8
23 IPV6_MC_OSPFV3_5 0 0 200 S On SMAC 8
24 IPV6_MC_OSPFV3_6 0 0 200 S On SMAC 8
25 IPV6_LDP 0 0 100 S On SMAC 8
26 IPV6_VRRP 0 0 300 S On SMAC 8
27 RRPP 0 0 100 S On SMAC 8
28 IPV4_AUTORP 0 0 100 S On SMAC 8
29 ARP 0 0 100 S On SMAC 8
30 ARP_REPLY 0 0 100 S On SMAC 8
31 DHCP_CLIENT 0 0 100 S On SMAC 8
32 DHCP_SERVER 0 0 100 S On SMAC 8
33 DHCP_RELAY_CLIENT 0 0 100 S On SMAC 8
34 DHCP_RELAY_SERVER 0 0 100 S On SMAC 8
35 DOT1X 0 0 300 S On SMAC 8
36 STP 0 0 100 S On SMAC 8
37 LACP 0 0 100 S On SMAC 8
38 GVRP 0 0 100 S On SMAC 8
39 HGMP 0 0 100 S On SMAC 8
40 BGP 0 0 200 S On SMAC 8
41 ICMP 0 0 400 S Off SMAC 4
42 IPV4_TTL 0 0 100 S On SMAC 8
43 IPOPTION 0 0 100 S On SMAC 8
结果显示修改成功。
|
|