ISCSI网卡优化

收集日志

cat /etc/iscsi/targets

lsattr -El iscsi0

lsdev -C | grep iscsi

lsattr -El hdiskX(iscsi存储盘)

errpt -a

netstat -v | egrep "STATISTICS|Media Speed" （检查网卡速度）

lsattr -El entX | grep flow_ctrl

lsattr -El entX | grep large

lsattr -El entX | grep jumbo

需要核实

1.连接iscsi 存储网卡是否配置etherchannel

2.出问题时网络是否出现问题或者闪断

iscsi优化

1.iscsi网卡启用TCP Large send、TCP flow control和Jumbo Frame

ifconfig en1 down

ifconfig en1 detach

chdev -l ent1 -a flow_ctrl=yes

chdev -l ent1 -a large_send=yes#

chdev -l ent1 -a jumbo_frames=yes

ifconfig en1 up

2.修改iscsi网卡最大传输大小为256KB，MTU为9000

smit chinet

Network Interface Name en0

INTERNET ADDRESS (dotted decimal) [192.168.100.100]

Network MASK (hexadecimal or dotted decimal) [255.255.255.0]

Current STATE up +

Use Address Resolution Protocol (ARP)? yes +

BROADCAST ADDRESS (dotted decimal) []

Interface Specific Network Options

('NULL' will unset the option)

rfc1323 []

tcp_mssdflt []

tcp_nodelay []

tcp_recvspace [262144]

tcp_sendspace [262144]

Apply change to DATABASE only no

smit chif

# smit chif

Network Interface Drivers

Type or select values in entry fields.

Press Enter AFTER making all desired changes.

[Entry Fields]

Network Interface en0

Maximum IP PACKET SIZE for THIS DEVICE [9000]

3.设置sb_max为1048576

no -o sb_max

no -p -o sb=max=1048576

4.调整队列深度，默认为16咨询存储厂家设置

# lsattr -El iscsi0 | grep max_targets

max_targets 16 Maximum Targets Allowed True

#lsattr -El hdisk1| grep queue_depth

1

调整方法

chdev -l hdisk1 -a queue_depth=64

5.调整num_cmd_elems

对于iscsi0，有一个"number of command elements"属性，影响iscsi0整个设备数的总队列深度，默认为200.为了最佳性能这个参数应该大于所有iscsi hdisk队列和。比如，有20个磁盘每个queue_depth=12，num_cmd_elems应该为240

# chdev -l iscsi0 -a num_cmd_elems=240

6.设置disk超时

查看系统范围内tcp_keepidle

# no -o tcp_keepidle

tcp_keepidle = 14400（2小时）

查看默认timeout设置，默认rw_timeout 为30s,建议调整为120s

# lsattr -El hdisk1 | grep time

reassign_to 120 REASSIGN time out value True

rw_timeout 30 READ/WRITE time out value True

start_timeout 60 START unit time out value True