|
Size: 23678
Comment:
|
← Revision 46 as of 2022-06-10 09:10:55 ⇥
Size: 32720
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 2: | Line 2: |
| <<TableOfContents>> == Top 10 QA == |
<<TableOfContents()>> = lab = http://labondemand.netapp.com/ https://library.netapp.com/ecmdocs/ECMP1136573/html/frameset.html == System Performance Modeler == https://spm.netapp.com == UP tool == * UP Supported Components: cDOT & 7-Mode Storage Controllers, Windows, VMware, Linux, HPUX, AIX, Cisco, Brocade https://up.netapp.com == top 10 qa == |
| Line 7: | Line 19: |
| == How to find lun WWID == | == how to find lun wwid == |
| Line 10: | Line 22: |
| == Data ONTAP Simulator Requirements == http://mysupport.netapp.com/NOW/cgi-bin/simulator http://mysupport.netapp.com/NOW/cgi-bin/simulatorlic8.cgi/download/tools/simulator/ontap/8.1.3/vsim_netapp-7m.tgz = Troubleshooting = == Too many users logged in! Please try again later. == |
== data ontap simulator requirements == http://mysupport.netapp.com/now/cgi-bin/simulator http://mysupport.netapp.com/now/cgi-bin/simulatorlic8.cgi/download/tools/simulator/ontap/8.1.3/vsim_netapp-7m.tgz === adding disks to a data ontap === http://community.netapp.com/t5/developer-network-articles-and-resources/adding-disks-to-a-data-ontap-8-1-1-simulator/ta-p/86240 http://kabri.uk/2013/11/04/how-to-increase-the-usable-disk-size-in-the-netapp-ontap-8-x-7-mode-simulator/ == SNAPSHOT == {{{ Cluster1::> run -node Cluster1-0 Cluster1-01 Cluster1-02 Cluster1::> run -node Cluster1-02 Type 'exit' or 'Ctrl-D' to return to the CLI Cluster1-02> snap delete -a -f vol0 Deleted vol0 snapshot hourly.5. Deleted vol0 snapshot hourly.4. Deleted vol0 snapshot nightly.1. Deleted vol0 snapshot hourly.3. Deleted vol0 snapshot hourly.2. Deleted vol0 snapshot hourly.1. Deleted vol0 snapshot hourly.0. Deleted vol0 snapshot nightly.0. Cluster1-02> snap sched vol0 0 0 0 Cluster1-02> snap autodelete vol0 on snap autodelete: snap autodelete enabled Cluster1-02> snap autodelete vol0 target_free_space 35 snap autodelete: snap autodelete configuration options set Cluster1-02> snap autodelete vol0 snapshot autodelete settings for vol0: state : on commitment : try trigger : volume target_free_space : 35% delete_order : oldest_first defer_delete : user_created prefix : (not specified) destroy_list : none }}} = troubleshooting = == Changing the disk shelf ID == {{{ Steps 1. Turn on the power to the disk shelf if it is not already on. 2. Remove the left end cap to locate the button near the shelf LEDs. 3. Change the first number of the shelf ID by pressing and holding the orange button until the first number on the digital display blinks, which can take up to three seconds. Note: If the ID takes longer than three seconds to blink, press the button again, making sure to press it in all the way. This activates the disk shelf ID programming mode. 4. Press the button to advance the number until you reach the desired number from 0 to 9. The first number continues to blink. 5. Change the second number of the shelf ID by pressing and holding the button until the second number on the digital display blinks, which can take up to three seconds. The first number on the digital display stops blinking. 6. Press the button to advance the number until you reach the desired number from 1 to 9. The second number continues to blink. 7. Lock in the desired number and exit the programming mode by pressing and holding the button until the second number stops blinking, which can take up to three seconds. Both numbers on the digital display start blinking and the amber LED on the operator display panel illuminates after about five seconds, alerting you that the pending disk shelf ID has not yet 8. Power cycle the disk shelf to make the shelf ID take effect. }}} == collection autosupport log == * Display the health status of the system, which reflects the overall status of individual health monitors {{{ system health status show }}} * Display the health status of subsystems for which health monitoring is available {{{ system health subsystem show }}} * node run -node local sysconfig -a {{{ 收集ASUP log，执行下面的命令就可以了，log就会产生。 system node autosupport invoke -node * -type all -uri file:///mroot/etc/log/case_number-asup.7z 存储的管理IP后面跟 /SPI，然后输入admin账号密码 https://x.x.x.x/spi/ log的路径是 /etc/log/case_number-asup.7z }}} == System Fault Led is on (FAS 2240-2) == {{{ We opened a case for this issue. Support sent to me the 7-step process below to resolve the issue with the system fault LEDs: 1. At the Data ONTAP CLI prompt, issue the “halt –s” command. Please note that this will cause an HA takeover in an HA configuration. 2. Wait for the controller to shut down and power off. 3. On the console port (not RSH, SSH, etc.), issue a “^G”(ctrl G)to switch the console to the SP. 4. Log in to the SP. 5. At the SP prompt, issue the “system power on” command. 6. Issue a “^D”(ctrl D)to get back to the Data ONTAP console. 7. Once the BIOS / Loader have booted, issue the “boot_ontap” command. 8. Issue Giveback after Takeover. After following the 7-step process, the issue has been solved Regards, }}} http://vipulvajpayeestorage.blogspot.com/2012/04/netapp-fas-2240-storage-showing-pcm.html https://community.netapp.com/t5/OnCommand-Storage-Management-Software-Discussions/System-Fault-Led-is-on-FAS-2240-2/td-p/79624 == too many users logged in! please try again later. == |
| Line 17: | Line 141: |
| {{{ 可能是其他人有登入，則請其他人先退出 或是登入後因為網路不穩，造成連線不正常中斷，此時就必須要等timeout時間一到，才可以再登入 另外可以嘗試透過rsh重啟telnet 或是ssh服務來解決這個問題 首先確定netapp 的rsh 是否有開啟 找一台client測試以下指令 client# rsh filer_ip -l root@password df 如果有正常回應的話 輸入 client# rsh filer_ip -l root@password "options ssh.enable off" client# rsh filer_ip -l root@password "options ssh.enable on" 或是 client# rsh filer_ip -l root@password "options telnet.enable off" client# rsh filer_ip -l root@password "options telnet.enable on" 即可 }}} rsh 192.168.0.192 -l root:xx sysconfig -a |
|
| Line 19: | Line 160: |
| == Fri Dec 25 15:03:29 CST [UR-2240A:sis.changelog.full:warning]: SIS change logging metafile for volume vol1_A is full. == == OnCommand System Manager Error 500 Connection Refused == |
== fri dec 25 15:03:29 cst [ur-2240a:sis.changelog.full:warning]: sis change logging metafile for volume vol1_a is full. == == oncommand system manager error 500 connection refused == |
| Line 24: | Line 165: |
| TLS is disabled by default on the storage controllers. It must be explicitly enabled To enable TLS, run the following command via the shell: |
tls is disabled by default on the storage controllers. it must be explicitly enabled to enable tls, run the following command via the shell: |
| Line 29: | Line 170: |
| That should do it. == Aggr ? == for volumes - you can't have a flexible volume without an aggregate. Flex Vols are logical, Aggregates are physical. you layer one or more flex vols on |
that should do it. == aggr ? == for volumes - you can't have a flexible volume without an aggregate. flex vols are logical, aggregates are physical. you layer one or more flex vols on |
| Line 35: | Line 176: |
| == How to monitor NetApp storage systems using SNMP == | == how to monitor netapp storage systems using snmp == |
| Line 38: | Line 179: |
| == NetApp best practice == As the best practice, NetApp now recommends to set Fractional Reserve and Snap Reserve for your volumes to 0%. Don’t forget about that, if you want to save more storage space: |
== netapp best practice == as the best practice, netapp now recommends to set fractional reserve and snap reserve for your volumes to 0%. don’t forget about that, if you want to save more storage space: |
| Line 44: | Line 185: |
| Disable snapshots if you don’t use them: | disable snapshots if you don’t use them: |
| Line 49: | Line 190: |
| = How to = == How to add Disk SHELF to exist NetApp == http://community.netapp.com/t5/FAS-and-V-Series-Storage-Systems-Discussions/DS2246-SAS-install-FAS2240-2-Config-check/td-p/55471 http://community.netapp.com/t5/FAS-and-V-Series-Storage-Systems-Discussions/DS2246-SAS-install-FAS2240-2-Config-check/m-p/55487#M3904 |
= how to = == initialize setting == http://www.getshifting.com/wiki/netappchangeip == how to add disk shelf to exist netapp == http://community.netapp.com/t5/fas-and-v-series-storage-systems-discussions/ds2246-sas-install-fas2240-2-config-check/td-p/55471 http://community.netapp.com/t5/fas-and-v-series-storage-systems-discussions/ds2246-sas-install-fas2240-2-config-check/m-p/55487#m3904 |
| Line 58: | Line 202: |
| How to add a new disk shelf to a Netapp filer ?? Assumption:- Filer has already one disk shelf connected this is the new one |
how to add a new disk shelf to a netapp filer ?? assumption:- filer has already one disk shelf connected this is the new one |
| Line 64: | Line 208: |
| Cables required:- Two SAS cables , Two ACP (CAT6 ETHERNET ) cables if any 1. Rack the shelf 2. Connect power cables & turn the shelf on (wait about 30 seconds) 3. On the front of the shelf, change the shelf id to something unique. (try and keep it sequential with the shelf that's already there) DO NOT USE "00" 4. Wait about 45 seconds and then restart the shelf and make sure the new shelf ID came up. 5. SSH into both filers and do "options disk.auto_assign off" 6. Do a "storage show disk -p" on both controllers and copy the |
cables required:- two sas cables , two acp (cat6 ethernet ) cables if any 1. rack the shelf 2. connect power cables & turn the shelf on (wait about 30 seconds) 3. on the front of the shelf, change the shelf id to something unique. (try and keep it sequential with the shelf that's already there) do not use "00" 4. wait about 45 seconds and then restart the shelf and make sure the new shelf id came up. 5. ssh into both filers and do "options disk.auto_assign off" 6. do a "storage show disk -p" on both controllers and copy the |
| Line 83: | Line 227: |
| 7. Do a "options autosupport.doit "before shelf add"" on both | 7. do a "options autosupport.doit "before shelf add"" on both |
| Line 87: | Line 231: |
| 8. Now for the fun part, take a SAS cable and plug one end into the TOP circle of the OLD shelf and plug it in the BOTTOM square of the NEW shelf 9. Now take another SAS cable and plug one end into the BOTTOM circle of the OLD shelf and plug it into the TOP square of the new shelf |
8. now for the fun part, take a sas cable and plug one end into the top circle of the old shelf and plug it in the bottom square of the new shelf 9. now take another sas cable and plug one end into the bottom circle of the old shelf and plug it into the top square of the new shelf |
| Line 97: | Line 241: |
| 11. Run "storage show disk -p" and make sure all of your old disks are | 11. run "storage show disk -p" and make sure all of your old disks are |
| Line 105: | Line 249: |
| == Data ONTAP Basic Command Please? == This post contains the list of commands that will be most used and will come handy when managing or monitoring or troubleshooting a Netapp |
== data ontap basic command please? == this post contains the list of commands that will be most used and will come handy when managing or monitoring or troubleshooting a netapp |
| Line 116: | Line 260: |
| netapp Ontap OS version. | netapp ontap os version. |
| Line 123: | Line 267: |
| rdfile : Like "cat" in Linux, used to read contents of text files/ |
rdfile : like "cat" in linux, used to read contents of text files/ |
| Line 126: | Line 270: |
| Creates/Overwrites a file. Similar to "cat > filename" in Linux aggr status : Shows |
creates/overwrites a file. similar to "cat > filename" in linux aggr status : shows |
| Line 130: | Line 274: |
| Shows the raid configuration, reconstruction information of the disks in filer | shows the raid configuration, reconstruction information of the disks in filer |
| Line 132: | Line 276: |
| Shows the disk usage of the aggreate, WAFL reserve, overheads etc. vol status : Shows |
shows the disk usage of the aggreate, wafl reserve, overheads etc. vol status : shows |
| Line 136: | Line 280: |
| Displays the spare disks on the filer | displays the spare disks on the filer |
| Line 138: | Line 282: |
| Displays the failed disks on the filer | displays the failed disks on the filer |
| Line 140: | Line 284: |
| Shows the raid configuration, reconstruction information of the disks df -h : Displays |
shows the raid configuration, reconstruction information of the disks df -h : displays |
| Line 143: | Line 287: |
| df -i : Shows the inode | df -i : shows the inode |
| Line 145: | Line 289: |
| df -Ah : Shows | df -ah : shows |
| Line 148: | Line 292: |
| Displays/add/removes license on a netapp filer maxfiles : Displays |
displays/add/removes license on a netapp filer maxfiles : displays |
| Line 152: | Line 296: |
| Creates aggregate | creates aggregate |
| Line 154: | Line 298: |
| <volname> <aggrname> <size> : Creates volume in an aggregate | <volname> <aggrname> <size> : creates volume in an aggregate |
| Line 156: | Line 300: |
| <volname> : Offlines a volume | <volname> : offlines a volume |
| Line 158: | Line 302: |
| <volname> : Onlines a volume | <volname> : onlines a volume |
| Line 160: | Line 304: |
| <volname> : Destroys and removes an volume | <volname> : destroys and removes an volume |
| Line 162: | Line 306: |
| <volname> [+|-]<size> : Resize a volume in netapp filer vol options : Displays/Changes |
<volname> [+|-]<size> : resize a volume in netapp filer vol options : displays/changes |
| Line 166: | Line 310: |
| <qtree-path> : Creates qtree | <qtree-path> : creates qtree |
| Line 168: | Line 312: |
| Displays the status of qtrees quota on : Enables |
displays the status of qtrees quota on : enables |
| Line 172: | Line 316: |
| Disables quota | disables quota |
| Line 174: | Line 318: |
| Resizes quota | resizes quota |
| Line 176: | Line 320: |
| Reports the quota and usage | reports the quota and usage |
| Line 178: | Line 322: |
| Displays all snapshots on a volume | displays all snapshots on a volume |
| Line 180: | Line 324: |
| <volname> <snapname> : Create snapshot | <volname> <snapname> : create snapshot |
| Line 182: | Line 326: |
| <volname> <schedule> : Schedule snapshot creation | <volname> <schedule> : schedule snapshot creation |
| Line 184: | Line 328: |
| <volname> <percentage> : Display/set snapshot reserve space in volume /etc/exports : File that manages the NFS exports |
<volname> <percentage> : display/set snapshot reserve space in volume /etc/exports : file that manages the nfs exports |
| Line 188: | Line 332: |
| : Read the NFS exports file | : read the nfs exports file |
| Line 190: | Line 334: |
| : Write to NFS exports file | : write to nfs exports file |
| Line 192: | Line 336: |
| Exports all the filesystems listed in /etc/exports cifs setup : Setup |
exports all the filesystems listed in /etc/exports cifs setup : setup |
| Line 195: | Line 339: |
| cifs shares : Create/displays | cifs shares : create/displays |
| Line 198: | Line 342: |
| Changes access of cifs shares | changes access of cifs shares |
| Line 200: | Line 344: |
| Creates iscsi or fcp luns on a netapp filer lun map : Maps lun |
creates iscsi or fcp luns on a netapp filer lun map : maps lun |
| Line 203: | Line 347: |
| lun show : Show all | lun show : show all |
| Line 206: | Line 350: |
| Creates netapp igroup lun stats : Show lun I/O statistics disk show : Shows |
creates netapp igroup lun stats : show lun i/o statistics disk show : shows |
| Line 212: | Line 356: |
| Zeros the spare disks | zeros the spare disks |
| Line 214: | Line 358: |
| Upgrades the disk firmware on all disks | upgrades the disk firmware on all disks |
| Line 216: | Line 360: |
| Display/Set options on netapp filer | display/set options on netapp filer |
| Line 218: | Line 362: |
| Display/Set NFS options | display/set nfs options |
| Line 220: | Line 364: |
| Display/Set NTP options on netapp. | display/set ntp options on netapp. |
| Line 222: | Line 366: |
| : Display/Set autosupport options | : display/set autosupport options |
| Line 224: | Line 368: |
| Display/Set cifs options | display/set cifs options |
| Line 226: | Line 370: |
| Display/Set TCP options | display/set tcp options |
| Line 228: | Line 372: |
| Display/Set network options | display/set network options |
| Line 230: | Line 374: |
| <src-path> <dst-path> : Initiates ndmpcopy | <src-path> <dst-path> : initiates ndmpcopy |
| Line 232: | Line 376: |
| Displays status of ndmpd | displays status of ndmpd |
| Line 234: | Line 378: |
| Terminates all the ndmpd processes. | terminates all the ndmpd processes. |
| Line 236: | Line 380: |
| Displays/Sets IP address on a network/vif interface | displays/sets ip address on a network/vif interface |
| Line 238: | Line 382: |
| Creates a VIF (bonding/trunking/teaming) | creates a vif (bonding/trunking/teaming) |
| Line 240: | Line 384: |
| Displays status of a vif netstat : Displays |
displays status of a vif netstat : displays |
| Line 245: | Line 389: |
| nfsstat : Shows nfs | nfsstat : shows nfs |
| Line 248: | Line 392: |
| Displays nfs stats per client nfs_hist : Displays |
displays nfs stats per client nfs_hist : displays |
| Line 253: | Line 397: |
| stats : Displays stats for every counter on netapp. Read stats man page for more info ifstat : Displays Network interface stats |
stats : displays stats for every counter on netapp. read stats man page for more info ifstat : displays network interface stats |
| Line 258: | Line 402: |
| displays I/O stats of qtree | displays i/o stats of qtree |
| Line 262: | Line 406: |
| <disk|shelf|adapter> : Shows storage component details | <disk|shelf|adapter> : shows storage component details |
| Line 264: | Line 408: |
| intialize : Initialize a snapmirror relation | intialize : initialize a snapmirror relation |
| Line 266: | Line 410: |
| Manually Update snapmirror relation | manually update snapmirror relation |
| Line 268: | Line 412: |
| Resyns a broken snapmirror | resyns a broken snapmirror |
| Line 270: | Line 414: |
| : Quiesces a snapmirror bond | : quiesces a snapmirror bond |
| Line 272: | Line 416: |
| Breakes a snapmirror relation | breakes a snapmirror relation |
| Line 274: | Line 418: |
| Abort a running snapmirror | abort a running snapmirror |
| Line 276: | Line 420: |
| Shows snapmirror status | shows snapmirror status |
| Line 278: | Line 422: |
| Displays locks held by filer sm_mon : Manage the |
displays locks held by filer sm_mon : manage the |
| Line 282: | Line 426: |
| shelf : Installs the shelf firmware | shelf : installs the shelf firmware |
| Line 284: | Line 428: |
| Download the Netapp OS software | download the netapp os software |
| Line 286: | Line 430: |
| Installs OS download : Updates the installed OS |
installs os download : updates the installed os |
| Line 290: | Line 434: |
| Displays cluster status cf takeover : Takes |
displays cluster status cf takeover : takes |
| Line 293: | Line 437: |
| cf giveback : Gives | cf giveback : gives |
| Line 295: | Line 439: |
| reboot : Reboots a | reboot : reboots a |
| Line 299: | Line 443: |
| == Pocket guide for netapp commands == This post contains the list of commands that will be most used and will come handy when managing or monitoring or troubleshooting a Netapp |
== pocket guide for netapp commands == this post contains the list of commands that will be most used and will come handy when managing or monitoring or troubleshooting a netapp |
| Line 310: | Line 454: |
| netapp Ontap OS version. | netapp ontap os version. |
| Line 317: | Line 461: |
| rdfile : Like "cat" in Linux, used to read contents of text files/ |
rdfile : like "cat" in linux, used to read contents of text files/ |
| Line 320: | Line 464: |
| Creates/Overwrites a file. Similar to "cat > filename" in Linux aggr status : Shows |
creates/overwrites a file. similar to "cat > filename" in linux aggr status : shows |
| Line 324: | Line 468: |
| Shows the raid configuration, reconstruction information of the disks in filer | shows the raid configuration, reconstruction information of the disks in filer |
| Line 326: | Line 470: |
| Shows the disk usage of the aggreate, WAFL reserve, overheads etc. vol status : Shows |
shows the disk usage of the aggreate, wafl reserve, overheads etc. vol status : shows |
| Line 330: | Line 474: |
| Displays the spare disks on the filer | displays the spare disks on the filer |
| Line 332: | Line 476: |
| Displays the failed disks on the filer | displays the failed disks on the filer |
| Line 334: | Line 478: |
| Shows the raid configuration, reconstruction information of the disks df -h : Displays |
shows the raid configuration, reconstruction information of the disks df -h : displays |
| Line 337: | Line 481: |
| df -i : Shows the inode | df -i : shows the inode |
| Line 339: | Line 483: |
| df -Ah : Shows | df -ah : shows |
| Line 342: | Line 486: |
| Displays/add/removes license on a netapp filer maxfiles : Displays |
displays/add/removes license on a netapp filer maxfiles : displays |
| Line 346: | Line 490: |
| Creates aggregate | creates aggregate |
| Line 348: | Line 492: |
| <volname> <aggrname> <size> : Creates volume in an aggregate | <volname> <aggrname> <size> : creates volume in an aggregate |
| Line 350: | Line 494: |
| <volname> : Offlines a volume | <volname> : offlines a volume |
| Line 352: | Line 496: |
| <volname> : Onlines a volume | <volname> : onlines a volume |
| Line 354: | Line 498: |
| <volname> : Destroys and removes an volume | <volname> : destroys and removes an volume |
| Line 356: | Line 500: |
| <volname> [+|-]<size> : Resize a volume in netapp filer vol options : Displays/Changes |
<volname> [+|-]<size> : resize a volume in netapp filer vol options : displays/changes |
| Line 360: | Line 504: |
| <qtree-path> : Creates qtree | <qtree-path> : creates qtree |
| Line 362: | Line 506: |
| Displays the status of qtrees quota on : Enables |
displays the status of qtrees quota on : enables |
| Line 366: | Line 510: |
| Disables quota | disables quota |
| Line 368: | Line 512: |
| Resizes quota | resizes quota |
| Line 370: | Line 514: |
| Reports the quota and usage | reports the quota and usage |
| Line 372: | Line 516: |
| Displays all snapshots on a volume | displays all snapshots on a volume |
| Line 374: | Line 518: |
| <volname> <snapname> : Create snapshot | <volname> <snapname> : create snapshot |
| Line 376: | Line 520: |
| <volname> <schedule> : Schedule snapshot creation | <volname> <schedule> : schedule snapshot creation |
| Line 378: | Line 522: |
| <volname> <percentage> : Display/set snapshot reserve space in volume /etc/exports : File that manages the NFS exports |
<volname> <percentage> : display/set snapshot reserve space in volume /etc/exports : file that manages the nfs exports |
| Line 382: | Line 526: |
| : Read the NFS exports file | : read the nfs exports file |
| Line 384: | Line 528: |
| : Write to NFS exports file | : write to nfs exports file |
| Line 386: | Line 530: |
| Exports all the filesystems listed in /etc/exports cifs setup : Setup |
exports all the filesystems listed in /etc/exports cifs setup : setup |
| Line 389: | Line 533: |
| cifs shares : Create/displays | cifs shares : create/displays |
| Line 392: | Line 536: |
| Changes access of cifs shares | changes access of cifs shares |
| Line 394: | Line 538: |
| Creates iscsi or fcp luns on a netapp filer lun map : Maps lun |
creates iscsi or fcp luns on a netapp filer lun map : maps lun |
| Line 397: | Line 541: |
| lun show : Show all | lun show : show all |
| Line 400: | Line 544: |
| Creates netapp igroup lun stats : Show lun I/O statistics disk show : Shows |
creates netapp igroup lun stats : show lun i/o statistics disk show : shows |
| Line 406: | Line 550: |
| Zeros the spare disks | zeros the spare disks |
| Line 408: | Line 552: |
| Upgrades the disk firmware on all disks | upgrades the disk firmware on all disks |
| Line 410: | Line 554: |
| Display/Set options on netapp filer | display/set options on netapp filer |
| Line 412: | Line 556: |
| Display/Set NFS options | display/set nfs options |
| Line 414: | Line 558: |
| Display/Set NTP options on netapp. | display/set ntp options on netapp. |
| Line 416: | Line 560: |
| : Display/Set autosupport options | : display/set autosupport options |
| Line 418: | Line 562: |
| Display/Set cifs options | display/set cifs options |
| Line 420: | Line 564: |
| Display/Set TCP options | display/set tcp options |
| Line 422: | Line 566: |
| Display/Set network options | display/set network options |
| Line 424: | Line 568: |
| <src-path> <dst-path> : Initiates ndmpcopy | <src-path> <dst-path> : initiates ndmpcopy |
| Line 426: | Line 570: |
| Displays status of ndmpd | displays status of ndmpd |
| Line 428: | Line 572: |
| Terminates all the ndmpd processes. | terminates all the ndmpd processes. |
| Line 430: | Line 574: |
| Displays/Sets IP address on a network/vif interface | displays/sets ip address on a network/vif interface |
| Line 432: | Line 576: |
| Creates a VIF (bonding/trunking/teaming) | creates a vif (bonding/trunking/teaming) |
| Line 434: | Line 578: |
| Displays status of a vif netstat : Displays |
displays status of a vif netstat : displays |
| Line 439: | Line 583: |
| nfsstat : Shows nfs | nfsstat : shows nfs |
| Line 442: | Line 586: |
| Displays nfs stats per client nfs_hist : Displays |
displays nfs stats per client nfs_hist : displays |
| Line 447: | Line 591: |
| stats : Displays stats for every counter on netapp. Read stats man page for more info ifstat : Displays Network interface stats |
stats : displays stats for every counter on netapp. read stats man page for more info ifstat : displays network interface stats |
| Line 452: | Line 596: |
| displays I/O stats of qtree | displays i/o stats of qtree |
| Line 456: | Line 600: |
| <disk|shelf|adapter> : Shows storage component details | <disk|shelf|adapter> : shows storage component details |
| Line 458: | Line 602: |
| intialize : Initialize a snapmirror relation | intialize : initialize a snapmirror relation |
| Line 460: | Line 604: |
| Manually Update snapmirror relation | manually update snapmirror relation |
| Line 462: | Line 606: |
| Resyns a broken snapmirror | resyns a broken snapmirror |
| Line 464: | Line 608: |
| : Quiesces a snapmirror bond | : quiesces a snapmirror bond |
| Line 466: | Line 610: |
| Breakes a snapmirror relation | breakes a snapmirror relation |
| Line 468: | Line 612: |
| Abort a running snapmirror | abort a running snapmirror |
| Line 470: | Line 614: |
| Shows snapmirror status | shows snapmirror status |
| Line 472: | Line 616: |
| Displays locks held by filer sm_mon : Manage the |
displays locks held by filer sm_mon : manage the |
| Line 476: | Line 620: |
| shelf : Installs the shelf firmware | shelf : installs the shelf firmware |
| Line 478: | Line 622: |
| Download the Netapp OS software | download the netapp os software |
| Line 480: | Line 624: |
| Installs OS download : Updates the installed OS |
installs os download : updates the installed os |
| Line 484: | Line 628: |
| Displays cluster status cf takeover : Takes |
displays cluster status cf takeover : takes |
| Line 487: | Line 631: |
| cf giveback : Gives | cf giveback : gives |
| Line 489: | Line 633: |
| reboot : Reboots a | reboot : reboots a |
| Line 493: | Line 637: |
| vperumal Former NetApp Employee http://community.netapp.com/t5/Data-ONTAP-Discussions/Data-ONTAP-Basic-Command-Please/td-p/59641 == NetApp basic how to == === LUN create & map === 1, fcp wwpn-alias set alias_name WWPN |
vperumal former netapp employee http://community.netapp.com/t5/data-ontap-discussions/data-ontap-basic-command-please/td-p/59641 == netapp basic how to == === lun create & map === 1, fcp wwpn-alias set alias_name wwpn |
| Line 503: | Line 647: |
| igroup create -f -t aix IBM_P720 IBM_P720a IBM_P720b igroup create -f -t windows IMAGE 198.0.0.10 |
igroup create -f -t aix ibm_p720 ibm_p720a ibm_p720b igroup create -f -t windows image 198.0.0.10 |
| Line 508: | Line 652: |
| 3, N6060A> {{{ vol create IBM_P720 aggr0a 330G vol create IMAGE aggr0a 2448G vol create DATA aggr0a 900G vol create chjbak aggr0b 900G snap reserve IBM_P720 0 }}} 4, lun create -s SIZE -t OSTYPE lun_PATH (lun show) {{{ lun create -s 5G -t aix /vol/IBM_P720/CRS01 lun create -s 5G -t aix /vol/IBM_P720/CRS02 lun create -s 5G -t aix /vol/IBM_P720/CRS03 lun create -s 100G -t aix /vol/IBM_P720/DATA01 lun create -s 100G -t aix /vol/IBM_P720/DATA02 lun create -s 100G -t aix /vol/IBM_P720/DATA03 lun create -s 898G -t windows /vol/chjbak/chjbak01 lun create -s 2048G -t windows_2008 /vol/IMAGE/image01 lun create -s 400G -t windows_2008 /vol/IMAGE/image02 }}} 5, lun map lun_PATH initialtor_group/alias_name {{{ N6060A> fcp wwpn-alias show WWPN Alias |
3, n6060a> {{{ vol create ibm_p720 aggr0a 330g vol create image aggr0a 2448g vol create data aggr0a 900g vol create chjbak aggr0b 900g snap reserve ibm_p720 0 }}} 4, lun create -s size -t ostype lun_path (lun show) {{{ lun create -s 5g -t aix /vol/ibm_p720/crs01 lun create -s 5g -t aix /vol/ibm_p720/crs02 lun create -s 5g -t aix /vol/ibm_p720/crs03 lun create -s 100g -t aix /vol/ibm_p720/data01 lun create -s 100g -t aix /vol/ibm_p720/data02 lun create -s 100g -t aix /vol/ibm_p720/data03 lun create -s 898g -t windows /vol/chjbak/chjbak01 lun create -s 2048g -t windows_2008 /vol/image/image01 lun create -s 400g -t windows_2008 /vol/image/image02 }}} 5, lun map lun_path initialtor_group/alias_name {{{ n6060a> fcp wwpn-alias show wwpn alias |
| Line 542: | Line 686: |
| 10:00:00:00:c9:88:9b:4b IBM_P720a 10:00:00:00:c9:7a:14:35 IBM_P720b |
10:00:00:00:c9:88:9b:4b ibm_p720a 10:00:00:00:c9:7a:14:35 ibm_p720b |
| Line 547: | Line 691: |
| lun map /vol/IBM_P720/CRS01 IBM_P720 lun map /vol/IBM_P720/CRS02 IBM_P720 lun map /vol/IBM_P720/CRS03 IBM_P720 lun map /vol/IBM_P720/DATA01 IBM_P720 lun map /vol/IBM_P720/DATA02 IBM_P720 lun map /vol/IBM_P720/DATA03 IBM_P720 lun map /vol/IMAGE/image01 198.0.0.10 lun map /vol/IMAGE/image02 198.0.0.10 }}} === NOTES === |
lun map /vol/ibm_p720/crs01 ibm_p720 lun map /vol/ibm_p720/crs02 ibm_p720 lun map /vol/ibm_p720/crs03 ibm_p720 lun map /vol/ibm_p720/data01 ibm_p720 lun map /vol/ibm_p720/data02 ibm_p720 lun map /vol/ibm_p720/data03 ibm_p720 lun map /vol/image/image01 198.0.0.10 lun map /vol/image/image02 198.0.0.10 }}} === notes === |
| Line 573: | Line 717: |
| == TEST failover works == | == test failover works == |
| Line 577: | Line 721: |
| Filer X has taken over Filer Y. | filer x has taken over filer y. |
| Line 580: | Line 724: |
| Filer X is ready for giveback. | filer x is ready for giveback. |
| Line 586: | Line 730: |
| N6060B(takeover) partner | n6060b(takeover) partner |
| Line 595: | Line 739: |
| http://mysupport.netapp.com/NOW/cgi-bin/simulator == 7 mode VS cluster mode == 最开始的Ｄata Ontap 借鉴了最早的开源UNIX之一的BSD Net/2许多代码，包括 TCP/IP 堆栈、启动代码、设备驱动等，后来的Data Ontap也从其他的开源UNIX借鉴了大量的代码。至于命令行接口是NetApp仿Unix独立开发的,另外WAFL文件系统与RAID代码及磁盘子系统为NetApp自己开发的所以与UNIX的完全不同。 一开始DataOntap没有什么mode之分的，NetApp收购了Spinnaker之后基于freeBSD把DataOntap与Spinnaker的软件重新整合出另一个叫Data Ontap GX的操作系统来，当Data Ontap更新至8.0版本后，NetApp统一了二者的版本号,并把原生的DataOntap称为7 mode, 后来的Data Ontap GX则称为 cluster mode,简称为c mode。 由于新的DataOntap cluster mode功能一直不够完善，NetApp一直同时开发着7 mode 和cluster mode两个操作系统，不过随着NetApp大力推广和开发cluster mode，相信很快就会停止开发7 mode只有cluste mode了。目前（Data Ontap |
http://mysupport.netapp.com/now/cgi-bin/simulator == 7 mode vs cluster mode == 最开始的ｄata ontap 借鉴了最早的开源unix之一的bsd net/2许多代码，包括 tcp/ip 堆栈、启动代码、设备驱动等，后来的data ontap也从其他的开源unix借鉴了大量的代码。至于命令行接口是netapp仿unix独立开发的,另外wafl文件系统与raid代码及磁盘子系统为netapp自己开发的所以与unix的完全不同。 一开始dataontap没有什么mode之分的，netapp收购了spinnaker之后基于freebsd把dataontap与spinnaker的软件重新整合出另一个叫data ontap gx的操作系统来，当data ontap更新至8.0版本后，netapp统一了二者的版本号,并把原生的dataontap称为7 mode, 后来的data ontap gx则称为 cluster mode,简称为c mode。 由于新的dataontap cluster mode功能一直不够完善，netapp一直同时开发着7 mode 和cluster mode两个操作系统，不过随着netapp大力推广和开发cluster mode，相信很快就会停止开发7 mode只有cluste mode了。目前（data ontap |
| Line 613: | Line 757: |
| Cluster-Mode Only −Clustered scaleout (24-NAS: 4-SAN) （多节点集群，如果提供SAN则一个集群最多4个节点） −Namespace （统一命名空间） −Nondisruptive operations （节点间平滑迁移volume或LUN） −Management as single system （统一管理整个集群） −Scalable and integrated multi-tenancy （可扩展及多租户） −NFS v4, v4.1 (pNFS); SMB 2.0, 2.1 −Onboard antivirus |
cluster-mode only −clustered scaleout (24-nas: 4-san) （多节点集群，如果提供san则一个集群最多4个节点） −namespace （统一命名空间） −nondisruptive operations （节点间平滑迁移volume或lun） −management as single system （统一管理整个集群） −scalable and integrated multi-tenancy （可扩展及多租户） −nfs v4, v4.1 (pnfs); smb 2.0, 2.1 −onboard antivirus |
| Line 632: | Line 776: |
| 7-Mode Only −SnapLock® −SnapVault® and OSSV −Qtree and synchronous SnapMirror −MetroCluster™ −vFiler® −FlexShare® −IPv6, HTTP, FTP, SFTP, TFTP |
7-mode only −snaplock® −snapvault® and ossv −qtree and synchronous snapmirror −metrocluster™ −vfiler® −flexshare® −ipv6, http, ftp, sftp, tftp |
| Line 650: | Line 794: |
| Both 7-Mode and Cluster-Mode −Unified architecture −Storage efficiency features 和（重复数据删除与压缩） −Snapshot™ copies and asynchronous volume SnapMirror® −Intelligent caching with Flash Cache }}} == Oncommand == http://mysupport.netapp.com/NOW/cgi-bin/software/ http://community.netapp.com/t5/OnCommand-Storage-Management-Software-Discussions/Operations-Manager-CORE-free-license-available/td-p/61964 == How to determine the disk and shelf firmware version on a controller and verify it is up to date == https://kb.netapp.com/index?page=content&id=1010762&actp=LIST_POPULAR https://kb.netapp.com/support/index?page=content&id=1011673&actp=LIST_RECENT == IOPS calc == The Shot Analysis of NetApp FAS8040 (2-node, C-Mode) SPC-1 Results | Storage News: |
both 7-mode and cluster-mode −unified architecture −storage efficiency features 和（重复数据删除与压缩） −snapshot™ copies and asynchronous volume snapmirror® −intelligent caching with flash cache }}} == oncommand == http://mysupport.netapp.com/now/cgi-bin/software/ http://community.netapp.com/t5/oncommand-storage-management-software-discussions/operations-manager-core-free-license-available/td-p/61964 == how to determine the disk and shelf firmware version on a controller and verify it is up to date == https://kb.netapp.com/index?page=content&id=1010762&actp=list_popular https://kb.netapp.com/support/index?page=content&id=1011673&actp=list_recent == iops calc == the shot analysis of netapp fas8040 (2-node, c-mode) spc-1 results | storage news: http://www.stornews.com/?page_id=53 |
| Line 675: | Line 821: |
| http://www.hudop.com/tools/iopse.php |
|
| Line 676: | Line 824: |
| * enable rsh {{{ options rsh.enable on }}} {{{ Hi, These are the commands I use to troubleshoot performance issues: always start with "priv set diag" sysstat -M -i 5 --> already explained sysstat -x 5 --> shows you the different I/O ("Disk util" is an importend one and also "CPty" see http://now.netapp.com/NOW/knowledge/docs/ontap/rel707/html/ontap/cmdref/man1/na_sysstat.1.html) lun stats -i 5 --> shows you the read / write / latency's of luns stats show lun --> shows you detailed info of every lun (you will want to capture this in an output file) stats show volume --> same as lun but now for the volumes (you will want to capture this in an output file) reallocate status --> shows if any reallocation jobs are running (walf scan status shows you even more info) If this is not enough you can get some info with statit a "statit -b" will start the data collection (wait a few minutes) a "statit -e" will stop the collection and will give you the result. (you will want this to capture in an output file) }}} |
|
| Line 679: | Line 872: |
| http://mysupport.netapp.com/NOW/cgi-bin/shelffwdnld.cgi/download/tools/diskshelf/bin/all_shelf_fw#7dot == Re: Understanding aggregate and lun == http://community.netapp.com/t5/FAS-and-V-Series-Storage-Systems-Discussions/Understanding-aggregate-and-lun/td-p/23326/page/3 == Netapp DS4243, DS4246 and DS2246 SAS storage shelf experiences a spurious ID change == Generally it requires either a power cycle of the shelf or a new ESH module. Either one requires a downtime. Netapp DS4243, DS4246 and DS2246 SAS storage shelf experiences a spurious ID change (KB Alerts) - Kamazoy Knowledge Books - IT Support in Birmingham: == NetApp Knowledgebase - How to power down and power up the controllers in a 7-Mode HA-Pair: == https://www.google.com.sb/url?sa=t&rct=j&q=&esrc=s&source=web&cd=4&cad=rja&uact=8&ved=0CDcQFjADahUKEwjy8JT7oKjHAhVF0h4KHcV9DcI&url=https%3A%2F%2Fkb.netapp.com%2Fsupport%2Findex%3Fpage%3Dcontent%26id%3D1010084&ei=frTNVfK5NsWke8X7tZAM&usg=AFQjCNGEZJTW7GV4GkAFcw3RDvL4o0BHKg&bvm=bv.99804247,d.cWw == Flash Pool setting == aggr create aggr_hybrid -t raid_dp -T sas -n 18 -r 18 |
http://mysupport.netapp.com/now/cgi-bin/shelffwdnld.cgi/download/tools/diskshelf/bin/all_shelf_fw#7dot == re: understanding aggregate and lun == http://community.netapp.com/t5/fas-and-v-series-storage-systems-discussions/understanding-aggregate-and-lun/td-p/23326/page/3 == netapp ds4243, ds4246 and ds2246 sas storage shelf experiences a spurious id change == generally it requires either a power cycle of the shelf or a new esh module. either one requires a downtime. netapp ds4243, ds4246 and ds2246 sas storage shelf experiences a spurious id change (kb alerts) - kamazoy knowledge books - it support in birmingham: == netapp knowledgebase - how to power down and power up the controllers in a 7-mode ha-pair: == https://www.google.com.sb/url?sa=t&rct=j&q=&esrc=s&source=web&cd=4&cad=rja&uact=8&ved=0cdcqfjadahukewjy8jt7okjhahvf0h4khcv9dci&url=https%3a%2f%2fkb.netapp.com%2fsupport%2findex%3fpage%3dcontent%26id%3d1010084&ei=frtnvfk5nswke8x7tzam&usg=afqjcngezjtw7gv4gkafcw3rdvl4o0bhkg&bvm=bv.99804247,d.cww == flash pool setting == aggr create aggr_hybrid -t raid_dp -t sas -n 18 -r 18 |
| Line 695: | Line 888: |
| aggr add aggr_hybrid -T ssd | aggr add aggr_hybrid -t ssd |
| Line 700: | Line 893: |
| == Differences between NetApp Flash Cache and Flash Pool == | == differences between netapp flash cache and flash pool == |
| Line 703: | Line 896: |
| = Performance tunning = == Calculating queue depth == https://library.netapp.com/ecmdocs/ECMP12458217/html/GUID-A055B184-0876-4376-9C75-35FE8C9BE832.html == SAN configuration limits == https://library.netapp.com/ecmdocs/ECMP1196793/html/GUID-F664A5DB-CAB3-43FB-9E0A-6E61AEAF8466.html == How to Create and Use Flash Pool == Flash Pool is a new feature in Data ONTAP 8.1.1. Basically, it is a pool of solid state disks (SSD) plus either SATA or SAS disks (but not both SATA and SAS in the same pool). === reate a Flash Pool === Flash Pool is implemented in the Data ONTAP aggregate layer. To construct a Flash Pool, you use the follow three steps and in that order. 1. Create a 64-bit aggregate using either SATA or SAS hard drives as usual (see Figure 1) * aggr create fpAggr -B 64 -t raid_dp -T SATA -r 16 16 2. Enable the aggregate option hybrid_enabled as shown in Figure 2 * aggr options fpAggr hybrid_enabled on 3. Add SSDs into the aggregate created in Step 1 above (Figure 3) * aggr add fpAggr -T SSD 6 === Use the Flash Pool === vol create myVol fpAggr 1t === UR setting === {{{ aggr create aggr_hybrid -t raid_dp -T sas -n 18 -r 18 |
= performance tunning = == calculating queue depth == https://library.netapp.com/ecmdocs/ecmp12458217/html/guid-a055b184-0876-4376-9c75-35fe8c9be832.html == san configuration limits == https://library.netapp.com/ecmdocs/ecmp1196793/html/guid-f664a5db-cab3-43fb-9e0a-6e61aeaf8466.html == how to create and use flash pool == flash pool is a new feature in data ontap 8.1.1. basically, it is a pool of solid state disks (ssd) plus either sata or sas disks (but not both sata and sas in the same pool). === reate a flash pool === flash pool is implemented in the data ontap aggregate layer. to construct a flash pool, you use the follow three steps and in that order. 1. create a 64-bit aggregate using either sata or sas hard drives as usual (see figure 1) * aggr create fpaggr -b 64 -t raid_dp -t sata -r 16 16 2. enable the aggregate option hybrid_enabled as shown in figure 2 * aggr options fpaggr hybrid_enabled on 3. add ssds into the aggregate created in step 1 above (figure 3) * aggr add fpaggr -t ssd 6 === use the flash pool === vol create myvol fpaggr 1t === ur setting === {{{ aggr create aggr_hybrid -t raid_dp -t sas -n 18 -r 18 |
| Line 730: | Line 923: |
| aggr add aggr_hybrid -T ssd | aggr add aggr_hybrid -t ssd |
| Line 735: | Line 928: |
=== differences between netapp flash cache and flash pool === https://bitpushr.wordpress.com/2013/07/30/differences-between-netapp-flash-cache-and-flash-pool/ = Troubleshooting = == received NHT health trigger == Disk 0a.14.23 received NHT health trigger (0x1 0xb 0x5d 0x10) === solution === disk maint start -d 3a.14.13 This will copy the data to a spare, then run tests if ok, it will make the disk a spare, if not it will fail it. * In the end the disk failed and was replaced. aggr status -r aggrXX * Once the disk copy is complete, run: disk maint status === Replace disk === displays the failed disks on the filer: vol status -r Yes, you are correct, if disk is in showing in failed disk, then its good to remove the disk. If you failed it manully then you can again unfail the disk. below is the setps. 1. failed the disk (disk failed <disk name>) 2. remove the failed disk ( disk remove <disk name>) 3. if you want this disk again which you failed manully ( use the command disk unfail <disk name>) 4. If physicall want to see which disk then umber the light (blink_on <disk name>) == aggr status == Find the disk ID of the failed disk by entering the following command: * aggr status -f If the disk does not appear in the list of failed disks, it might be partially failed, with a Rapid RAID Recovery in process. In this case, you should wait until the disk is present in the list of failed disks (which means that the Rapid RAID Recovery process is complete) before removing the disk. Determine the physical location of the disk you want to remove from the output of the aggr status -f command. The location is shown in the columns labeled HA, SHELF, and BAY. Remove the disk from the disk shelf, following the instructions in the hardware guide for your disk shelf model. == FCP wwn == {{{ # storage port show -node clusterB-02 -port 2a # storage bridge show grep -B 13 'Switch Port' SYSCONFIG-A.txt | egrep 'FC Node Name|FC Port Name|FC Host Adapter|Fibre Channel Target Host Adapter|FCVI Host Adapter|Switch Port|FC Nodename|FC Portname' $ pwd /mnt/play/Downloads/Oupai-logs/10.10.98.215 }}} |
Contents
- lab
-
troubleshooting
- Changing the disk shelf ID
- collection autosupport log
- System Fault Led is on (FAS 2240-2)
- too many users logged in! please try again later.
- fri dec 25 15:03:29 cst [ur-2240a:sis.changelog.full:warning]: sis change logging metafile for volume vol1_a is full.
- oncommand system manager error 500 connection refused
- aggr ?
- how to monitor netapp storage systems using snmp
- netapp best practice
-
how to
- initialize setting
- how to add disk shelf to exist netapp
- data ontap basic command please?
- pocket guide for netapp commands
- netapp basic how to
- test failover works
- simulator download
- 7 mode vs cluster mode
- oncommand
- how to determine the disk and shelf firmware version on a controller and verify it is up to date
- iops calc
- perfstat
- upgrade shelf disk firmware
- re: understanding aggregate and lun
- netapp ds4243, ds4246 and ds2246 sas storage shelf experiences a spurious id change
- netapp knowledgebase - how to power down and power up the controllers in a 7-mode ha-pair:
- flash pool setting
- differences between netapp flash cache and flash pool
- performance tunning
- Troubleshooting
lab
http://labondemand.netapp.com/
https://library.netapp.com/ecmdocs/ECMP1136573/html/frameset.html
System Performance Modeler
UP tool
UP Supported Components: cDOT & 7-Mode Storage Controllers, Windows, VMware, Linux, HPUX, AIX, Cisco, Brocade
top 10 qa
https://kb.netapp.com/support/index?page=content&id=4010151
how to find lun wwid
http://www.voleg.info/netapp_serial_to_wwid_converter.html
data ontap simulator requirements
http://mysupport.netapp.com/now/cgi-bin/simulator http://mysupport.netapp.com/now/cgi-bin/simulatorlic8.cgi/download/tools/simulator/ontap/8.1.3/vsim_netapp-7m.tgz
adding disks to a data ontap
SNAPSHOT
Cluster1::> run -node Cluster1-0
Cluster1-01 Cluster1-02
Cluster1::> run -node Cluster1-02
Type 'exit' or 'Ctrl-D' to return to the CLI
Cluster1-02> snap delete -a -f vol0
Deleted vol0 snapshot hourly.5.
Deleted vol0 snapshot hourly.4.
Deleted vol0 snapshot nightly.1.
Deleted vol0 snapshot hourly.3.
Deleted vol0 snapshot hourly.2.
Deleted vol0 snapshot hourly.1.
Deleted vol0 snapshot hourly.0.
Deleted vol0 snapshot nightly.0.
Cluster1-02> snap sched vol0 0 0 0
Cluster1-02> snap autodelete vol0 on
snap autodelete: snap autodelete enabled
Cluster1-02> snap autodelete vol0 target_free_space 35
snap autodelete: snap autodelete configuration options set
Cluster1-02> snap autodelete vol0
snapshot autodelete settings for vol0:
state : on
commitment : try
trigger : volume
target_free_space : 35%
delete_order : oldest_first
defer_delete : user_created
prefix : (not specified)
destroy_list : none
troubleshooting
Changing the disk shelf ID
Steps 1. Turn on the power to the disk shelf if it is not already on. 2. Remove the left end cap to locate the button near the shelf LEDs. 3. Change the first number of the shelf ID by pressing and holding the orange button until the first number on the digital display blinks, which can take up to three seconds. Note: If the ID takes longer than three seconds to blink, press the button again, making sure to press it in all the way. This activates the disk shelf ID programming mode. 4. Press the button to advance the number until you reach the desired number from 0 to 9. The first number continues to blink. 5. Change the second number of the shelf ID by pressing and holding the button until the second number on the digital display blinks, which can take up to three seconds. The first number on the digital display stops blinking. 6. Press the button to advance the number until you reach the desired number from 1 to 9. The second number continues to blink. 7. Lock in the desired number and exit the programming mode by pressing and holding the button until the second number stops blinking, which can take up to three seconds. Both numbers on the digital display start blinking and the amber LED on the operator display panel illuminates after about five seconds, alerting you that the pending disk shelf ID has not yet 8. Power cycle the disk shelf to make the shelf ID take effect.
collection autosupport log
- Display the health status of the system, which reflects the overall status of individual health monitors
system health status show
- Display the health status of subsystems for which health monitoring is available
system health subsystem show
- node run -node local sysconfig -a
收集ASUP log，执行下面的命令就可以了，log就会产生。 system node autosupport invoke -node * -type all -uri file:///mroot/etc/log/case_number-asup.7z 存储的管理IP后面跟 /SPI，然后输入admin账号密码 https://x.x.x.x/spi/ log的路径是 /etc/log/case_number-asup.7z
System Fault Led is on (FAS 2240-2)
We opened a case for this issue. Support sent to me the 7-step process below to resolve the issue with the system fault LEDs:
1. At the Data ONTAP CLI prompt, issue the “halt –s” command. Please note that this will cause an HA takeover in an HA configuration.
2. Wait for the controller to shut down and power off.
3. On the console port (not RSH, SSH, etc.), issue a “^G”(ctrl G)to switch the console to the SP.
4. Log in to the SP.
5. At the SP prompt, issue the “system power on” command.
6. Issue a “^D”(ctrl D)to get back to the Data ONTAP console.
7. Once the BIOS / Loader have booted, issue the “boot_ontap” command.
8. Issue Giveback after Takeover.
After following the 7-step process, the issue has been solved
Regards,http://vipulvajpayeestorage.blogspot.com/2012/04/netapp-fas-2240-storage-showing-pcm.html
too many users logged in! please try again later.
http://nayabrasools.blogspot.com/2013/08/netapp-too-many-users-logged-in-please.html
可能是其他人有登入，則請其他人先退出 或是登入後因為網路不穩，造成連線不正常中斷，此時就必須要等timeout時間一到，才可以再登入 另外可以嘗試透過rsh重啟telnet 或是ssh服務來解決這個問題 首先確定netapp 的rsh 是否有開啟 找一台client測試以下指令 client# rsh filer_ip -l root@password df 如果有正常回應的話 輸入 client# rsh filer_ip -l root@password "options ssh.enable off" client# rsh filer_ip -l root@password "options ssh.enable on" 或是 client# rsh filer_ip -l root@password "options telnet.enable off" client# rsh filer_ip -l root@password "options telnet.enable on" 即可
rsh 192.168.0.192 -l root:xx sysconfig -a rsh <filername> -l root:<password> logout telnet
fri dec 25 15:03:29 cst [ur-2240a:sis.changelog.full:warning]: sis change logging metafile for volume vol1_a is full.
oncommand system manager error 500 connection refused
tls is disabled by default on the storage controllers. it must be explicitly enabled to enable tls, run the following command via the shell:
options tls.enable on
that should do it.
aggr ?
for volumes - you can't have a flexible volume without an aggregate. flex vols
- are logical, aggregates are physical. you layer one or more flex vols on top (in side) of an aggregate
how to monitor netapp storage systems using snmp
https://kb.netapp.com/support/index?page=content&id=1011225&pmv=print&impressions=false
netapp best practice
as the best practice, netapp now recommends to set fractional reserve and snap reserve for your volumes to 0%. don’t forget about that, if you want to save more storage space:
> vol options “targetvol” fractional_reserve 0
> snap reserve “targetvol” 0
disable snapshots if you don’t use them:
> snap sched “targetvol” 0
how to
initialize setting
http://www.getshifting.com/wiki/netappchangeip
how to add disk shelf to exist netapp
http://www.cosonok.com/2013/03/how-to-hot-add-ds4243-shelf-quick-guide.html
- how to add a new disk shelf to a netapp filer ?? assumption:- filer has already one disk shelf connected this is the new one which has to be added and cabled. cables required:- two sas cables , two acp (cat6 ethernet ) cables if any
1. rack the shelf
2. connect power cables & turn the shelf on (wait about 30 seconds)
3. on the front of the shelf, change the shelf id to something unique. (try and keep it sequential with the shelf that's already there) do not use "00"
4. wait about 45 seconds and then restart the shelf and make sure the new shelf id came up.
5. ssh into both filers and do "options disk.auto_assign off"
6. do a "storage show disk -p" on both controllers and copy the contents into a txt file and save it. (run this command again and make sure all your disks are still there)
7. do a "options autosupport.doit "before shelf add"" on both controllers since i'm scared your doing this via community forums. ("before shelf add" is in quotes on the command)
8. now for the fun part, take a sas cable and plug one end into the top circle of the old shelf and plug it in the bottom square of the
- new shelf
9. now take another sas cable and plug one end into the bottom circle of the old shelf and plug it into the top square of the new shelf
10. assign your disks and don't forget to turn back on disk auto assign when you're done.
11. run "storage show disk -p" and make sure all of your old disks are there.
(shelves at the end of a stack are always reversed, this is a special circumstance and you will not cable all shelves like this in the future. http://nayabrasools.blogspot.com/2012/10/how-to-add-new-disk-shelf-to-netapp.html
data ontap basic command please?
- this post contains the list of commands that will be most used
and will come handy when managing or monitoring or troubleshooting a netapp filer.
sysconfig -a : shows hardware
configuration with more verbose information
sysconfig -d :
shows information of the disk attached to the filer
version : shows the
netapp ontap os version.
uptime : shows the
filer uptime
dns info : this
shows the dns resolvers, the no of hits and misses and other info
nis info : this
shows the nis domain name, yp servers etc.
rdfile : like
"cat" in linux, used to read contents of text files/
wrfile :
creates/overwrites a file. similar to "cat > filename" in linux
aggr status : shows
the aggregate status
aggr status -r :
shows the raid configuration, reconstruction information of the disks in filer
aggr show_space :
shows the disk usage of the aggreate, wafl reserve, overheads etc.
vol status : shows
the volume information
vol status -s :
displays the spare disks on the filer
vol status -f :
displays the failed disks on the filer
vol status -r :
shows the raid configuration, reconstruction information of the disks
df -h : displays
volume disk usage
df -i : shows the inode
counts of all the volumes
df -ah : shows
"df" information of the aggregate
license :
displays/add/removes license on a netapp filer
maxfiles : displays
and adds more inodes to a volume
aggr create :
creates aggregate
vol create
<volname> <aggrname> <size> : creates volume in an aggregate
vol offline
<volname> : offlines a volume
vol online
<volname> : onlines a volume
vol destroy
<volname> : destroys and removes an volume
vol size
<volname> [+|-]<size> : resize a volume in netapp filer
vol options : displays/changes
volume options in a netapp filer
qtree create
<qtree-path> : creates qtree
qtree status :
displays the status of qtrees
quota on : enables
quota on a netapp filer
quota off :
disables quota
quota resize :
resizes quota
quota report :
reports the quota and usage
snap list :
displays all snapshots on a volume
snap create
<volname> <snapname> : create snapshot
snap sched
<volname> <schedule> : schedule snapshot creation
snap reserve
<volname> <percentage> : display/set snapshot reserve space in volume
/etc/exports : file
that manages the nfs exports
rdfile /etc/exports
: read the nfs exports file
wrfile /etc/exports
: write to nfs exports file
exportfs -a :
exports all the filesystems listed in /etc/exports
cifs setup : setup
cifs
cifs shares : create/displays
cifs shares
cifs access :
changes access of cifs shares
lun create :
creates iscsi or fcp luns on a netapp filer
lun map : maps lun
to an igroup
lun show : show all
the luns on a filer
igroup create :
creates netapp igroup
lun stats : show lun
i/o statistics
disk show : shows
all the disk on the filer
disk zero spares :
zeros the spare disks
disk_fw_update :
upgrades the disk firmware on all disks
options :
display/set options on netapp filer
options nfs :
display/set nfs options
options timed :
display/set ntp options on netapp.
options autosupport
: display/set autosupport options
options cifs :
display/set cifs options
options tcp :
display/set tcp options
options net :
display/set network options
ndmpcopy
<src-path> <dst-path> : initiates ndmpcopy
ndmpd status :
displays status of ndmpd
ndmpd killall :
terminates all the ndmpd processes.
ifconfig :
displays/sets ip address on a network/vif interface
vif create :
creates a vif (bonding/trunking/teaming)
vif status :
displays status of a vif
netstat : displays
network statistics
sysstat -us 1 : begins a 1
second sample of the filer's current utilization (crtl - c to end)
nfsstat : shows nfs
statistics
nfsstat -l :
displays nfs stats per client
nfs_hist : displays
nfs historgram
statit : beings/ends a
performance workload sampling [-b starts / -e ends]
stats : displays
stats for every counter on netapp. read stats man page for more info
ifstat : displays
network interface stats
qtree stats :
displays i/o stats of qtree
environment : display
environment status on shelves and chassis of the filer
storage show
<disk|shelf|adapter> : shows storage component details
snapmirror
intialize : initialize a snapmirror relation
snapmirror update :
manually update snapmirror relation
snapmirror resync :
resyns a broken snapmirror
snapmirror quiesce
: quiesces a snapmirror bond
snapmirror break :
breakes a snapmirror relation
snapmirror abort :
abort a running snapmirror
snapmirror status :
shows snapmirror status
lock status -h :
displays locks held by filer
sm_mon : manage the
locks
storage download
shelf : installs the shelf firmware
software get :
download the netapp os software
software install :
installs os
download : updates
the installed os
cf status :
displays cluster status
cf takeover : takes
over the cluster partner
cf giveback : gives
back control to the cluster partner
reboot : reboots a
filer
pocket guide for netapp commands
this post contains the list of commands that will be most used and will come handy when managing or monitoring or troubleshooting a netapp filer.
sysconfig -a : shows hardware
configuration with more verbose information
sysconfig -d :
shows information of the disk attached to the filer
version : shows the
netapp ontap os version.
uptime : shows the
filer uptime
dns info : this
shows the dns resolvers, the no of hits and misses and other info
nis info : this
shows the nis domain name, yp servers etc.
rdfile : like
"cat" in linux, used to read contents of text files/
wrfile :
creates/overwrites a file. similar to "cat > filename" in linux
aggr status : shows
the aggregate status
aggr status -r :
shows the raid configuration, reconstruction information of the disks in filer
aggr show_space :
shows the disk usage of the aggreate, wafl reserve, overheads etc.
vol status : shows
the volume information
vol status -s :
displays the spare disks on the filer
vol status -f :
displays the failed disks on the filer
vol status -r :
shows the raid configuration, reconstruction information of the disks
df -h : displays
volume disk usage
df -i : shows the inode
counts of all the volumes
df -ah : shows
"df" information of the aggregate
license :
displays/add/removes license on a netapp filer
maxfiles : displays
and adds more inodes to a volume
aggr create :
creates aggregate
vol create
<volname> <aggrname> <size> : creates volume in an aggregate
vol offline
<volname> : offlines a volume
vol online
<volname> : onlines a volume
vol destroy
<volname> : destroys and removes an volume
vol size
<volname> [+|-]<size> : resize a volume in netapp filer
vol options : displays/changes
volume options in a netapp filer
qtree create
<qtree-path> : creates qtree
qtree status :
displays the status of qtrees
quota on : enables
quota on a netapp filer
quota off :
disables quota
quota resize :
resizes quota
quota report :
reports the quota and usage
snap list :
displays all snapshots on a volume
snap create
<volname> <snapname> : create snapshot
snap sched
<volname> <schedule> : schedule snapshot creation
snap reserve
<volname> <percentage> : display/set snapshot reserve space in volume
/etc/exports : file
that manages the nfs exports
rdfile /etc/exports
: read the nfs exports file
wrfile /etc/exports
: write to nfs exports file
exportfs -a :
exports all the filesystems listed in /etc/exports
cifs setup : setup
cifs
cifs shares : create/displays
cifs shares
cifs access :
changes access of cifs shares
lun create :
creates iscsi or fcp luns on a netapp filer
lun map : maps lun
to an igroup
lun show : show all
the luns on a filer
igroup create :
creates netapp igroup
lun stats : show lun
i/o statistics
disk show : shows
all the disk on the filer
disk zero spares :
zeros the spare disks
disk_fw_update :
upgrades the disk firmware on all disks
options :
display/set options on netapp filer
options nfs :
display/set nfs options
options timed :
display/set ntp options on netapp.
options autosupport
: display/set autosupport options
options cifs :
display/set cifs options
options tcp :
display/set tcp options
options net :
display/set network options
ndmpcopy
<src-path> <dst-path> : initiates ndmpcopy
ndmpd status :
displays status of ndmpd
ndmpd killall :
terminates all the ndmpd processes.
ifconfig :
displays/sets ip address on a network/vif interface
vif create :
creates a vif (bonding/trunking/teaming)
vif status :
displays status of a vif
netstat : displays
network statistics
sysstat -us 1 : begins a 1
second sample of the filer's current utilization (crtl - c to end)
nfsstat : shows nfs
statistics
nfsstat -l :
displays nfs stats per client
nfs_hist : displays
nfs historgram
statit : beings/ends a
performance workload sampling [-b starts / -e ends]
stats : displays
stats for every counter on netapp. read stats man page for more info
ifstat : displays
network interface stats
qtree stats :
displays i/o stats of qtree
environment : display
environment status on shelves and chassis of the filer
storage show
<disk|shelf|adapter> : shows storage component details
snapmirror
intialize : initialize a snapmirror relation
snapmirror update :
manually update snapmirror relation
snapmirror resync :
resyns a broken snapmirror
snapmirror quiesce
: quiesces a snapmirror bond
snapmirror break :
breakes a snapmirror relation
snapmirror abort :
abort a running snapmirror
snapmirror status :
shows snapmirror status
lock status -h :
displays locks held by filer
sm_mon : manage the
locks
storage download
shelf : installs the shelf firmware
software get :
download the netapp os software
software install :
installs os
download : updates
the installed os
cf status :
displays cluster status
cf takeover : takes
over the cluster partner
cf giveback : gives
back control to the cluster partner
reboot : reboots a
filervperumal former netapp employee http://community.netapp.com/t5/data-ontap-discussions/data-ontap-basic-command-please/td-p/59641
netapp basic how to
lun create & map
1, fcp wwpn-alias set alias_name wwpn
2,igroup create -i -t windows_2008 win-group0 alias_name,1,2,3
igroup create -f -t aix ibm_p720 ibm_p720a ibm_p720b igroup create -f -t windows image 198.0.0.10 igroup add initialtor_group nodename/alias_name
3, n6060a>
vol create ibm_p720 aggr0a 330g vol create image aggr0a 2448g vol create data aggr0a 900g vol create chjbak aggr0b 900g snap reserve ibm_p720 0
4, lun create -s size -t ostype lun_path (lun show)
lun create -s 5g -t aix /vol/ibm_p720/crs01 lun create -s 5g -t aix /vol/ibm_p720/crs02 lun create -s 5g -t aix /vol/ibm_p720/crs03 lun create -s 100g -t aix /vol/ibm_p720/data01 lun create -s 100g -t aix /vol/ibm_p720/data02 lun create -s 100g -t aix /vol/ibm_p720/data03 lun create -s 898g -t windows /vol/chjbak/chjbak01 lun create -s 2048g -t windows_2008 /vol/image/image01 lun create -s 400g -t windows_2008 /vol/image/image02
5, lun map lun_path initialtor_group/alias_name
n6060a> fcp wwpn-alias show wwpn alias ---- ----- 10:00:00:90:fa:09:34:87 198.0.0.221 10:00:00:90:fa:09:37:de 198.0.0.222 10:00:00:90:fa:09:35:b6 198.0.0.223 10:00:00:00:c9:88:9b:4b ibm_p720a 10:00:00:00:c9:7a:14:35 ibm_p720b 10:00:00:00:c9:e0:b0:12 198.0.0.10 21:00:00:1b:32:90:4e:63 198.0.0.152 lun map /vol/ibm_p720/crs01 ibm_p720 lun map /vol/ibm_p720/crs02 ibm_p720 lun map /vol/ibm_p720/crs03 ibm_p720 lun map /vol/ibm_p720/data01 ibm_p720 lun map /vol/ibm_p720/data02 ibm_p720 lun map /vol/ibm_p720/data03 ibm_p720 lun map /vol/image/image01 198.0.0.10 lun map /vol/image/image02 198.0.0.10
notes
- sysconfig -a : shows hardware aggr status aggr status -r aggr show_space vol status -s vol status -r lun stats
test failover works
1, cf takeover
2, cf status filer x has taken over filer y.
3, cf status filer x is ready for giveback. partner ifconfig -a partner vfiler status
4, vol status
- aggr status
n6060b(takeover) partner
- vol status aggr status
cf giveback cf giveback -f
simulator download
http://mysupport.netapp.com/now/cgi-bin/simulator
7 mode vs cluster mode
最开始的ｄata ontap 借鉴了最早的开源unix之一的bsd net/2许多代码，包括 tcp/ip 堆栈、启动代码、设备驱动等，后来的data ontap也从其他的开源unix借鉴了大量的代码。至于命令行接口是netapp仿unix独立开发的,另外wafl文件系统与raid代码及磁盘子系统为netapp自己开发的所以与unix的完全不同。
一开始dataontap没有什么mode之分的，netapp收购了spinnaker之后基于freebsd把dataontap与spinnaker的软件重新整合出另一个叫data ontap gx的操作系统来，当data ontap更新至8.0版本后，netapp统一了二者的版本号,并把原生的dataontap称为7 mode, 后来的data ontap gx则称为 cluster mode,简称为c mode。
由于新的dataontap cluster mode功能一直不够完善，netapp一直同时开发着7 mode 和cluster mode两个操作系统，不过随着netapp大力推广和开发cluster mode，相信很快就会停止开发7 mode只有cluste mode了。目前（data ontap 8.1.1）二者功能上的区别如下：
cluster-mode only
−clustered scaleout (24-nas: 4-san) （多节点集群，如果提供san则一个集群最多4个节点）
−namespace （统一命名空间）
−nondisruptive operations （节点间平滑迁移volume或lun）
−management as single system （统一管理整个集群）
−scalable and integrated multi-tenancy （可扩展及多租户）
−nfs v4, v4.1 (pnfs); smb 2.0, 2.1
−onboard antivirus
7-mode only −snaplock® −snapvault® and ossv −qtree and synchronous snapmirror −metrocluster™ −vfiler® −flexshare® −ipv6, http, ftp, sftp, tftp both 7-mode and cluster-mode −unified architecture −storage efficiency features 和（重复数据删除与压缩） −snapshot™ copies and asynchronous volume snapmirror® −intelligent caching with flash cache
oncommand
http://mysupport.netapp.com/now/cgi-bin/software/ http://community.netapp.com/t5/oncommand-storage-management-software-discussions/operations-manager-core-free-license-available/td-p/61964
how to determine the disk and shelf firmware version on a controller and verify it is up to date
https://kb.netapp.com/index?page=content&id=1010762&actp=list_popular https://kb.netapp.com/support/index?page=content&id=1011673&actp=list_recent
iops calc
the shot analysis of netapp fas8040 (2-node, c-mode) spc-1 results | storage news:
perfstat
- enable rsh
options rsh.enable on
Hi,
These are the commands I use to troubleshoot performance issues:
always start with "priv set diag"
sysstat -M -i 5
--> already explained
sysstat -x 5
--> shows you the different I/O ("Disk util" is an importend one and also "CPty" see
http://now.netapp.com/NOW/knowledge/docs/ontap/rel707/html/ontap/cmdref/man1/na_sysstat.1.html)
lun stats -i 5
--> shows you the read / write / latency's of luns
stats show lun
--> shows you detailed info of every lun (you will want to capture this in an output file)
stats show volume
--> same as lun but now for the volumes (you will want to capture this in an output file)
reallocate status
--> shows if any reallocation jobs are running (walf scan status shows you even more info)
If this is not enough you can get some info with statit
a "statit -b" will start the data collection (wait a few minutes)
a "statit -e" will stop the collection and will give you the result. (you will want this to capture in an
output file)https://latx.netapp.com/summary/id/323525
upgrade shelf disk firmware
re: understanding aggregate and lun
netapp ds4243, ds4246 and ds2246 sas storage shelf experiences a spurious id change
generally it requires either a power cycle of the shelf or a new esh module. either one requires a downtime.
netapp ds4243, ds4246 and ds2246 sas storage shelf experiences a spurious id change (kb alerts) - kamazoy knowledge books - it support in birmingham:
netapp knowledgebase - how to power down and power up the controllers in a 7-mode ha-pair:
flash pool setting
aggr create aggr_hybrid -t raid_dp -t sas -n 18 -r 18 aggr option aggr_hybrid hybrid_enabled on aggr add aggr_hybrid -t ssd
priority hybrid-cache set aggr_hybrid read-cache=random-read priority hybrid-cache set aggr_hybrid write-cache=random-write
differences between netapp flash cache and flash pool
https://bitpushr.wordpress.com/2013/07/30/differences-between-netapp-flash-cache-and-flash-pool/
performance tunning
calculating queue depth
https://library.netapp.com/ecmdocs/ecmp12458217/html/guid-a055b184-0876-4376-9c75-35fe8c9be832.html
san configuration limits
https://library.netapp.com/ecmdocs/ecmp1196793/html/guid-f664a5db-cab3-43fb-9e0a-6e61aeaf8466.html
how to create and use flash pool
flash pool is a new feature in data ontap 8.1.1. basically, it is a pool of solid state disks (ssd) plus either sata or sas disks (but not both sata and sas in the same pool).
reate a flash pool
- flash pool is implemented in the data ontap aggregate layer. to construct a flash pool, you use the follow three steps and in that order.
- create a 64-bit aggregate using either sata or sas hard drives as usual (see figure 1)
* aggr create fpaggr -b 64 -t raid_dp -t sata -r 16 16
- enable the aggregate option hybrid_enabled as shown in figure 2
* aggr options fpaggr hybrid_enabled on
- add ssds into the aggregate created in step 1 above (figure 3)
* aggr add fpaggr -t ssd 6
use the flash pool
vol create myvol fpaggr 1t
ur setting
aggr create aggr_hybrid -t raid_dp -t sas -n 18 -r 18 aggr option aggr_hybrid hybrid_enabled on aggr add aggr_hybrid -t ssd priority hybrid-cache set aggr_hybrid read-cache=random-read priority hybrid-cache set aggr_hybrid write-cache=random-write
differences between netapp flash cache and flash pool
https://bitpushr.wordpress.com/2013/07/30/differences-between-netapp-flash-cache-and-flash-pool/
Troubleshooting
received NHT health trigger
Disk 0a.14.23 received NHT health trigger (0x1 0xb 0x5d 0x10)
solution
disk maint start -d 3a.14.13
This will copy the data to a spare, then run tests
if ok, it will make the disk a spare, if not it will fail it.
* In the end the disk failed and was replaced.
aggr status -r aggrXX
* Once the disk copy is complete, run:
disk maint status
Replace disk
displays the failed disks on the filer:
vol status -r
Yes, you are correct, if disk is in showing in failed disk, then its good to remove the disk. If you failed it manully then you can again unfail the disk. below is the setps.
failed the disk (disk failed <disk name>)
remove the failed disk ( disk remove <disk name>)
if you want this disk again which you failed manully ( use the command disk unfail <disk name>)
If physicall want to see which disk then umber the light (blink_on <disk name>)
aggr status
- Find the disk ID of the failed disk by entering the following command:
- aggr status -f
FCP wwn
# storage port show -node clusterB-02 -port 2a # storage bridge show grep -B 13 'Switch Port' SYSCONFIG-A.txt | egrep 'FC Node Name|FC Port Name|FC Host Adapter|Fibre Channel Target Host Adapter|FCVI Host Adapter|Switch Port|FC Nodename|FC Portname' $ pwd /mnt/play/Downloads/Oupai-logs/10.10.98.215