Topology

11.11.11.11
    +---+
    |PC1|
    +-+-+
      |
11.11.11.1
   +--+---+             +------+
   |      +-------------+  R1  |
   |2811-01      2.1/30 |2811  |
   +------+             +---+--+
 192.168.2.2/30             |26.26.26.1/24
                            |
                           ISP 路由可达即可
                            |
                          +-+-+
                          |PC2|
                          +---+
                             22.22.22.22

完整阅读

All methods are summarized from my own CASE, base on the same method, you can find other OID E.g: transceiver temperatures, fan speed and so on. If have other special OID, I will add to the article. At first, what is OID? You can check follow PIC:

Useful Tools

Commands:

Windows: You can install Net-SNMP, then support SNMP command.

MAC OS: Native support SNMP command.

PS：SNMPv3需要经过认证才能进行snmpwalk，如下是example：

$ snmpwalk -v3 -l authPriv -u Monitor -a MD5 -A "passtest" -x DES -X "passtest" x.x.x.x oid

Graphics Tools

Refer to graphics tools, you can use free software “iReasoning MIB Browser”, that support load 5 MIB, and support for Win and MAC.

Support Tools

SNMP Object Navigator

CPU OID Get

1. C:\Users\yonzhao2>snmpwalk -v2c -c cisco 10.75.49.17 1.3.6.1.2.1.47.1.1.1.1.7

SNMPv2-SMI::mib-2.47.1.1.1.1.7.22353429 = STRING: "module 0/5/CPU0"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.38557239 = STRING: "module 0/RSP0/CPU0"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.49175796 = STRING: "module 0/6/CPU0"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.52299895 = STRING: "module 0/6/CPU0“

2. C:\Users\yonzhao2>snmpwalk -v2c -c cisco 10.75.49.17 .1.3.6.1.4.1.9.9.109.1.1.1.1.2

SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.66 = INTEGER: 38557239
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.2162 = INTEGER: 7571408
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.2178 = INTEGER: 52299895

Follow is N5k describes:

YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.3 1.3.6.1.4.1.9.9.109.1.1.1.1.2
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.1 = INTEGER: 4109
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.33 = INTEGER: 4107
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.257 = INTEGER: 8205
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.289 = INTEGER: 8203
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.4097 = INTEGER: 110605
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.4129 = INTEGER: 110603
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.8225 = INTEGER: 86027
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.8481 = INTEGER: 90123
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.8737 = INTEGER: 94219
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.8993 = INTEGER: 98315
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.9249 = INTEGER: 102411
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.9505 = INTEGER: 106507
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.49185 = INTEGER: 118795
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.2.49441 = INTEGER: 122891

YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.3 1.3.6.1.2.1.47.1.1.1.1.7 |grep 4109
SNMPv2-SMI::mib-2.47.1.1.1.1.7.4109 = STRING: "0/0-Virtual processor for RP XR"
YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.3 1.3.6.1.2.1.47.1.1.1.1.7 |grep 4107
SNMPv2-SMI::mib-2.47.1.1.1.1.7.4107 = STRING: "0/0-Virtual processor for admin"
YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.3 1.3.6.1.2.1.47.1.1.1.1.7 |grep 8205
SNMPv2-SMI::mib-2.47.1.1.1.1.7.8205 = STRING: "0/1-Virtual processor for RP XR"
YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.3 1.3.6.1.2.1.47.1.1.1.1.7 |grep 8203
SNMPv2-SMI::mib-2.47.1.1.1.1.7.8203 = STRING: "0/1-Virtual processor for admin"
YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.3 1.3.6.1.2.1.47.1.1.1.1.7 |grep 110605
SNMPv2-SMI::mib-2.47.1.1.1.1.7.110605 = STRING: "0/RP0-Virtual processor for RP XR"
YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.3 1.3.6.1.2.1.47.1.1.1.1.7 |grep 110603
SNMPv2-SMI::mib-2.47.1.1.1.1.7.110603 = STRING: "0/RP0-Virtual processor for admin"
YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.3 1.3.6.1.2.1.47.1.1.1.1.7 |grep 86027
SNMPv2-SMI::mib-2.47.1.1.1.1.7.86027 = STRING: "0/FC0-Virtual processor for admin"
YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.3 1.3.6.1.2.1.47.1.1.1.1.7 |grep 90123
SNMPv2-SMI::mib-2.47.1.1.1.1.7.90123 = STRING: "0/FC1-Virtual processor for admin"
YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.3 1.3.6.1.2.1.47.1.1.1.1.7 |grep 94219
SNMPv2-SMI::mib-2.47.1.1.1.1.7.94219 = STRING: "0/FC2-Virtual processor for admin"
YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.3 1.3.6.1.2.1.47.1.1.1.1.7 |grep 98315
SNMPv2-SMI::mib-2.47.1.1.1.1.7.98315 = STRING: "0/FC3-Virtual processor for admin"

3. We can see RP0 CPU MIB is mib-2.47.1.1.1.1.7.38557239, while 38557239 correspond to enterprises.9.9.109.1.1.1.1.2.66

   - -- cpmCPUTotalTable (1)
      |
       - -- cpmCPUTotalEntry (1)
         | --   cpmCPUTotalIndex (1)
         | --   cpmCPUTotalPhysicalIndex (2) object Details
         | --   cpmCPUTotal5secRev (6)
         | --   cpmCPUTotal1minRev (7)

4. Base on the above trees, try to find exact OID enterprises.9.9.109.1.1.1.1.x.66 we can see enterprises.9.9.109.1.1.1.1.8.66 refer to the RP0 CPU usage, Eg:

C:\Users\yonzhao2>snmpwalk -v2c -c cisco 10.75.49.17 enterprises.9.9.109.1.1.1.1.8.66
SNMPv2-SMI::enterprises.9.9.109.1.1.1.1.8.66 = Gauge32: 4 >>> 5 minutes

Follow MIB Browser analyzing result:

Temperatures OID Get

1. C:\>snmpwalk -v2c -c cisco 10.75.49.17 1.3.6.1.2.1.47.1.1.1.1.7

SNMPv2-SMI::mib-2.47.1.1.1.1.7.28783653 = STRING: "temperature 0/RSP0/CPU0"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.45561266 = STRING: "temperature 0/RSP0/CPU0“

2. Find the mapping relation, same value 38557239 that indicate two sensors in the same slot

C:\>snmpwalk -v2c -c cisco 10.75.49.17 1.3.6.1.2.1.47.1.1.1.1.4
SNMPv2-SMI::mib-2.47.1.1.1.1.4.28783653 = INTEGER: 38557239
SNMPv2-SMI::mib-2.47.1.1.1.1.4.45561266 = INTEGER: 38557239

3. Get sensor name description

C:\Users\yonzhao2>snmpwalk -v2c -c cisco 10.75.49.17 1.3.6.1.2.1.47.1.1.1.1.2
SNMPv2-SMI::mib-2.47.1.1.1.1.2.28783653 = STRING: "Hot Temperature SensorHotspot0"
SNMPv2-SMI::mib-2.47.1.1.1.1.2.45561266 = STRING: "Inlet Temperature SensorInlet0“

4. Get temperature value

C:\Users\yonzhao2>snmpwalk -v2c -c cisco 10.75.49.17 1.3.6.1.4.1.9.9.91.1.1.1.1.4.28783653
SNMPv2-SMI::enterprises.9.9.91.1.1.1.1.4.28783653 = INTEGER: 379
C:\Users\yonzhao2>snmpwalk -v2c -c cisco 10.75.49.17 1.3.6.1.4.1.9.9.91.1.1.1.1.4.45561266
SNMPv2-SMI::enterprises.9.9.91.1.1.1.1.4.45561266 = INTEGER: 250

5. Check information:

RP/0/RSP0/CPU0:ASR9K-1# show environment temperatures
Tue Aug 21 01:45:42.330 UTC
R/S/I   Modules Sensor            (deg C)
0/RSP0/*
        host    Inlet0             25.0
        host    Hotspot0           37.9

Follow MIB Browser analyzing result:

Interface Input/Output Rate OID Get

We couldn’t direct get the input/output rate by OID, but we can get the total input/output byte, then calculate the average rate. As the follow example:

RP/0/RP0/CPU0:HK-HK#show int tenGigE 0/3/0/1 | in packets
Wed Dec 25 15:46:00.223 GMT
  30 second input rate 1392790000 bits/sec, 359663 packets/sec
  30 second output rate 3284104000 bits/sec, 485129 packets/sec
     3948749701 packets input, 1922601093239 bytes, 0 total input drops
     5353048351 packets output, 4591216874548 bytes, 0 total output drops

RP/0/RP0/CPU0:HK-HK#show int tenGigE 0/3/0/1 | in packets
Wed Dec 25 15:47:00.276 GMT
  30 second input rate 1419539000 bits/sec, 360974 packets/sec
  30 second output rate 3330562000 bits/sec, 480283 packets/sec
     3970580990 packets input, 1933354797631 bytes, 0 total input drops
     5382021312 packets output, 4616287298982 bytes, 0 total output drops

>>> (4616287298982-4591216874548)*8/60 = 3,342,723,257.8 = 3.342G

How to get totally byte? Use “1.3.6.1.2.1.31.1.1.1.10“

yonzhao2-mac:python zhaoyong$ snmpwalk -v2c -c cisco 10.75.41.73 1.3.6.1.2.1.31.1.1.1.1 |grep 0/15/5/0
IF-MIB::ifName.34 = STRING: TenGigE0/15/5/0
IF-MIB::ifName.59 = STRING: tunnel-te1
yonzhao2-mac:python zhaoyong$ 
yonzhao2-mac:python zhaoyong$ snmpwalk -v2c -c cisco 10.75.41.73 1.3.6.1.2.1.31.1.1.1.10.34
IF-MIB::ifHCOutOctets.34 = Counter64: 1528125340524

Fan speed OID Get

1. Check speed sensor’s index:

yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.13.15 1.3.6.1.2.1.47.1.1.1.1.7 |grep speed
SNMPv2-SMI::mib-2.47.1.1.1.1.7.6869781 = STRING: "speed 0/FT1/SP"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.11741762 = STRING: "speed 0/FT1/SP"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.13443524 = STRING: "speed 0/FT1/SP"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.13805629 = STRING: "speed 0/FT0/SP"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.15177601 = STRING: "speed 0/FT0/SP"

2. Get sensor’s value:

yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.13.15 1.3.6.1.4.1.9.9.91.1.1.1.1.4.6869781
SNMPv2-SMI::enterprises.9.9.91.1.1.1.1.4.6869781 = INTEGER: 8490
yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.13.15 1.3.6.1.4.1.9.9.91.1.1.1.1.4.11741762
SNMPv2-SMI::enterprises.9.9.91.1.1.1.1.4.11741762 = INTEGER: 8550
yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.13.15 1.3.6.1.4.1.9.9.91.1.1.1.1.4.13443524
SNMPv2-SMI::enterprises.9.9.91.1.1.1.1.4.13443524 = INTEGER: 8460

3. Show fans speed in 9k:

RP/0/RSP0/CPU0:ASR9006-4#admin show environment fans 
Mon Nov  3 14:24:16.456 GMT
  Fan speed (rpm) and run time (in hours) :
        FAN0    FAN1    FAN2    FAN3    FAN4    FAN5

0/FT0/* (Speed) 
        8430    8400    8430    8430    8430    8400

Memory OID Get

Physical memory <= 4G

1. Check memory use by “cempMemPoolUsed”, you can found location is “7858209”

yonzhao2-:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.110 1.3.6.1.4.1.9.9.221.1.1.1.1.7
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.7.7858209.1 = Gauge32: 1222515685
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.7.7858209.2 = Gauge32: 163311616
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.7.7858209.3 = Gauge32: 32756764

2. Check memory free by “cempMemPoolFree”, you can found location not change

yonzhao2-:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.110 1.3.6.1.4.1.9.9.221.1.1.1.1.8
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.8.7858209.1 = Gauge32: 2794577920
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.8.7858209.2 = Gauge32: 69480448
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.8.7858209.3 = Gauge32: 0

3. Check what’s location id:

yonzhao2-:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.110 .1.3.6.1.2.1.47.1.1.1.1.7 | grep 7858209
SNMPv2-SMI::mib-2.47.1.1.1.1.7.7858209 = STRING: "0/RP0/* - cpu"

4. Check what is .1, .2 and .3 mean by “cempMemPoolName”:

yonzhao2-:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.110 1.3.6.1.4.1.9.9.221.1.1.1.1.3
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.3.7858209.1 = STRING: "processor"
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.3.7858209.2 = STRING: "reserved"
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.3.7858209.3 = STRING: "image“

5. Follow is cempMemPoolType:

yonzhao2-:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.49.110 1.3.6.1.4.1.9.9.221.1.1.1.1.2
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.2.7858209.1 = INTEGER: 2
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.2.7858209.2 = INTEGER: 11
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.2.7858209.3 = INTEGER: 12

1:other
2:processorMemory
3:ioMemory
4:pciMemory
5:fastMemory
6:multibusMemory
7:interruptStackMemory
8:processStackMemory
9:localExceptionMemory
10:virtualMemory
11:reservedMemory
12:imageMemory
13:asicMemory
14:posixMemory

Physical memory > 4G

When physical memory greater than 4G, you need use follow OID to get use and free memory:

cempMemPoolHCUsed: .1.3.6.1.4.1.9.9.221.1.1.1.1.18 cempMemPoolHCFree: .1.3.6.1.4.1.9.9.221.1.1.1.1.20

Follow example for NCS6008:

RP/0/RP1/CPU0:pani#sh platform
Mon Aug 11 07:55:19.193 CEST
Node name         Node type             Node state       Admin state   Config state
-----------------------------------------------------------------------------------
0/0               NC6-10X100G-M-P       OPERATIONAL      UP            NSHUT
0/0/NPU0          Slice                 UP               UP            
0/0/NPU1          Slice                 UP               UP            
0/0/NPU2          Slice                 UP               UP            
0/0/NPU3          Slice                 UP               UP            
0/0/NPU4          Slice                 UP               UP            
0/RP0             NC6-RP                OPERATIONAL      UP            NSHUT

RP/0/RP1/CPU0:pani#sh memory sum location 0/rp0/cpu0
Mon Aug 11 08:22:05.406 CEST

 Physical Memory: 11838M total (9533M available)
 Application Memory : 11838M (9533M available)
 Image: 4M (bootram: 0M)
 Reserved: 0M, IOMem: 0M,        flashfsys: 0M

RP/0/RP1/CPU0:pani#sh memory sum location 0/0/cpu0  
Mon Aug 11 08:22:13.114 CEST

 Physical Memory: 5638M total (2881M available)
 Application Memory : 5638M (2881M available)
 Image: 4M (bootram: 0M)
 Reserved: 0M, IOMem: 0M,        flashfsys: 0M

yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c public 10.48.32.161  .1.3.6.1.4.1.9.9.221.1.1.1.1.18
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.18.10.1 = Counter64: 2416496640
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.18.10.2 = Counter64: 0
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.18.10.3 = Counter64: 4194304
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.18.65546.1 = Counter64: 2890944512
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.18.65546.2 = Counter64: 0
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.18.65546.3 = Counter64: 4194304

yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c public 10.48.32.161  .1.3.6.1.4.1.9.9.221.1.1.1.1.20
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.20.10.1 = Counter64: 9996664832
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.20.10.2 = Counter64: 0
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.20.10.3 = Counter64: 0
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.20.65546.1 = Counter64: 3020886016
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.20.65546.2 = Counter64: 0
SNMPv2-SMI::enterprises.9.9.221.1.1.1.1.20.65546.3 = Counter64: 0

Transceiver TX/RX Power OID Get

10G Port

1. Target port TE 0/5/0/0, we couldn’t direct get dBm, and need get mW, then convert to dBm by formula

RP/0/RSP1/CPU0:ios#sho controllers tenGigE 0/5/0/0 phy
Thu Mar 21 03:31:45.953 UTC

        Tx Power:  0.510 mW (-2.92 dBm)    <<<==
        Rx Power:  0.220 mW (-6.58 dBm)    <<<==

2. Check the interface index via “entPhysicalName” OID 1.3.6.1.2.1.47.1.1.1.1.7

iso.3.6.1.2.1.47.1.1.1.1.7.63431564 = STRING: "power Tx 0/5/CPU0/0"
iso.3.6.1.2.1.47.1.1.1.1.7.13100313 = STRING: "power Rx 0/5/CPU0/0"

3. Check sensor value OID : 1.3.6.1.4.1.9.9.91.1.1.1.1.4 to look for the TX/RX power

C:\>snmpwalk -v 2c -c cisco 10.75.49.17 1.3.6.1.4.1.9.9.91.1.1.1.1.4.63431564
iso.3.6.1.4.1.9.9.91.1.1.1.1.4.63431564 = INTEGER: 510

C:\>snmpwalk -v 2c -c cisco 10.75.49.17 1.3.6.1.4.1.9.9.91.1.1.1.1.4.13100313
iso.3.6.1.4.1.9.9.91.1.1.1.1.4.13100313 = INTEGER: 226

Notes: Not all XFP support CISCO-ENTITY-SENSOR-MIB, so you need check it by follow command (example for ASR9k ):

RP/0/RSP1/CPU0:ASR9010-1#admin show inventory raw | i Power
Fri Jan 10 09:54:30.682 UTC
NAME: "power Tx 0/2/0/1", DESCR: "Transceiver Tx Power Sensor"
NAME: "power Rx 0/2/0/1", DESCR: "Transceiver Rx Power Sensor"
NAME: "power Tx 0/2/1/2", DESCR: "Transceiver Tx Power Sensor"
NAME: "power Rx 0/2/1/2", DESCR: "Transceiver Rx Power Sensor”

Notes: We couldn’t directly get dBm by OID, so need compute that by know formula:

dBm = 10 * log10(mW)
    = 10 * log10( 0.510) 
    = 10 * -0.292
    = -2.92

100G Port

2014-9-19 update:

After checked with DE, now panini not support Tx/Rx power sensor by OID, so base on follow step, will return “0“, had filed a new DDTS:CSCuq86603

Refer XFP/CXP/… Tx/Rx power, looks like only ASR9k support(some parts that have DOM feature) under XR platform, CRS maybe not support that too.

Btw, refer to 100G port, checked ASR9k have same issue, return “0”. After NCS support that, use follow way will get correct result.

Not the same as 10G, 100G port constitute by lane (SERDES), following is a 1X100G CFP diagram example, other similar. So when you need to get 100G transceiver TX/RX Power, we need to check each Lane power.

Follow example for CPAK-100G-LR4 on NCS6008:

1. Check port TX/RX power:

CPAK Detail Info:
================

Temp: 26.00 C
Tx bias: 30.12 mA
Total Tx power: 2.96 mW (  4.72 dBm)
  Lane 0 Tx power: 0.74 mW ( -1.33 dBm)
  Lane 1 Tx power: 0.74 mW ( -1.28 dBm)
  Lane 2 Tx power: 0.75 mW ( -1.22 dBm)
  Lane 3 Tx power: 0.73 mW ( -1.37 dBm)
Total Rx power: 1.91 mW (  2.82 dBm)
  Lane 0 Rx power: 0.51 mW ( -2.90 dBm)
  Lane 1 Rx power: 0.54 mW ( -2.68 dBm)
  Lane 2 Rx power: 0.42 mW ( -3.74 dBm)
  Lane 3 Rx power: 0.44 mW ( -3.57 dBm)

2. Check sensor index:

SNMPv2-SMI::mib-2.47.1.1.1.1.7.655630 = STRING: "0/0-PORT-0-Tx Lane 0 Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.655631 = STRING: "0/0-PORT-0-Tx Lane 1 Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.655632 = STRING: "0/0-PORT-0-Tx Lane 2 Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.655633 = STRING: "0/0-PORT-0-Tx Lane 3 Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.655642 = STRING: "0/0-PORT-0-Rx Lane 0 Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.655643 = STRING: "0/0-PORT-0-Rx Lane 1 Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.655644 = STRING: "0/0-PORT-0-Rx Lane 2 Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.655645 = STRING: "0/0-PORT-0-Rx Lane 3 Power"

3. Then use follow OID to get those sensor information, then SUM(Lane 0-3):

snmpwalk -v2c -c public x.x.x.x 1.3.6.1.4.1.9.9.91.1.1.1.1.4.655630

Power OID Get

1. We need get OID for “Total power input/output”

sysadmin-vm:0_RP1# show env power
Mon Aug  11 08:03:42.557 UTC
================================================================================
CHASSIS LEVEL POWER INFO: chassisinfo
================================================================================
   Total output power capacity (Shelf 0 + Shelf 1) :    9000W +    9000W
   Total output power required                     :    6500W
   Total power input                               :    2392W
   Total power output                              :    1871W

Power Shelf 0: 
================================================================================
   Power       Supply     ------Input----   ------Output---      Status
   Module      Type        Volts     Amps    Volts     Amps    
================================================================================
   0/PT0-PM0   3KW-AC      228.7      1.8     55.4      5.7    OK 
   0/PT0-PM1   3KW-AC      226.1      1.8     55.3      5.9    OK 
   0/PT0-PM2   3KW-AC      228.7      1.8     55.3      5.7    OK 

Total of Power Shelf 0:        1230W/ 5.4A        957W/17.3A

Power Shelf 1: 
================================================================================
   Power       Supply     ------Input----   ------Output---      Status
   Module      Type        Volts     Amps    Volts     Amps    
================================================================================
   0/PT3-PM0   3KW-AC      228.7      1.8     55.3      5.7    OK 
   0/PT3-PM1   3KW-AC      229.6      1.7     55.4      5.7    OK 
   0/PT3-PM2   3KW-AC      224.9      1.6     55.5      5.1    OK 

Total of Power Shelf 1:        1162W/ 5.1A        914W/16.5A

2. After checked, no totally power data, so need check each PEM, follow only input power, same way for output power

yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c public 10.48.32.161 .1.3.6.1.2.1.47.1.1.1.1.7 |grep 0/PT

SNMPv2-SMI::mib-2.47.1.1.1.1.7.1966350 = STRING: "0/PT0-PM0-Input Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.1966351 = STRING: "0/PT0-PM0-Output Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.1970446 = STRING: "0/PT0-PM1-Input Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.1970447 = STRING: "0/PT0-PM1-Output Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.1974542 = STRING: "0/PT0-PM2-Input Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.1974543 = STRING: "0/PT0-PM2-Output Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.2212110 = STRING: "0/PT3-PM0-Input Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.2212111 = STRING: "0/PT3-PM0-Output Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.2216206 = STRING: "0/PT3-PM1-Input Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.2216207 = STRING: "0/PT3-PM1-Output Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.2220302 = STRING: "0/PT3-PM2-Input Power"
SNMPv2-SMI::mib-2.47.1.1.1.1.7.2220303 = STRING: "0/PT3-PM2-Output Power"

yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c public 10.48.32.161 1.3.6.1.4.1.9.9.91.1.1.1.1.4.1966350
SNMPv2-SMI::enterprises.9.9.91.1.1.1.1.4.1966350 = INTEGER: 387092 <<< "0/PT0-PM0-Input Power"
yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c public 10.48.32.161 1.3.6.1.4.1.9.9.91.1.1.1.1.4.1970446
SNMPv2-SMI::enterprises.9.9.91.1.1.1.1.4.1970446 = INTEGER: 390611 <<< "0/PT0-PM1-Input Power"
yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c public 10.48.32.161 1.3.6.1.4.1.9.9.91.1.1.1.1.4.1974542
SNMPv2-SMI::enterprises.9.9.91.1.1.1.1.4.1974542 = INTEGER: 390611 <<< "0/PT0-PM2-Input Power"
yonzhao2-mac:~ zhaoyong$ 
yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c public 10.48.32.161 1.3.6.1.4.1.9.9.91.1.1.1.1.4.2212110
SNMPv2-SMI::enterprises.9.9.91.1.1.1.1.4.2212110 = INTEGER: 387092 <<< "0/PT3-PM0-Input Power"
yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c public 10.48.32.161 1.3.6.1.4.1.9.9.91.1.1.1.1.4.2216206
SNMPv2-SMI::enterprises.9.9.91.1.1.1.1.4.2216206 = INTEGER: 383573 <<< "0/PT3-PM1-Input Power"
yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c public 10.48.32.161 1.3.6.1.4.1.9.9.91.1.1.1.1.4.2220302
SNMPv2-SMI::enterprises.9.9.91.1.1.1.1.4.2220302 = INTEGER: 351902 <<< "0/PT3-PM2-Input Power"

Totally power input：

387092 + 390611 + 390611 + 387092 + 383573 + 351902 = 2290,881

sysadmin-vm:0_RP1# show environment power | i "Total power input"
Mon Aug  11 09:14:11.744 UTC
   Total power input                               :    2394W

MAC Accounting OID – 2015-2-25 update:

We can config mac accounting on l3 Ethernet port:

RP/0/RSP0/CPU0:ASR9006-3#sh snmp interface g0/0/0/1 ifindex 
Wed Feb 25 01:22:30.230 UTC
ifName : GigabitEthernet0/0/0/1 ifIndex : 38
RP/0/RSP0/CPU0:ASR9006-3#
RP/0/RSP0/CPU0:ASR9006-3#
RP/0/RSP0/CPU0:ASR9006-3#sh arp location 0/0/cpu0 | i 0/0/0/1 
Wed Feb 25 01:22:56.612 UTC
192.168.0.1 - 4055.395e.94e9 Interface ARPA GigabitEthernet0/0/0/1
192.168.0.2 02:52:16 d867.d97f.3846 Dynamic ARPA GigabitEthernet0/0/0/1
RP/0/RSP0/CPU0:ASR9006-3#
RP/0/RSP0/CPU0:ASR9006-3#
RP/0/RSP0/CPU0:ASR9006-3#sh mac-accounting gigabitEthernet 0/0/0/1
Wed Feb 25 01:23:01.182 UTC
GigabitEthernet0/0/0/1
 Input (96 free)
 d867.d97f.3846: 155 packets, 13600 bytes
 Total: 155 packets, 13600 bytes

RP/0/RSP0/CPU0:ASR9006-3#
RP/0/RSP0/CPU0:ASR9006-3#
RP/0/RSP0/CPU0:ASR9006-3#sh run int g0/0/0/1
Wed Feb 25 01:34:14.617 UTC
interface GigabitEthernet0/0/0/1
 ipv4 address 192.168.0.1 255.255.255.0
 mac-accounting ingress
 transceiver permit pid all
!

And get stat from OID 1.3.6.1.4.1.9.9.84, that belong from MIB CISCO-IP-STAT-MIB.

yonzhao2-mac:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.13.14 .1.3.6.1.4.1.9.9.84
SNMPv2-SMI::enterprises.9.9.84.1.2.1.1.3.38.1.216.103.217.127.56.70 = Counter32: 155
SNMPv2-SMI::enterprises.9.9.84.1.2.1.1.4.38.1.216.103.217.127.56.70 = Counter32: 13600
SNMPv2-SMI::enterprises.9.9.84.1.2.2.1.2.38.1 = Gauge32: 96
SNMPv2-SMI::enterprises.9.9.84.1.2.3.1.1.38.1.216.103.217.127.56.70 = Counter64: 155
SNMPv2-SMI::enterprises.9.9.84.1.2.3.1.2.38.1.216.103.217.127.56.70 = Counter64: 13600

d867.d97f.3846 = d8:67:d9:7f:38:46 = 216:103:217:127:56:70

Policy-Map OID – 2016-5-7 update:

Policy-Map / class-map name OID

cbQosPolicyMapName: 1.3.6.1.4.1.9.9.166.1.6.1.1.1 cbQosClassMapCfg: 1.3.6.1.4.1.9.9.166.1.7.1.1.1

Follow configuration, and “show policy-map”:

RP/0/RP0/CPU0:6008-A#sh run int bundle-ether 74
Thu May  5 12:57:49.756 UTC
interface Bundle-Ether74
 mtu 9192
 service-policy input CORE-QOS-IN
 service-policy output CORE-QOS-OUT
 ipv4 address x.x.x.x 255.255.255.0
 load-interval 30
 logging events link-status

RP/0/RP0/CPU0:6008-A#sh policy-map interface bundle-ether 74
Thu May  5 12:09:37.264 UTC

Bundle-Ether74 input: CORE-QOS-IN

Class VOICE
  Classification statistics          (packets/bytes)     (rate - kbps)
    Matched             :                   0/0                    0
    Transmitted         :                   0/0                    0
    Total Dropped       :                   0/0                    0
Class CONTROL
  Classification statistics          (packets/bytes)     (rate - kbps)
    Matched             :                1741/175494               0
    Transmitted         :                1741/175494               0
    Total Dropped       :                   0/0                    0

1. Find interface index:

YONZHAO2-M-Q4TL:Desktop zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 1.3.6.1.2.1.31.1.1.1.1 |grep 74
IF-MIB::ifName.74 = STRING: TenGigE0/7/0/6/1
IF-MIB::ifName.156 = STRING: Bundle-Ether74
IF-MIB::ifName.174 = STRING: TenGigE0/0/0/22

2. Find qos index:

YONZHAO2-M-Q4TL:Desktop zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 .1.3.6.1.4.1.9.9.166.1.1.1 |grep 156
SNMPv2-SMI::enterprises.9.9.166.1.1.1.1.4.1700684885 = INTEGER: 156
SNMPv2-SMI::enterprises.9.9.166.1.1.1.1.4.1887606559 = INTEGER: 156

3. Check direct, I: input; 2: output:

YONZHAO2-M-Q4TL:Desktop zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 1.3.6.1.4.1.9.9.166.1.1.1.1.3 |grep 1700684885
SNMPv2-SMI::enterprises.9.9.166.1.1.1.1.3.1700684885 = INTEGER: 1
YONZHAO2-M-Q4TL:Desktop zhaoyong$ 
YONZHAO2-M-Q4TL:Desktop zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 1.3.6.1.4.1.9.9.166.1.1.1.1.3 |grep 1887606559
SNMPv2-SMI::enterprises.9.9.166.1.1.1.1.3.1887606559 = INTEGER: 2

4. Find type index mapping:

OID1.3.6.1.4.1.9.9.166.1.5.1.1.3  TypeQosObjectType 
1:policymap
2:classmap
3:matchStatement
4:queueing
5:randomDetect
6:trafficShaping
7:police
8:set
9:compression
10:ipslaMeasure
11:account

Policymap type index:

YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 1.3.6.1.4.1.9.9.166.1.5.1.1.3.1700684885 |grep ": 1"
SNMPv2-SMI::enterprises.9.9.166.1.5.1.1.3.1700684885.410789968 = INTEGER: 1
YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 1.3.6.1.4.1.9.9.166.1.5.1.1.3.1887606559 |grep ": 1"
SNMPv2-SMI::enterprises.9.9.166.1.5.1.1.3.1887606559.1471843729 = INTEGER: 1

Classmap type index:

YONZHAO2-M-Q4TL:Desktop zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 1.3.6.1.4.1.9.9.166.1.5.1.1.3.1700684885 |grep ": 2"
SNMPv2-SMI::enterprises.9.9.166.1.5.1.1.3.1700684885.99023777 = INTEGER: 2
SNMPv2-SMI::enterprises.9.9.166.1.5.1.1.3.1700684885.342272198 = INTEGER: 2
SNMPv2-SMI::enterprises.9.9.166.1.5.1.1.3.1700684885.999086546 = INTEGER: 2
SNMPv2-SMI::enterprises.9.9.166.1.5.1.1.3.1700684885.1049873889 = INTEGER: 2
SNMPv2-SMI::enterprises.9.9.166.1.5.1.1.3.1700684885.2129476654 = INTEGER: 2

5.  Find plicymap name index (cbQosConfigIndex) by qos index + type index :

YONZHAO2-M-Q4TL:Desktop zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 1.3.6.1.4.1.9.9.166.1.5.1.1.2.1700684885 | grep 410789968
SNMPv2-SMI::enterprises.9.9.166.1.5.1.1.2.1700684885.410789968 = Gauge32: 821802964

6. Check policy-map name (cbQosPolicyMapName) by name index:

YONZHAO2-M-Q4TL:Desktop zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 1.3.6.1.4.1.9.9.166.1.6.1.1.1.821802964
SNMPv2-SMI::enterprises.9.9.166.1.6.1.1.1.821802964 = STRING: "CORE-QOS-IN"

7. Find classmap name index (cbQosConfigIndex) by qos index + type index :

YONZHAO2-M-Q4TL:Desktop zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 1.3.6.1.4.1.9.9.166.1.5.1.1.2.1700684885 | grep 99023777
SNMPv2-SMI::enterprises.9.9.166.1.5.1.1.2.1700684885.99023777 = Gauge32: 1123079824

8. Check classmap name (cbQosClassMapCfg) by name index:

YONZHAO2-M-Q4TL:Desktop zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 1.3.6.1.4.1.9.9.166.1.7.1.1.1.1123079824
SNMPv2-SMI::enterprises.9.9.166.1.7.1.1.1.1123079824 = STRING: "CONTROL"

Class-map “match” and “transmit” states OID

cbQosPolicyMapName:1.3.6.1.4.1.9.9.166.1.15.1.1.2 ; The lower 32 bits count of inbound packets prior to executing any QoS policies.

cbQosClassMapCfg: 1.3.6.1.4.1.9.9.166.1.15.1.1.5 ; The lower 32 bits count of inbound octets prior to executing any QoS policies.

Please attention, above only show example that is 32bit oid, and maybe not cover all scenario, if ok, suggest you use the 64bit oid, you can each check that by SNMP Navigator tools in CCO.

Class CONTROL
  Classification statistics          (packets/bytes)     (rate - kbps)
    Matched             :                2133/220574               0
    Transmitted         :                2133/220574               0
    Total Dropped       :                   0/0                    0

1. Check class-map “match” states (cbQosClassMapStats):

YONZHAO2-M-Q4TL:Desktop zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 1.3.6.1.4.1.9.9.166.1.15.1.1.2.1700684885.99023777
SNMPv2-SMI::enterprises.9.9.166.1.15.1.1.2.1700684885.99023777 = Counter32: 2133
YONZHAO2-M-Q4TL:Desktop zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 1.3.6.1.4.1.9.9.166.1.15.1.1.5.1700684885.99023777
SNMPv2-SMI::enterprises.9.9.166.1.15.1.1.5.1700684885.99023777 = Counter32: 220574

2. Check class-map “Transmit” states After checked, no this OID, we need to compute that by “drop” OID: 

cbQosCMDropPkt: 1.3.6.1.4.1.9.9.166.1.15.1.1.13

The lower 32 bits counter of dropped pkts per class as the result of all features that can produce drops  (e.g., police, random-detect, etc.).

YONZHAO2-M-Q4TL:Desktop zhaoyong$ snmpwalk -v2c -c cisco 172.18.87.115 1.3.6.1.4.1.9.9.166.1.15.1.1.13.1700684885.99023777
SNMPv2-SMI::enterprises.9.9.166.1.15.1.1.13.1700684885.99023777 = Counter32: 0

So “Transmitted” = “match” – “drop” =  2133 – 0 = 2133.

Bundle and Member OID Mapping – 2016-10-21 update:

RP/0/RSP0/CPU0:9006-3#sh int bundle-ether 103 | i Active
Thu Oct 20 07:17:52.053 UTC
      TenGigE0/1/0/0               Full-duplex  10000Mb/s    Active

1. Get bundle index:

YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.13.14 .1.3.6.1.2.1.2.2 | grep Bund
IF-MIB::ifDescr.9 = STRING: Bundle-Ether103
IF-MIB::ifDescr.27 = STRING: Bundle-Ether18
IF-MIB::ifDescr.28 = STRING: Bundle-Ether40

2. check member in if-mib:

YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.13.14 ifStackStatus.9
IF-MIB::ifStackStatus.9.107 = INTEGER: active(1)
 
YONZHAO2-M-Q4TL:~ zhaoyong$ snmpwalk -v2c -c cisco 10.75.13.14 ifDescr.107
IF-MIB::ifDescr.107 = STRING: TenGigE0/1/0/0

Related Links

Cisco ASR 9000 Series SNMP MIB Support List

High Cpu Capture Packets No.1 by Span Way

A SPAN for the RP or SP port in Cisco IOS Software is available in Cisco IOS Software Release 12.1(19)E and later.
Example:

switch# monitor session 1 source interface
switch# monitor session 1 destination interface

Now go to SP console:, we can do this on following way :

switch#remote log sw
switch-sp#
switch-sp#test monitor add 1 rp-inband rx
test monitor add|del session# rp_inband|sp_inband [rx|tx|both]

Catalyst 6500/6000 Switch High CPU Utilization
http://www.cisco.com/en/US/partner/products/hw/switches/ps708/products_tech_note09186a00804916e0.shtml#utilities
完整阅读

4500 High Cpu Action Plan.No.1

Config “no ip unreachables” and “no ip redirects” in all L3 interface or SVI. General the “ip unreachables” and “ip redirects” will affect cpu utilization in 4000/4500. So if  don’t requirement for “ip unreachables” and “ip redirects”. Suggest to turn off the feature first. Then confirm the problem will be clear.
关于redirect的内容，可以参考之前的文章《ICMP 重定向的一些问题》和《Layer 3 层网络中的重定向》 ，另外官网也有详细介绍： When Are ICMP Redirects Sent?

4500 High Cpu Action Plan.No.2

If the cpu couldn’t downgrade, then capture follow information:

#clear counters 
#show int switching  //some times #show ip int
#show proc cpu sorted | exclude 0.00
#show proc mem sorted
#show platform health
#show platform cpu packet statistics all

完整阅读

[对于XR的升级，就我现在所知的有以下几种，如果还有其他的方法，到时再更新]
1. Golden Disk升级
类似于Ghost系统，在现有XR设备（version A）上直接把整个系统文件backup到disk卡中，然后把这个disk卡放到要升级的机箱上（version B），指定boot位置并重启，就可以直接用新系统了（version A）。省了安装系统的时间。但由于需要指定boot路径，另外还需要copy MBI文件到bootflash，所以操作起来感觉不是非常方便。

2013-9-18 更新:
在2010-9-24 更新中的第3和第4小点中，已经总结了一些GoldenDisk的内容。这里再提一下，如果从老版本升级到新版本，如3.6.3到4.0.4，又需要用FAT32，那么一定要把MBI拷贝到bootflash，否则无法识别FAT32；另外还要记住升级前要升级rommona/b的版本，原因下面有解释。

在3.6.3上升级rommon的步骤如下：
1. 从官网下载较新的rommon tar文件
2. 拷贝到disk0中
3. 执行upgrade rommon a/b all disk0

如果客户安装了很多SMU，又不知道正确的MBI路径，那么可以在老系统中把默认的MBI路径拷贝到bootflash中，然后启动，设备会自动boot这个MBI，如果MBI不正确，它会自动把正确的MBI文件copy到bootflash中，然后重启并用新MBI启动，如下所示：

Install (Node Preparation): Booting with committed software
Install (Node Preparation): Checking free space on /bootflash/
Install (Node Preparation): Copying MBI from /disk0/hfr-os-mbi-4.0.4.CSCuc17728-1.0.0/mbihfr-rp.vm
Install (Node Preparation): Copying MBI to /bootflash/disk0/hfr-os-mbi-4.0.4.CSCuc17728-1.0.0/mbihfr-rp.vm
insthelper: This node was booted with an incorrect MBI (/bootflash/disk0/hfr-os-mbi-4.0.4/mbihfr-rp.vm), rebooting self with correct boot image (/bootflash/disk0/hfr-os-mbi-4.0.4.CSCuc17728-1.0.0/mbihfr-rp.vm).

2. Turboboot 升级
完全重新安装，在Rommon模式中download mini PIE文件，感觉像之前IOS环境下的启动新版本那样。只不过XR是要安装，而IOS直接调用。
3. 直接在原有系统上升级
打个比方说，在windows xp的基础上直接升级到windows 7，这样即使windows 7装完了，在新系统中仍然有老系统的东西。所以一般不推荐用这种方法。对于disk存储介质，最好只有1种操作系统，这样稳定些。

2013-11-29 更新：
在现有系统升级又分两种方式：
一种是直接安装PIE文件，如果你的版本是A，要升级B，那么直接active B的PIE即可，但要注意，A和B的PIE要保持一致才能安装，否则会有兼容，如下所示(注：现有系统升级后，配置是保留的)：

RP/0/RP0/CPU0:LAB-CRS-1(admin)#show ins ac sum
Wed Nov 20 08:56:25.113 UTC
Default Profile:
  Admin Resources
  SDRs:
    Owner
  Active Packages:
    disk0:hfr-mpls-px-4.0.4
    disk0:hfr-mgbl-px-4.0.4
    disk0:hfr-mini-px-4.0.4

RP/0/RP0/CPU0:LAB-CRS-1(admin)#install activate disk0:hfr-mini-px-4.2.4 sync
Wed Nov 20 08:56:33.503 UTC
Install operation 34 '(admin) install activate disk0:hfr-mini-px-4.2.4 synchronous' started by user 'cisco' via CLI at 08:56:33 UTC Wed Nov 20 2013.
Error:    Cannot proceed with the activation because of the following package incompatibilities:
Error:      hfr-mgbl-supp-4.0.4 needs iosxr-fwding-4.0.4, or equivalent, to be active on the same nodes.
Error:      hfr-mgbl-supp-4.0.4 needs hfr-fwding-4.0.4, or equivalent, to be active on the same nodes.
Error:      hfr-mgbl-supp-4.0.4 needs hfr-base-4.0.4, or equivalent, to be active on the same nodes.
Error:      hfr-mgbl-supp-4.0.4 needs iosxr-infra-4.0.4, or equivalent, to be active on the same nodes.
Error:      hfr-mgbl-supp-4.0.4 needs hfr-os-support-4.0.4, or equivalent, to be active on the same nodes.
Error:      hfr-mgbl-supp-4.0.4 needs iosxr-os-4.0.4, or equivalent, to be active on the same nodes.
Error:      iosxr-mgbl-4.0.4 needs iosxr-routing-4.0.4, or equivalent, to be active on the same nodes.
Error:      iosxr-mgbl-4.0.4 needs iosxr-fwding-4.0.4, or equivalent, to be active on the same nodes.
Error:      iosxr-mgbl-4.0.4 needs iosxr-infra-4.0.4, or equivalent, to be active on the same nodes.
Error:      iosxr-mgbl-4.0.4 needs iosxr-os-4.0.4, or equivalent, to be active on the same nodes.
Error:      iosxr-mpls-4.0.4 needs iosxr-routing-4.0.4, or equivalent, to be active on the same nodes.
Error:      iosxr-mpls-4.0.4 needs iosxr-fwding-4.0.4, or equivalent, to be active on the same nodes.
Error:      iosxr-mpls-4.0.4 needs iosxr-infra-4.0.4, or equivalent, to be active on the same nodes.
Error:      iosxr-mpls-4.0.4 needs iosxr-os-4.0.4, or equivalent, to be active on the same nodes.
Error:    Suggested steps to resolve this:
Error:     - check the installation instructions.
Error:     - activate or deactivate the specified packages on the specified nodes.
Install operation 34 failed at 08:56:40 UTC Wed Nov 20 2013.
RP/0/RP0/CPU0:LAB-CRS-1(admin)#
RP/0/RP0/CPU0:LAB-CRS-1(admin)#install add tftp://10.75.41.57/hfr-mgbl-px.pie-4.2.4 sync
Wed Nov 20 08:57:39.796 UTC
Install operation 35 '(admin) install add /tftp://10.75.41.57/hfr-mgbl-px.pie-4.2.4 synchronous' started by user 'cisco' via CLI at 08:57:39 UTC Wed Nov 20 2013.
Info:     The following package is now available to be activated:
Info:
Info:         disk0:hfr-mgbl-px-4.2.4
Info:
Info:     The package can be activated across the entire router.
Info:
Install operation 35 completed successfully at 08:58:02 UTC Wed Nov 20 2013.
RP/0/RP0/CPU0:LAB-CRS-1(admin)#install activate disk0:hfr-mini-px-4.2.4 disk0:hfr-mgbl-px-4.2.4 sync
Wed Nov 20 08:58:46.818 UTC
Install operation 36 '(admin) install activate disk0:hfr-mini-px-4.2.4 disk0:hfr-mgbl-px-4.2.4 synchronous' started by user 'cisco' via CLI at 08:58:46 UTC Wed Nov 20
2013.
Error:    Cannot proceed with the activation because of the following package incompatibilities:
Error:      iosxr-mpls-4.0.4 needs iosxr-routing-4.0.4, or equivalent, to be active on the same nodes.
Error:      iosxr-mpls-4.0.4 needs iosxr-fwding-4.0.4, or equivalent, to be active on the same nodes.
Error:      iosxr-mpls-4.0.4 needs iosxr-infra-4.0.4, or equivalent, to be active on the same nodes.
Error:      iosxr-mpls-4.0.4 needs iosxr-os-4.0.4, or equivalent, to be active on the same nodes.
Error:    Suggested steps to resolve this:
Error:     - check the installation instructions.
Error:     - activate or deactivate the specified packages on the specified nodes.
Install operation 36 failed at 08:58:54 UTC Wed Nov 20 2013.
RP/0/RP0/CPU0:LAB-CRS-1(admin)#
RP/0/RP0/CPU0:LAB-CRS-1(admin)#install deactivate disk0:hfr-mpls-px-4.0.4
Wed Nov 20 08:59:20.777 UTC
Install operation 37 '(admin) install deactivate disk0:hfr-mpls-px-4.0.4' started by user 'cisco' via CLI at 08:59:20 UTC Wed Nov 20 2013.
Info:     Install Method: Parallel Process Restart
The install operation will continue asynchronously.
RP/0/RP0/CPU0:LAB-CRS-1(admin)#show ins ac sum
Wed Nov 20 09:00:36.442 UTC
Default Profile:
  Admin Resources
  SDRs:
    Owner
  Active Packages:
    disk0:hfr-mgbl-px-4.0.4
    disk0:hfr-mini-px-4.0.4

RP/0/RP0/CPU0:LAB-CRS-1(admin)#
RP/0/RP0/CPU0:LAB-CRS-1(admin)#install activate disk0:hfr-mini-px-4.2.4 disk0:hfr-mgbl-px-4.2.4 sync
Wed Nov 20 09:00:50.380 UTC
Install operation 38 '(admin) install activate disk0:hfr-mini-px-4.2.4 disk0:hfr-mgbl-px-4.2.4 synchronous' started by user 'cisco' via CLI at 09:00:50 UTC Wed Nov 20
2013.
Info:     This operation will reload the following nodes in parallel:
Info:         0/7/CPU0 (LC) (SDR: Owner)
Info:         0/15/SP (MSC-DRP-SP) (Admin Resource)
Info:         0/15/CPU0 (LC) (SDR: Owner)
Info:         0/RP0/CPU0 (CRS16-RP-x86) (SDR: Owner)
Info:         0/FC0/SP (SP) (Admin Resource)
Info:         0/FC1/SP (SP) (Admin Resource)
Info:         0/AM0/SP (SP) (Admin Resource)
Info:         0/AM1/SP (SP) (Admin Resource)
Info:         0/SM2/SP (140G-Fabric-SP-B) (Admin Resource)
Info:         0/SM3/SP (140G-Fabric-SP-B) (Admin Resource)
Info:         0/SM4/SP (140G-Fabric-SP-B) (Admin Resource)
Info:         0/SM5/SP (140G-Fabric-SP-B) (Admin Resource)
Info:         0/SM6/SP (140G-Fabric-SP-B) (Admin Resource)
Info:         0/SM7/SP (140G-Fabric-SP-B) (Admin Resource)
Proceed with this install operation (y/n)? [y]
Info:     Install Method: Parallel Reload
Info:     The changes made to software configurations will not be persistent across system reloads. Use the command '(admin) install commit' to make changes persistent.
Info:     Please verify that the system is consistent following the software change using the following commands:
Info:         show system verify
Info:         install verify packages
Install operation 38 completed successfully at 09:06:24 UTC Wed Nov 20 2013.
RP/0/RP0/CPU0:LAB-CRS-1(admin)#

另一种方式是直接安装下载后的TAR文件，或者自己做的一个TAR文件，以后有机会抓着部分信息，在更新上去。

关于rommon的一些问题
CRS一共有两个rommon，rommon A和rommon B。平时启动都是rommon B，rommon A只做一些工厂检测用。[如果rommon A的版本不低于1.52（这是CRS的需求，9k的另需要确认），就不用升级rommon A。因为每次启动都会由rommon A 去disk卡中check一些信息，感觉像是rommon在加载一些命令集（monlib ?），使得如果rommonB不能启动，或是坏了，可以直接从rommon A启动进行检测。如果版本低于1.52，rommon A就会不识别fat32的disk，所以就停在那里无法继续进行加载rommon B，如果是fat16，就没有任何问题]
完整阅读