Problem while booting 1830i, constant rebooting with crash dump

  • 137 Views
  • Last Post 18 January 2017
Dmitry Mochalov posted this 17 January 2017

Hi,

We have old 1830i which has worked fine. It has 12 disks which organized into two independent arrays. Recently we started a process of reorganizing a raid in the first arrays. Today it can’t boot and goes into process of constant rebooting.

We tried to remove all disks from the first volume (first 6 disks) and the server started successfully. All disks in the second arrays were visible. Then we tried to hot plug other 6 disks – and the server went into process of constant rebooting.

 In the web log we see a line:

Jan 17, 2017 10:48:02   0x00040009  3F206A883F066904 0000000000000000 0000000000000000 0000000000000000     The controller has new crash information

 

Here is the part of the console log during boot process:

*** Special RedBoot Ver 3.06.0000.00 ***

 

+NAND flash ID = ad f1 00 1d

Ethernet eth0: MAC address 00:01:55:13:ab:d5

IP: 192.168.0.16/255.255.255.0, Gateway: 0.0.0.0

Default server: 0.0.0.0, DNS server IP: 192.168.0.5

 

 

 

RedBoot with SAS , Ver 3.06.0000.00

 

 

Built 15:26:16, Oct 24 2011

Platform: IOP348 (XScale) Core1, DDR2-533

IF_PCIX: 1, PCIe(x4) RC, 

C1-step, IB Speed: 400MHz, Core Speed: 1200MHz

RAM: 0x00000000-0x20000000, [0x00058208-0x0f7b1000] available

FLASH: 0xf0000000 - 0xf0400000, 32 blocks of 0x00020000 bytes each.

== Executing boot script in 1.000 seconds - enter ^C to abort

RedBoot> fis load -t fs;fis load -t kernel

RedBoot> exec 0x01008000 -r 0x00800000 -s 0x800000 -c "console=ttyS0,115200 root=/dev/ram0"

Using base address 0x01008000 and length 0x0016f098

Uncompressing Linux................................................................................................. done, booting the kernel.

 

Using /islavista/fw/be_bbm.ko

Using /islavista/fw/isc813xx.ko

[   57.680000] Internal error: Oops: 17 [#1]

[   57.680000] Modules linked in: isc813xx be_bbm raid_core prom_osal

[   57.680000] CPU: 0

[   57.680000] PC is at InstallMigrationShadowStructures+0x110/0x16d4 [raid_core]

[   57.680000] LR is at mgtSwapU16Ret+0x20/0x28 [raid_core]

 

Order By: Standard | Latest | Votes
Dmitry Mochalov posted this 17 January 2017

 Other part of the log:

RedBoot with SAS , Ver 3.06.0000.00

 

 

Built 15:26:16, Oct 24 2011

Platform: IOP348 (XScale) Core1, DDR2-533

IF_PCIX: 1, PCIe(x4) RC, 

C1-step, IB Speed: 400MHz, Core Speed: 1200MHz

RAM: 0x00000000-0x20000000, [0x00058208-0x0f7b1000] available

FLASH: 0xf0000000 - 0xf0400000, 32 blocks of 0x00020000 bytes each.

== Executing boot script in 1.000 seconds - enter ^C to abort

RedBoot> fis load -t fs;fis load -t kernel

RedBoot> exec 0x01008000 -r 0x00800000 -s 0x800000 -c "console=ttyS0,115200 root=/dev/ram0"

Using base address 0x01008000 and length 0x0016f098

Uncompressing Linux................................................................................................. done, booting the kernel.

 

Using /islavista/fw/be_bbm.ko

Using /islavista/fw/isc813xx.ko

[   57.680000] Internal error: Oops: 17 [#1]

[   57.680000] Modules linked in: isc813xx be_bbm raid_core prom_osal

[   57.680000] CPU: 0

[   57.680000] PC is at InstallMigrationShadowStructures+0x110/0x16d4 [raid_core]

[   57.680000] LR is at mgtSwapU16Ret+0x20/0x28 [raid_core]

[   57.680000] pc : [<3f206a88>]    lr : [<3f066904>]    Tainted: P     

[   57.680000] sp : 488f1f08  ip : 488f1ef4  fp : 488f1f8c

[   57.680000] r10: 00000000  r9 : 00000210  r8 : 48504000

[   57.680000] r7 : 00000eb0  r6 : 00000007  r5 : 00000005  r4 : 00000001

[   57.680000] r3 : 48504018  r2 : 00003c5c  r1 : 00004000  r0 : 00000006

[   57.680000] Flags: Nzcv  IRQs on  FIQs on  Mode SVC_32  Segment user

[   57.680000] Control: 400397F  Table: 0AA90018  DAC: 00000015

[   57.680000] Process MainScheduler (pid: 812, stack limit = 0x488f0198)

[   57.680000] DUMP_TO_NVRAM: ERR: 3f810028 PC: 4029e07c Invalid Addr: 0

[   57.680000] PC is at : InstallMigrationShadowStructures+0x110/0x16d4 [raid_core]

[   57.680000] LR is at mgtSwapU16Ret+0x20/0x28 [raid_core]

[   57.680000] Crash time: 01/17/17 - 05Hrs:34Min:41Sec

[   57.680000] Thread Name: MainScheduler

[   57.680000] 

[   57.680000] PC: 3F206A88   LR: 3F066904    SP: 488F1F08

[   57.680000] 

[   57.680000] pc : [<3f206a88>]    lr : [<3f066904>]

[   57.680000] sp : 488f1f08  ip : 488f1ef4  fp : 488f1f8c

[   57.680000] r10: 00000000  r9 : 00000210  r8 : 48504000

[   57.680000] r7 : 00000eb0  r6 : 00000007  r5 : 00000005  r4 : 00000001

[   57.680000] r3 : 48504018  r2 : 00003c5c  r1 : 00004000  r0 : 00000006

[   57.680000] Flags: Nzcv  IRQs on  FIQs on  Mode SVC_32

[   57.680000] Stack Dump:

[   57.680000] 488f1f08: 00000000 00000000 00000000 00000000 

[   57.680000] 488f1f18: 4B41E800 00000000 00000000 00000000 

[   57.680000] 488f1f28: 3F31D26C 4B41E840 00000000 00000001 

[   57.680000] 488f1f38: 00000001 00000000 00000000 00000006 

[   57.680000] 488f1f48: 488F1F54 00000000 00000006 00000007 

[   57.680000] 488f1f58: 3F05740C 00000001 48504000 00000000 

[   57.680000] 488f1f68: FFFFFFFF FFFFFFFF 48504000 00003CE0 

[   57.680000] 488f1f78: 00000210 00003CEA 488F1FB8 488F1F90 

[   57.680000] 488f1f88: 3F2083F8 3F206984 3F3C6E78 00000000 

[   57.680000] 488f1f98: 00000000 48504000 00000064 3F3C6E48 

[   57.680000] 488f1fa8: 3F3D3064 488F1FF4 488F1FBC 3F069DC4 

[   57.680000] 488f1fb8: 3F208058 4003E950 488F0000 00000008 

[   57.680000] 488f1fc8: 00000000 00000000 00000000 00000000 

[   57.680000] 488f1fd8: 00000000 00000000 00000000 00000000 

[   57.680000] 488f1fe8: 00000000 488F1FF8 4003E950 3F069B2C 

[   57.680000] 488f1ff8: FFFFFFFF FFFFFFFF 

[   57.680000] Backtrace:

[   57.680000] [<3f2083f8>] (ProcessInstallMigrationShadowStructures+0x3ac/0x424 [raid_core])

[   57.680000] [<3f069dc4>] (MainScheduler+0x2a4/0xc68 [raid_core])

[   57.680000] [<4003e950>] (do_exit+0x0/0x884)

[   57.680000] 

[   57.680000] Stack: (0x488f1f08 to 0x488f2000)

[   57.680000] 1f00:                   00000000 00000000 00000000 00000000 4b41e800 00000000 

[   57.680000] 1f20: 00000000 00000000 3f31d26c 4b41e840 00000000 00000001 00000001 00000000 

[   57.680000] 1f40: 00000000 00000006 488f1f54 00000000 00000006 00000007 3f05740c 00000001 

[   57.680000] 1f60: 48504000 00000000 ffffffff ffffffff 48504000 00003ce0 00000210 00003cea 

[   57.680000] 1f80: 488f1fb8 488f1f90 3f2083f8 3f206984 3f3c6e78 00000000 00000000 48504000 

[   57.680000] 1fa0: 00000064 3f3c6e48 3f3d3064 488f1ff4 488f1fbc 3f069dc4 3f208058 4003e950 

[   57.680000] 1fc0: 488f0000 00000008 00000000 00000000 00000000 00000000 00000000 00000000 

[   57.680000] 1fe0: 00000000 00000000 00000000 488f1ff8 4003e950 3f069b2c ffffffff ffffffff 

[   57.680000] Backtrace: 

[   57.680000] [<3f206978>] (InstallMigrationShadowStructures+0x0/0x16d4 [raid_core]) from [<3f2083f8>] (ProcessInstallMigrationShadowStructures+0x3ac/0x424 [raid_core])

[   57.680000] [<3f20804c>] (ProcessInstallMigrationShadowStructures+0x0/0x424 [raid_core]) from [<3f069dc4>] (MainScheduler+0x2a4/0xc68 [raid_core])

[   57.680000] [<3f069b20>] (MainScheduler+0x0/0xc68 [raid_core]) from [<4003e950>] (do_exit+0x0/0x884)

[   57.680000] Code: e795a003 e2827078 e50b8060 2a00003f (e5dac045) 

[   57.690000] ****** QUEUE 1: TIMER_Q (cnt = 5) ******

[   57.700000]   No. ID       ProcFn   FuncStat ResFn    ResNo    Info     ScrPtr

[   57.700000]    1. 490c7560 3f1d82c8 00000001 00000000 00001730 00000001 4bf0fec0

[   57.710000]    2. 3f5b59f0 3f1c80b4 00000001 00000000 000016de 00000001 4f23e420

[   57.720000]    3. 3f34926c 3f012924 00000000 00000000 00001a08 00000001 4bd4a3a0

[   57.730000]    4. 00000000 3f1c0de0 00000004 00000000 000016aa 00000001 4bd4a380

[   57.730000]    5. 00000000 3f1d8534 00000000 00000000 000016ec 00000001 4bd8b8e0

[   57.740000] 

[   57.740000] ****** QUEUE 2: MSG_Q (cnt = 0) ******

[   57.750000] No RIO in this queue

[   57.750000] 

[   57.750000] ****** QUEUE 3: NEW_CMD_Q (cnt = 0) ******

[   57.760000] No RIO in this queue

[   57.760000] 

[   57.760000] ****** QUEUE 4: NORMAL_Q (cnt = 0) ******

[   57.770000] No RIO in this queue

[   57.770000] 

[   57.770000] ****** QUEUE 5: GENERAL_RES_WAIT_Q (cnt = 1) ******

[   57.780000]   No. ID       ProcFn   FuncStat ResFn    ResNo    Info     ScrPtr

[   57.790000]    1. 00010001 3f154d70 00000001 3f154e04 00000001 00000005 00000000

[   57.790000] 

[   57.800000] ****** QUEUE 6: BKMGR_RES_WAIT_Q (cnt = 0) ******

[   57.800000] No RIO in this queue

[   57.800000] 

[   57.810000] ****** QUEUE 7: CACHE_RES_NEWCMD_WAIT_Q (cnt = 0) ******

[   57.810000] No RIO in this queue

[   57.810000] 

[   57.820000] ****** QUEUE 8: CACHE_RES_WAIT_Q (cnt = 0) ******

[   57.820000] No RIO in this queue

[   57.820000] 

[   57.830000] FreeBics: 8180 (InQL: 8, SuQL: 1, StsQL: 1)

[   57.830000] 

[   57.840000] 

[   57.840000] Drives found list:

[   57.840000]    PD  Ctl  Chn  Tgt  InQL  SuQL  rst  SubmitQH  BE_entry PECC  TOut    HPDSN

[   57.850000]     2    0    0    2     0     0    0  00000000  3f234108    0     - 544374AE

[   57.860000]     3    0    0    3     0     0    0  00000000  3f234108    0     - 4A59737A

[   57.870000]     1    0    0    1     0     0    0  00000000  3f234108    0     - 50479A77

[   57.870000]     4    0    0    4     0     0    0  00000000  3f234108    0     - 4543E5A6

[   57.880000]     0    0    0    0     0     0    0  00000000  3f234108    0     - 3452539A

[   57.890000]     5    0    0    5     0     0    0  00000000  3f234108    0     - 30517018

[   57.900000]     6    0    0    6     0     0    0  00000000  3f234108    0     - 4830560C

[   57.910000]     7    0    0    7     0     0    0  00000000  3f234108    0     - 54371F8E

[   57.920000]     8    0    0    8     0     0    0  00000000  3f234108    0     - 394C06E3

[   57.920000]     9    0    0    9     0     0    0  00000000  3f234108    0     - 384BF0B8

[   57.930000]    10    0    0   10     0     0    0  00000000  3f234108    0     - 30511B04

[   57.940000]    11    0    0   11     0     0    0  00000000  3f234108    0     - 485A9982

[   57.950000]    PD  Ctl  Chn  Tgt  InQL  SuQL  rst  SubmitQH  BE_entry PECC  TOut    HPDSN

[   57.960000] 

[   57.960000] ESP found list:

[   57.960000]    ID  Indx  Type  Ctl  Chn  Tgt  InQl  SuQl  rst  SubmitQH  PECC  TOut

[   57.970000]     0     0  0x1    0    0   12     8     1    0  53206340     0     0

[   57.980000] 

[   57.980000] InputQ BICS. (number:8)

[   57.980000]    BICSptr  Ctl  Chn  Tgt  CDB[0]  CallBackFun 

[   57.990000]   53206580    0    0   12  0x1c     3f1d0988

[   57.990000]   532067c0    0    0   12  0x1c     3f1d0988

[   58.000000]   53206a00    0    0   12  0x1c     3f1d0988

[   58.010000]   53206c40    0    0   12  0x1c     3f1d0988

[   58.010000]   53206e80    0    0   12  0x1c     3f1d0988

[   58.020000]   53205c80    0    0   12  0x1d     3f1d0988

[   58.020000]   53205ec0    0    0   12  0x1d     3f1d0988

[   58.030000]   53206100    0    0   12  0x1d     3f1d0988

[   58.030000] 

[   58.030000] SubmitQ BICS. (number:1)

[   58.040000]    BICSptr  Ctl  Chn  Tgt  CDB[0]  CallBackFun 

[   58.040000]   53206340    0    0   12  0x1c     3f1d0988

[   58.050000] 

[   58.050000] StatusQ BICS. (number:1)

[   58.050000]    BICSptr  Ctl  Chn  Tgt  CDB[0]  CallBackFun 

[   58.060000]   53206340    0    0   12  0x1c     3f1d0988

[   58.070000] 

[   58.070000] Used BICS.

[   58.070000]    BICSptr  Ctl  Chn  Tgt  CDB[0]  CallBackFun

[   58.070000]   53201480    0    0    0  0xa1     3f058c38

[   58.080000]   53201d80    0    0    0  0x88     3f20804c

[   58.090000]   53203d00    0    0   10  0xa1     3f058c38

[   58.090000]   53205c80    0    0   12  0x1d     3f1d0988

[   58.100000]   53205ec0    0    0   12  0x1d     3f1d0988

[   58.100000]   53206100    0    0   12  0x1d     3f1d0988

[   58.110000]   53206340    0    0   12  0x1c     3f1d0988

[   58.110000]   53206580    0    0   12  0x1c     3f1d0988

[   58.120000]   532067c0    0    0   12  0x1c     3f1d0988

[   58.120000]   53206a00    0    0   12  0x1c     3f1d0988

[   58.130000]   53206c40    0    0   12  0x1c     3f1d0988

[   58.140000]   53206e80    0    0   12  0x1c     3f1d0988

[   58.140000] 

[   58.140000] current DDF Rio: 0x00000000

[   58.150000] 

[   58.150000] -------------------------------------------------------------------------------

[   58.160000] Pause Count: 3, Controller Pause IO state: 0x1

[   58.160000] Controller Pending IO count: 0

[   58.170000] -------------------------------------------------------------------------------

[   58.170000] NCQ Setting: 1 (0:Disable, 1:Enable)

[   58.170000] 

[   58.180000] Current RIO is being processed:

[   58.190000] ID=0x000000 PROCFN=0x3f20804c FUNC_STATE=0x00001b RESFN=0x00000000

[   58.190000] RESNO=0x000000 INFO=0x000000 SCRPTR=0x00000000

[   58.200000] Walking Active RIO -- Start *****

[   58.200000] 

[   58.200000] 

[   58.200000] Walking Active RIO -- End *****

[   58.200000] 

[   58.210000] RioFreeCount: 1073, RioIdStackIndex: 1056

[   58.220000] 

[   58.220000]  Dumping WB Structures:

[   58.220000] 

[   58.220000]  WBP Actv Q HD 00000000 TL 00000000

[   58.230000]  WBP Wait Q HD 00000000 TL 00000000

[   58.230000] R5Total 0x9762, Avail: 0x9762

[   58.240000] CLTotal 0x96d, Avail: 0x96d, CMMin: 0x80, CMMinChk: 0x180

[   58.240000] HostReqTotal 0x2000, Avail: 0x2000

[   58.250000] gNumWBPWorkUnderMiniCl 0x0, gMaxWBPWorkUnderMiniCl: 0x1

[   58.250000] Used Cache Lines 0x0 -

[   58.260000] 54170438, 54170f78, 54172d00, 541736d8, 5417594c, 54177ff8, 5417864c, 54178e08, 54179510, 5417f564, 

[   58.270000] 54180eb4, 54181238, 541815bc, 54181aa8, 5418296c, 54182cf0, 54185aa4, 54186800, 54186a1c, 54187070, 

[   58.280000] 54189d70, 5418a694, 5418afb8, 5418bc60, 5418c098, 5418e960, 5418ed98, 54194ea0, 54195440, 54195b48, 

[   58.290000] 54195cb0, 54195d64, 5419754c, 541988fc, 54198bcc, 5419cbc8, 5419e518, 5419ee3c, 5419f6ac, 5419fa30, 

[   58.300000] 5419ffd0, 541a0408, 541a0570, 541a17b8, 541a25c8, 541a2ab4, 541a2fa0, 541a5214, 541a54e4, 541a8c70, 

[   58.310000] 541a8dd8, 541a915c, 541aa7dc, 541ab100, 541af534, 541b0344, 541b077c, 541b10a0, 541b2e28, 541b3044, 

[   58.320000] 541b4a48, 541b4e80, 541b5150, 541b5df8, 541b6500, 541b7f04, 541b8828, 541b914c, 541beed0, 541c1144, 

[   58.330000] 541c3304, 541c3958, 541c46b4, 541c5b18, 541c7198, 541c83e0, 541c8d04, 541c96dc, 541c9c7c, 541ccf1c, 

[   58.350000] 541cd8f4, 541cf94c, 541d08c4, 541d29d0, 541d4c44, 541d56d0, 541d5d24, 541d5dd8, 541d66fc, 541d7cc8, 

[   58.360000] 541d8484, 

[   58.360000] Dirty Cache Lines 0x58 -

[   58.360000] 54170438, 54170f78, 54172d00, 541736d8, 5417594c, 54177ff8, 5417864c, 54178e08, 54179510, 5417f564, 

[   58.370000] 54180eb4, 54181238, 541815bc, 54181aa8, 5418296c, 54182cf0, 54185aa4, 54186800, 54186a1c, 54187070, 

[   58.380000] 54189d70, 5418a694, 5418afb8, 5418bc60, 5418c098, 5418e960, 5418ed98, 54194ea0, 54195440, 54195b48, 

[   58.400000] 54195cb0, 54195d64, 5419754c, 541988fc, 54198bcc, 5419cbc8, 5419e518, 5419ee3c, 5419f6ac, 5419fa30, 

[   58.410000] 5419ffd0, 541a0408, 541a0570, 541a17b8, 541a25c8, 541a2ab4, 541a2fa0, 541a5214, 541a54e4, 541a8c70, 

[   58.420000] 541a8dd8, 541a915c, 541aa7dc, 541ab100, 541af534, 541b0344, 541b077c, 541b10a0, 541b3044, 541b4a48, 

[   58.430000] 541b4e80, 541b5150, 541b5df8, 541b6500, 541b7f04, 541b8828, 541b914c, 541beed0, 541c1144, 541c3304, 

[   58.440000] 541c3958, 541c46b4, 541c5b18, 541c7198, 541c83e0, 541c96dc, 541c9c7c, 541ccf1c, 541cd8f4, 541cf94c, 

[   58.450000] 541d08c4, 541d29d0, 541d4c44, 541d56d0, 541d5d24, 541d5dd8, 541d66fc, 541d8484, 

[   58.460000] 

[   58.460000]  Dumping WB Structures:

[   58.470000] 

[   58.470000]  WBP Actv Q HD 00000000 TL 00000000

[   58.480000]  WBP Wait Q HD 00000000 TL 00000000

[   58.480000] R5Total 0x9762, Avail: 0x9762

[   58.480000] R6Total 0x9762, Avail: 0x96de

[   58.490000]  gFreeBics 0x1ff4

[   58.490000] 

[   58.490000] CLTotal 0x96d, Avail: 0x96d

[   58.500000] HostReqTotal 0x2000, Avail: 0x2000

[   58.500000] gNumWBPWorkUnderMiniCl 0x0, gMaxWBPWorkUnderMiniCl: 0x1

[   58.510000] Used Cache Lines 0x0 -

[   58.510000] 54170438,  type 0x1  lba 54565a80

[   58.520000] 54170f78,  type 0x1  lba e3883600

[   58.520000] 54172d00,  type 0x1  lba aa00

[   58.520000] 541736d8,  type 0x1  lba 3a695b80

[   58.530000] 5417594c,  type 0x1  lba 1b880

[   58.530000] 54177ff8,  type 0x1  lba 6403880

[   58.540000] 5417864c,  type 0x1  lba 13004080

[   58.540000] 54178e08,  type 0x1  lba e6d3300

[   58.550000] 54179510,  type 0x1  lba 5d3e300

[   58.550000] 5417f564,  type 0x1  lba ed28ac80

[   58.560000] 

[   58.560000] 54180eb4,  type 0x1  lba e74a7b80

[   58.560000] 54181238,  type 0x1  lba 1b680

[   58.570000] 541815bc,  type 0x1  lba 6406100

[   58.570000] 54181aa8,  type 0x1  lba e6d3380

[   58.580000] 5418296c,  type 0x1  lba 6422e00

[   58.580000] 54182cf0,  type 0x1  lba 129ef980

[   58.580000] 54185aa4,  type 0x1  lba da13e300

[   58.590000] 54186800,  type 0x1  lba 37f07380

[   58.590000] 54186a1c,  type 0x1  lba 3a69b100

[   58.600000] 54187070,  type 0x1  lba 35eaba80

[   58.600000] 

[   58.600000] 54189d70,  type 0x1  lba e219cd00

[   58.610000] 5418a694,  type 0x1  lba 2a426800

[   58.610000] 5418afb8,  type 0x1  lba e75ff80

[   58.620000] 5418bc60,  type 0x1  lba ef1fb100

[   58.620000] 5418c098,  type 0x1  lba 1b900

[   58.630000] 5418e960,  type 0x1  lba efa3f800

[   58.630000] 5418ed98,  type 0x1  lba 27e44480

[   58.640000] 54194ea0,  type 0x1  lba e74a7c00

[   58.640000] 54195440,  type 0x1  lba dfd71c80

[   58.640000] 54195b48,  type 0x1  lba db261700

[   58.650000] 

[   58.650000] 54195cb0,  type 0x1  lba def7ca80

[   58.660000] 54195d64,  type 0x1  lba db2efc00

[   58.660000] 5419754c,  type 0x1  lba 2dc07100

[   58.660000] 541988fc,  type 0x1  lba 38f05880

[   58.670000] 54198bcc,  type 0x1  lba 2f190d80

[   58.670000] 5419cbc8,  type 0x1  lba 340f4e00

[   58.680000] 5419e518,  type 0x1  lba 1bc00

[   58.680000] 5419ee3c,  type 0x1  lba 10a2ea80

[   58.690000] 5419f6ac,  type 0x1  lba 1304ee00

[   58.690000] 5419fa30,  type 0x1  lba dfad8900

[   58.700000] 

[   58.700000] 5419ffd0,  type 0x1  lba d2f5500

[   58.700000] 541a0408,  type 0x1  lba 34107a00

[   58.710000] 541a0570,  type 0x1  lba 11a15800

[   58.710000] 541a17b8,  type 0x1  lba 1e7efb00

[   58.720000] 541a25c8,  type 0x1  lba 6403980

[   58.720000] 541a2ab4,  type 0x1  lba e74a6500

[   58.720000] 541a2fa0,  type 0x1  lba 1eda5180

[   58.730000] 541a5214,  type 0x1  lba 8acd000

[   58.730000] 541a54e4,  type 0x1  lba f31d0480

[   58.740000] 541a8c70,  type 0x1  lba da937200

[   58.740000] 

[   58.740000] 541a8dd8,  type 0x1  lba e237a00

[   58.750000] 541a915c,  type 0x1  lba 50c00

[   58.750000] 541aa7dc,  type 0x1  lba 10a2ea00

[   58.760000] 541ab100,  type 0x1  lba 2dc17280

[   58.760000] 541af534,  type 0x1  lba 3a69f200

[   58.770000] 541b0344,  type 0x1  lba da13e380

[   58.770000] 541b077c,  type 0x1  lba 2f1bad00

[   58.780000] 541b10a0,  type 0x1  lba 1eda5280

[   58.780000] 541b2e28,  type 0x1  lba 19ca6800

[   58.790000] 541b3044,  type 0x1  lba 8ad6c80

[   58.790000] 

[   58.790000] 541b4a48,  type 0x1  lba 6d8bb80

[   58.800000] 541b4e80,  type 0x1  lba e6ea080

[   58.800000] 541b5150,  type 0x1  lba 31801380

[   58.800000] 541b5df8,  type 0x1  lba efa33980

[   58.810000] 541b6500,  type 0x1  lba 30a9d600

[   58.810000] 541b7f04,  type 0x1  lba 6403d80

[   58.820000] 541b8828,  type 0x1  lba 3601a200

[   58.820000] 541b914c,  type 0x1  lba db261680

[   58.830000] 541beed0,  type 0x1  lba e74eb80

[   58.830000] 541c1144,  type 0x1  lba db26bf00

[   58.840000] 

[   58.840000] 541c3304,  type 0x1  lba dfac7680

[   58.840000] 541c3958,  type 0x1  lba 1304ed80

[   58.850000] 541c46b4,  type 0x1  lba e0d9e900

[   58.850000] 541c5b18,  type 0x1  lba 1f080900

[   58.860000] 541c7198,  type 0x1  lba e74a6980

[   58.860000] 541c83e0,  type 0x1  lba d9e5a980

[   58.870000] 541c8d04,  type 0x1  lba 480ba80

[   58.870000] 541c96dc,  type 0x1  lba 4109000

[   58.870000] 541c9c7c,  type 0x1  lba 6403800

[   58.880000] 541ccf1c,  type 0x1  lba 129ef900

[   58.880000] 

[   58.890000] 541cd8f4,  type 0x1  lba ef88f000

[   58.890000] 541cf94c,  type 0x1  lba 31800e80

[   58.890000] 541d08c4,  type 0x1  lba efa3f780

[   58.900000] 541d29d0,  type 0x1  lba 37ef3680

[   58.900000] 541d4c44,  type 0x1  lba ac00

[   58.910000] 541d56d0,  type 0x1  lba ed28ad00

[   58.910000] 541d5d24,  type 0x1  lba 13004100

[   58.920000] 541d5dd8,  type 0x1  lba da15b780

[   58.920000] 541d66fc,  type 0x1  lba 39f6ab00

[   58.930000] 541d7cc8,  type 0x1  lba 480bb00

[   58.930000] 

[   58.930000] 541d8484,  type 0x1  lba 27e55880

[   58.940000] 

[   58.940000] Dirty Cache Lines 0x58 -

[   58.940000] 54170438, 54170f78, 54172d00, 541736d8, 5417594c, 54177ff8, 5417864c, 54178e08, 54179510, 5417f564, 

[   58.950000] 54180eb4, 54181238, 541815bc, 54181aa8, 5418296c, 54182cf0, 54185aa4, 54186800, 54186a1c, 54187070, 

[   58.960000] 54189d70, 5418a694, 5418afb8, 5418bc60, 5418c098, 5418e960, 5418ed98, 54194ea0, 54195440, 54195b48, 

[   58.970000] 54195cb0, 54195d64, 5419754c, 541988fc, 54198bcc, 5419cbc8, 5419e518, 5419ee3c, 5419f6ac, 5419fa30, 

[   58.990000] 5419ffd0, 541a0408, 541a0570, 541a17b8, 541a25c8, 541a2ab4, 541a2fa0, 541a5214, 541a54e4, 541a8c70, 

[   59.000000] 541a8dd8, 541a915c, 541aa7dc, 541ab100, 541af534, 541b0344, 541b077c, 541b10a0, 541b3044, 541b4a48, 

[   59.010000] 541b4e80, 541b5150, 541b5df8, 541b6500, 541b7f04, 541b8828, 541b914c, 541beed0, 541c1144, 541c3304, 

[   59.020000] 541c3958, 541c46b4, 541c5b18, 541c7198, 541c83e0, 541c96dc, 541c9c7c, 541ccf1c, 541cd8f4, 541cf94c, 

[   59.030000] 541d08c4, 541d29d0, 541d4c44, 541d56d0, 541d5d24, 541d5dd8, 541d66fc, 541d8484, 

[   59.040000] 

[   59.040000] DUMPMIGRATE: START

[   59.050000] DUMPMIGRATE: END

[   59.050000] LOID: 1, LCnt: 0, LState: 0

[   59.060000] LOID: 2, LCnt: 0, LState: 0

[   59.060000] LOID: 0, LCnt: 0, LState: 0

[   59.060000] LOID: 0, LCnt: 0, LState: 0

[   59.070000] LOID: 0, LCnt: 0, LState: 0

[   59.070000] LOID: 0, LCnt: 0, LState: 0

[   59.070000] LOID: 0, LCnt: 0, LState: 0

[   59.080000] LOID: 0, LCnt: 0, LState: 0

[   59.080000] LOID: 0, LCnt: 0, LState: 0

[   59.090000] LOID: 0, LCnt: 0, LState: 0

[   59.090000] LOID: 0, LCnt: 0, LState: 0

[   59.090000] LOID: 0, LCnt: 0, LState: 0

[   59.100000] LOID: 0, LCnt: 0, LState: 0

[   59.100000] LOID: 0, LCnt: 0, LState: 0

[   59.110000] LOID: 0, LCnt: 0, LState: 0

[   59.110000] LOID: 0, LCnt: 0, LState: 0

[   59.110000] LOID: 0, LCnt: 0, LState: 0

[   59.120000] LOID: 0, LCnt: 0, LState: 0

[   59.120000] LOID: 0, LCnt: 0, LState: 0

[   59.130000] LOID: 0, LCnt: 0, LState: 0

[   59.130000] LOID: 0, LCnt: 0, LState: 0

[   59.130000] LOID: 0, LCnt: 0, LState: 0

[   59.140000] LOID: 0, LCnt: 0, LState: 0

[   59.140000] LOID: 0, LCnt: 0, LState: 0

[   59.150000] LOID: 0, LCnt: 0, LState: 0

[   59.150000] LOID: 0, LCnt: 0, LState: 0

[   59.150000] LOID: 0, LCnt: 0, LState: 0

[   59.160000] LOID: 0, LCnt: 0, LState: 0

[   59.160000] LOID: 0, LCnt: 0, LState: 0

[   59.160000] LOID: 0, LCnt: 0, LState: 0

[   59.170000] LOID: 0, LCnt: 0, LState: 0

[   59.170000] LOID: 0, LCnt: 0, LState: 0

[   59.180000] WATERMARK DEBUG DISPLAY

[   59.180000] WMI Free Q HEAD :0x3f5326ac Tail :0x3f532d90 Count :0x40

[   59.190000] WMI Pending Q HEAD :0x00000000 Tail :0x00000000 Count :0x0

[   59.190000] WMP Free Q HEAD :0x3f532dac Tail :0x3f533f64 Count :0x40

[   59.200000] WMP Proc Q HEAD :0x00000000 Tail :0x00000000 Count :0x0

[   59.210000] Total valid handles are 0

[   59.210000] Total valid caches are 0

[   59.210000] --------------------------------------------------------------

[   59.220000]  Number of RC Pending in controller 0x0

[   59.220000] --------------------------------------------------------------

[   59.220000]  Number of BGS Pending in controller 0x0

[   59.240000] Display Rebuild RIO Information

[   59.240000] MP_RIO is 0x00000000

[   59.240000] MP complete Queue Head 0x00000000 Tail 0x00000000 Count 0x0

[   59.250000] MP Active Queue Head 0x00000000 Tail 0x00000000 Count 0x0

[   59.260000] MP Pending Queue Head 0x00000000 Tail 0x00000000 Count 0x0

[   59.270000] MP Free Queue Head 0x3f3d3660 Tail 0x3f3d4a4c Count 0x100

[   59.270000] MP State is 0x13

[   59.270000] User state is 0xff

[   59.280000] Pause Count :0x0

[   59.280000] MP User RIO 0x00000000

[   59.280000] MP is not active

[   59.290000] 

[   59.290000] --------------------------------------------------------------

[   59.300000] VPD read status

[   59.300000] --------------------------------------------------------------

[   59.310000] BP EEPROM: 0x0

[   59.310000] MB EEPROM: 0x0

[   59.310000] Tgt: 0x0 function: 0x3f231330 fstate: 0x14 tgtid: 0x0 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.320000] Tgt: 0x1 function: 0x3f231330 fstate: 0x14 tgtid: 0x1 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.330000] Tgt: 0x2 function: 0x3f231330 fstate: 0x14 tgtid: 0x2 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.340000] Tgt: 0x3 function: 0x3f231330 fstate: 0x14 tgtid: 0x3 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.350000] Tgt: 0x4 function: 0x3f231330 fstate: 0x14 tgtid: 0x4 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.360000] Tgt: 0x5 function: 0x3f231330 fstate: 0x14 tgtid: 0x5 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.370000] Tgt: 0x6 function: 0x3f231330 fstate: 0x14 tgtid: 0x6 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.380000] Tgt: 0x7 function: 0x3f231330 fstate: 0x14 tgtid: 0x7 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.390000] Tgt: 0x8 function: 0x3f231330 fstate: 0x14 tgtid: 0x8 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.400000] Tgt: 0x9 function: 0x3f231330 fstate: 0x14 tgtid: 0x9 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.410000] Tgt: 0xa function: 0x3f231330 fstate: 0x14 tgtid: 0xa tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.420000] Tgt: 0xb function: 0x3f231330 fstate: 0x14 tgtid: 0xb tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.430000] Tgt: 0xc function: 0x3f234f9c fstate: 0x14 tgtid: 0xc tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.440000] Tgt: 0xd function: 0x00000000 fstate: 0x0 tgtid: 0xd tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.450000] Tgt: 0xe function: 0x00000000 fstate: 0x0 tgtid: 0xe tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.460000] Tgt: 0xf function: 0x00000000 fstate: 0x0 tgtid: 0xf tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.470000] Tgt: 0x10 function: 0x00000000 fstate: 0x0 tgtid: 0x10 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.480000] Tgt: 0x11 function: 0x00000000 fstate: 0x0 tgtid: 0x11 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.490000] Tgt: 0x12 function: 0x00000000 fstate: 0x0 tgtid: 0x12 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.500000] Tgt: 0x13 function: 0x00000000 fstate: 0x0 tgtid: 0x13 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.510000] Tgt: 0x14 function: 0x00000000 fstate: 0x0 tgtid: 0x14 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.520000] Tgt: 0x15 function: 0x00000000 fstate: 0x0 tgtid: 0x15 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.530000] Tgt: 0x16 function: 0x00000000 fstate: 0x0 tgtid: 0x16 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.540000] Tgt: 0x17 function: 0x00000000 fstate: 0x0 tgtid: 0x17 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.550000] Tgt: 0x18 function: 0x00000000 fstate: 0x0 tgtid: 0x18 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.560000] Tgt: 0x19 function: 0x00000000 fstate: 0x0 tgtid: 0x19 tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.570000] Tgt: 0x1a function: 0x00000000 fstate: 0x0 tgtid: 0x1a tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.580000] Tgt: 0x1b function: 0x00000000 fstate: 0x0 tgtid: 0x1b tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.590000] Tgt: 0x1c function: 0x00000000 fstate: 0x0 tgtid: 0x1c tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.600000] Tgt: 0x1d function: 0x00000000 fstate: 0x0 tgtid: 0x1d tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.610000] Tgt: 0x1e function: 0x00000000 fstate: 0x0 tgtid: 0x1e tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.620000] Tgt: 0x1f function: 0x00000000 fstate: 0x0 tgtid: 0x1f tgtstate: 0x0 bics: 0x00000000 inuseflag: 0x0 inpend: 0x0 rmpend: 0x0 retry: 0x0

[   59.630000] gInsertionHandlerRio state: 0x1

[   59.630000] Ct1:0, Ct2:32

[   59.630000] 

[   59.630000] Note:

[   59.640000] 1. Use [cat /proc/raid/input_select] to setup info of ivdump

[   59.640000] 2. Use [grep 12345678 /proc/kallsyms] to search symbol

[   59.650000] 

[   59.650000] Info:

[   59.650000] 1. The ivdump entry point is invoked directly.

[   59.660000] Inside arch_reset

 

 

 

*** Special RedBoot Ver 3.06.0000.00 ***

Venkatachalam Settu posted this 17 January 2017

Hi,

It looks like this issue needs to be analyzed with the help of subsystem report of the unit to find out the exact issue. Please call technical support at 408-228-1500 or reach out through support case at  https://support.promise.com/.

Thank you.

Dmitry Mochalov posted this 17 January 2017

Unfortunately the server is old and our warranty has expired long ago so we do not have a valid promise support. Is there any way we can analyze and diagnose the issue by ourselves?

Where can we find the subsystem report of the unit?

Recently we have tried to update the firmware to 3.06.0000.10. It updated successfully but it hasn’t resolved the issue.

We have tried to localize the issue – inserting any of the 6 disks of the first arrays results in  server rebooting.

Pradeep Chidambaranath posted this 18 January 2017

Hi Dmitry,

Kindly go to https://support.promise.com to create a case.   Follow the below steps to save the subsystem report.   -Click on administrative tools in your Web Pam and click on save system service report under the tool list.   -Save the file as HTML and attach it to this case for further investigation.   Even if the unit is not under warranty, we should be able to check the report to further investigate the issue to help you resolve the issue.   Regards .Ppradeep C PromiseTech Support

 

Pradeep Chidambaranath posted this 18 January 2017

 Hi Dmitry,

Kindly go to https://support.promise.com to create a case.  

Follow the below steps to save the subsystem report. 
-Click on administrative tools in your Web Pam and click on save system service report under the tool list.  
-Save the file as HTML and attach it to this case for further investigation.  

Even if the unit is not under warranty, we should be able to check the report to further investigate the issue to help you resolve the issue. 

Regards
Pradeep C
Promise Tech Support.

  • Liked by
  • Yu Qin
Search
Categories
Close