[Problem] Dell R720xd iDRAC BIOS Recovery

[immelrikt]

Hello, guys! What an amazing work you’ve done here! Wish I read these before deciding to upgrade my r720’s iDRAC from 1.35.35 to 2.10.10.
Anyway I got this UART output. Seems like partition table is corrupted.
So it sees SD card (on which I copied firmimg.d7).
What could I do? Maybe I should try to write a bootable image on SD card? Or try to interrupt booting with A2-B2 shortage?

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
 

U-Boot 2009.08-00088-g121cddc (Nov 17 2014 - 05:50:46) Avocent (0.0.3) EVB, Build: jenkins-idrac-yocto-release-505
 
CPU: SH-4A
BOARD: R0P7757LC00xxRL (C0 step) board
BOOT: Secure, 
sh_mmcINFO: 00:002 Start-up -to- util_idrac_main()
INFO: 00:005 U-Boot 2009.08-00088-g121cddc (Nov 17 2014 - 05:50:46) Avocent (0.0.3) EVB
INFO: 00:008 U-Boot checkin date(05-10-2013) Version(1.0.FO: detect2CIe C0 Ver=0.15 MCTP en, x8e9b6875 @0x8efbf954 cnt=0x18000
INFO: 00:007 Init PCIe mailbox(PCIe 0xFFEE0150=0x40010000)
INFO: 00:006 m 04:829 Write trace buf mem@0x83000000 to SPI NOR@0x140000 for 0x80000 
PASS: 00:008 Booted Lower Vector, 'uboot1' wdt2cnt=0
INFO: 00:005 wdt0cnt=0
PASS: 00:002 SMR0 no sermux env, default 0xd4
INFO: 00:004 GRACR=0x3c HISEL=0x00 SIRQCR5_D=0x03 SIRQCR6_D=0x01 LADMSK0=0xff2
    :8E
INFO: 00:007 Fan logic is not modified on Non-AC power up
00:052 Env and backup CRC'ed ok
*** no text signature found ***
INFO:FO: 00:000 10:607
 

WDT2: Disabled
Initialization complete, proceed with boot
OS_WDT0_EN:180 seconds,  Re-load ILRAM:
OK
## B 88000age Name:   ssh_eth_init
 
Monolithic/DRB
 
init started: BusyBox v1.18.4 (2014-11-17 05:25:30 CST)
 
starting pid 409, tty '': '/etc/init.d/rcS'
 
waitfor:409 ...
Fri Dec 31 xecute command __source /etc/sysapps_script/I_1170_mknode.sh__
Fri Dec 31 18:00:06 CST 1999 To execu7.79 0.02
/etc/sysapps_script/syslog.sh: /sbin/aim not running
Dec 31 18:00:09 (none) kernel: klogd 1.4.2, log source = /proc/kmsg started.
Dec 31 18:00:09 (none) kernel: Cannot find map file.
Dec 31 18:00:09 (none) kernel: No module symbols loaded - kernel modules not enabled. 
Dec 31 18:00:09 (none) kernel: cannot find any symbols, turning off symbol looku ...kernel: ... ORIG_ROOT_DEV     - 00000000
Dec 31 18:00:09 (none) kernel: ... LOADER_TYPE       - 00000000
Dec 31 18:00:0ernel: ... INITRD_START      - 00000000
Dec 31 18:00:09 (none) kernel: 09e) kernel:     0: 0x00040000 -> 0x0004ea00
Dec 31 18:00:09 (none) kernel: On node 0 totalpages: 59904
Dec 31 18:00:09 (none) kernel: free_area_init_node: node 0, pgdat 8049539c, node_mem_map 804fa000
Dec 31 18:00:09 (none) kernel:   Normal zone: 468 pages used for memmap
Dec 31 18:00:09 (none) kernel:   Normal zone: 0 pages reserved
Dec 31 18:00:09 (none) kernel:   Normal zone: 59436 pageO batch:15
Dec 31 18:00:09 (none) kernel: Built 1 zonelists in Zone order, mobility grouping dev/mmcblk0p2 rootwait rw rootfstype=squashfs mem=239616k console=ttyS2,115200 <NULL> mac1=78:45:C4:F3:00:8D mac2=78:45:C4:F3:0R_IRQS:384
Dec 31 18:00:09 (none) kernel: PID hash table entries: 1024 (order: 10, 4096 bytes)
Dec 31 18:hetries: 16384 (order: 4, 65536 bytes)
Dec 31 18:00:09 (none) kernel: PVR=10300b00 CVR=410 PRR=00003113
Dec 31 18:00:09 (none) kernel: I-cache : n_iases=2
Dec 31 18:00:09 (none) kernel: D-cache : n_ways=4 n_sets=256 way_incr=8192
Dec 31 18:00:09 (none) kernel: D-cache : entry_mask=0x00001fe0 alias_mask=0x00001000 n_aliases=2
Dec 31 18:00:09 (none) krnel: Memory: 232192k/239616k available (3484k kernel code, 1209k data, 156k init)
Dec 31 18:00:09 (none) kerCalibrating delay loop... 230.19 BogoMIPS 150976)
Dec 31 18:00:09 (none) kernel: Security Framk initialized
Dec 31 18:00:09 (none) kernel: Mount-cache hash table entries: 512
D: net_namespace: 980 bytes
Dec 31 18:00:09 (none) kernel: PCI: Using configuration type 1
Dec 31 18:00:09 (none) kernel: NET: Registered protocol family 16
Deckernsh pinmux: sh7757_pfc handling gpio 0 -> 504
Dec 31 18:00:09 (none) kernel: bio: crslab <bio-0> at 0
Dec 31 18e drevice driver usb
Dec 31 18:00:09 (none)
Dec 31 18:00:09 (none) kernel: DMA: Registering sh_dmac handler (24 channels).
Dec 31 18:00:09 (none) kernel: Autoconfig PCI channel 0x8048e8f4
Dec 31 18:00:09 (none) kernel: Scanning bus 00, I/O 0xfedhash table entries: 8192 (order: 4, 65536 bytes)
Dec 31 1tries: 8192 (order: 3, 32768 bytes)
Dec 31 18:00:09 (none) kernel: TCP: Hash tables configured (established 8192 bind 8192)
Dec 31 18:00:09 (none) kernel: TCP reno registered
Dec 31 18:00:09 (none) kernel: Switched to high resolution mode on CPU 0
Dec 31 18:00:09 (none) kernel: NET: Registered protocol family 1
Dec 31 18:00:09 (none) kernel: planar_id: id 2
Dec 31 18:00:09 (none) kernel: enable PCIe shared memory area
Dec 31 18:00:09 (none) kernel: audit: initializing netlink socket (died)
Dec 31 18:00:09 (none) kernel: type=2000 audit(946684800.310:1): initialized
Dec 31 18:00:09 (none) kernel: squashfs: version 4.0 (2009/01/31) Phillip Lougher
31 18:00:09 (none) kernel: JFFS2 version 2.2. (NAND) (SUMMARY)  © 2001-2006 Red Hat, Inc.
Dec 31 18:00:09 (l: fuse init (API version 7.11)
Fri Dec 31 18:00:09 CST 1999 To execute command __source /etc/sysapps_script/I_trab_asdf.sh__
Dec 31 18:00:09 (none) kernel: msgmni has bee none) kernel: alg: o test for compress_null (compress_null-generic)
Dec 31 18:00:09 (none) kernel: alg: No test for stdrng (krng)
Dec 31 18:00:09 (none) kernel: io scheduler noop registered
Dec 31 18:00:09 (none) kernel: io sch registered
Decheduler deadline registered (default)
Dec 31 18:00:09 (nones
00000, 00:00:00:00:00:00, IRQ 315.
Dec 31 18:00:09kernel: sh_spi sh_spi.0: registered master spi0
Dec 31 18:00:09 (none) kernel: m25p80 spi0.1: mx25l3205d (4096 Kbytes)
Dec 31 18:00:09 (none) kernel: Creating 9 MTD partitions on "m25p80":
 31 18:00:09 (none) kernel: 0x000000000000-0x000000080000 : "u-boot1"
Dec 31 18:00:09 (none) kernel: 0x000000080000-0x000000100000 : "u-boot2"
Dec 31 18:00:09 (none) kernel: 0x000000100000-0x000000110000 : "env1"
Dec 31 18:00:09 (none) kernel: 0x0110000-0x000000120000 : "env2"
Dec 31 18:00:09 (none) kernel: 0x000000120000-000 : "fru"
Dec 31 18:00:09 (none) kernel: 0x000000130000-0x000000140000 : "res1"
De0340000 : "lcl"
Dec 31 18:00:09 (none) kernel: 0x000000340000-0x000000400000 : "res2"
Dec 31 18:00:09 (none) kernel: sh_spi sh_spi.0: registered child spi0.1
10
Dec 31 18:00:09 (none) kernel: mknod /dev/aess_wdtdrv c 10 130 
Dec 31 18:00:09 (nsermrmux: version 2010-05-26
Dec 31 18hid_init: Desc: Keyboard/Mouse Function
:00:09 (none) kehid_init: Name: g_kbdmouse
rnel: nf_conntrahid_init: Version: 20120917
ck version 0.5.0hid_bind: Using Major Number 232
 (3744 buckets, hid_bind: using r8a66597_udc, Keyboard ep1 Mouse ep2
14976 max)
 
Dechid_bind: Mouse REL ep3
 31 18:00:09 (none) kernel: IPv4 ove: NET: Registered protocol family 10
Dec 31 18:00:09 (none) kernel: lo: Disabled Privacy Exons
Dec 31 18:00:09 (none) kernel: tunl0: Disabled Privacy Extensions
Dec 31 18:00:09 (none) kernel: ip6_tables: (C) 2000-2006 Netfilter Core Team
De:09 (none) kernel: IPv6 over IPv4 tunndriver
Dec 31 18:00:09 (none) kernel: sit0: Disabled Privacy Extensions
Dec 31 18:00:09 (none) kernel: NET: Registered protocol family 17
Dec 31 18:00:09 (none) kernel: RPC: Regis(none) kernel: RPC: Registered tcp transport module.
Dec 31 18:00:09 (none) kernel: 802.1Q VLAN Support v1.8 Ben Greear <[email protected]>
Dec 31 18:00:09 (none) kerns added by David S. Miller <[email protected]>
Dec 31 18:00:09 (none) kernel: registered taskstats version 1
Dec 31 18:00:09 (none) kernel: Waite) el: mmcblk0: mmc0:0001 HYNIX  3.60 GiB 
Dec 31 18:00:09 (none) kernel: blk0: p1 p2 p3 p4 < p5 p6 p7 p8 p9 p10 p11 p12 p13 p14 p15 >
Dec 31 18:00:09 (none) kernel: mmc1: power on - 8e
Dec 31 18:00:09 (none) kernel: VFS: Mounted root (squashfs filesystem) readonly on device 179:2 156k freed
Decone) kernel: mmc1: non-Dell SD detected
Dec 31 18:00:09 (none) kernel: mmc1: new DHC card at address b368
Dec 31 18:00:09 (none) kernel: mmcblk1: mmc1:b368 SDC   30.2 GiB 
Dec 31 18:00:09 (none) kernel:  mmcblk1: p1
Dec 31 18:00:09 (none) kernel: kjournald starting.  Commit ial journal
Dec 31 18:00:09 (none) kernel: EXT3-fs: recovery complete.
Dec 31 18:0(0 dead, 0 orphan) found.
Dec 31 18:00:10 (none) kernel: KN:init_aess_mem_module
Dec 31 18:00:10 (none) kemknod /dev/aess_gpiodrv c 250 0
Dec 31 18:00:ss_sgpiodrv c 249 0
Dec 31 18:00:10 (none) kernel: mknod /dev/aess_dynairqdrv c 248 0
D0:10 (none) kernel: IRQ 236/aess_dynairqdrv: IRQF_DISABLED is not guaranteed on shared IRQs
Dec 31 18:00:10 (none) kern8:00:10 (none) kernel:  hwrng registration sucessed
Dec 31 18:00:10 (none) kernel: cbc(aes) ecb(aes) ecb(des3_ede) cbc(des3_ede) sha1 sha256 hmac(sha1) hmac(sha256) <6>
Dec 1 18:00:10 (none) kernel: mknod /dev/aess_fansnod /dev/vkcs c 240 0
Dec 31 18:00:10 (none) kernel: mknod /dev/aess_memdrv c 239 0
 
Dec 31 18:00:10 (none) kernel: mknod /dev/aess_spi1drv c 238 0
Dec 31 18:00:10 (none) kernel: mknod /dev/dell_cplddrv c 237 0
Dec 31 18:00:10 (none) kernel: mknoddrv c 236 0
Dec 31 18:00:10 (none) kernel: aess_rspi_init: isblade=0 val=0x2
Dec 31 18:00:10 (no 1800:10 (none) kernel: mknod /dev/sh_pbi c 233 0
Dec 31 18:00:10 (none) kernel: sh_pbi: 4kb Shared memoryRQ 320
Deec :10 (none) kernel: g_mass_storage: msd_i0 (none) kernel: g_mass_storage: msd_init() Name: g_mass_storage
Dec 31 18:00:10 (none) kernel: g_m0919
Dec 31 18:00:10 (none) kernel: Now registering e 18:00:10 (none) kernel: g_mass_storage2: msd_init() Desc: Mass Storage Function
Dec l: g_mass_storage4: msd_bind() Using Major Nu
waitfor: pid 409, wpid -1
SCSI subsystem initialized
Driver 'sd' needs updating - please use bus_type methods
Dec 31 18:00:12 (none) kernel: Driver 'sd' needs updating - please use bus_type methods
ss, the pid is 734!
13.55 0.04
(none) kernel: Initializing USB Mass Storage driver...
Dec 31 18:00:13 (none) kernel: usbcore: registered new intDec 31 18:00:13 (none) kernel: USB Mass Storage support registered.
 usb drivers version: 1.1.0.3
Fri Dec 31 18:00:13 CST 199aess_video_init Avocent Video Driver installed
allocate_video_buffer ulEcc_enabled 0x00000000 ulEcd_clock_stop 0x00000000 ulMcr_ecc_enabled 0x00000001
allocate_video_buffer_dynamically- video_buffer_phys: 47000000 video_buffer_size: 0x00EAE000
Dec 31 18:00:13 (none) kernel: aess_video_init Avocent Video Driver installed
 
Dec 31 18:00:13 (none) kernel: allocate_video_buffer ulEcc_enabled 0x00000000 ulEcd_clock_stop 0x00000000 ulMcr_ecc_enabled 0x00000001
 
Dec 31 18:00:13 (ne comm __touch /flash/data0/o/maserinit__
 18:EXT2-fs warning: mounting unchecked fs, running e2fsck is recommended
Dec 31 18:00:14 (none) kernel: EXT2-fs warning: mounting unchecked fs, running e2fsck is recommended
 
mv: cclogs: Read-only file system
 
Dec 31 18:00:15 (none) syslogd 1.4.2: restart.
 
Dec 31 18:00:15 (none) kernel: klogd 1.4.2, log source = /proc/kmsg started.
 
Dec 31 18:00:15 (none) kernel: Cannot find map file.
 
Dec 31 18:00:15 (none) kernel: No module symbols loaded - f symbSetting Debut ...
Debug Level set to: 1 (Critical)
Debug Source set to: 1024 (All Sources)
Debug Output set to: 2 (Rs))
Debug Extra Options set to: 0 (No Extra Options)
IPMI Trace Buffer Stopped
Generic Trace Buffer StIRQCR Write OK! -- SIRQCR_SELIRQ10  = 1
 
 KCSSI      513       16384  83 Linux
Partition 1 does not end on    0 Empty
Partition 3 does not end on cylinder boundary
/dev/mmcblk0p4            4097       85184     2594815+  5 Extended
Partition 4 does not end on cylinder boundary
/dev/mmcblk0p5            4097        4609       16384  83 Linux
/dev/mmcblk0p6            4609        8177      114176   0 Empty
/dev/mmcblk0p7            8177        8193         512   0 Empty
/dev/mmcblk0p8            8193       18433      327680    18689       18817        4096  83 Linux
/dev/mmcblk0p12          18817       63937     1443840  83 Linux
/dev/mmcblk0p13     lervalconds
 
Dec 31 18:00:16 (none) kernel: EXT3-fs warning: mounting fs with errors, running e2fsck is recommend : mounystem with writeback data mode.
 
 done.
FreshAir Partition type = "ext2" 
 Checking FS Dec 31 18:00:16 (none) kernel: EXT2-fs warning: mounting unchecked fs, running e2fsck is recommended
 
 done.
 done.
Fri Dec 31 18:00:16 CST 1999 To execute command __/etc/sysapps_script/S_1000_AIM.sh start__
h st
=========================
AMEA card is present or not      
=================================
Read CPLD Offset 0x21 Bit 3
c 31 18:00:17 CST 1999 Toend_request: I/O error, dev mmcblk0, sector 1196698
end_request: I/O error, dev mmcblk0, sector 1196700
end_request: I/O error, dev mmcblk0, sector 1196702
end_request: Icblk0: retrying using single block read
sh_mmcif: Cmd(d'17) err
mmcblk0: error -84 sending read/write command, responmmcblrror -84 sending read/write command, response xd40
end_request: I/O error, dev mmcblk0, sector 524296
sh_mmcif: Cmd(d'17) err
mmcblk0: error -84 sending read/write command, response 0x0, card status 0xd40
end_request: I/O error, dev mmcblk0, sector 524297
sh_mmcif: Cmd(d'17) err
mmcblk0: error -84 sending read/write command, response 0x0, card status 0xd40
end_requ4command, responsrequest: I/O error, dev mmcblk0, sector 524300
Buffer I/O error on device mmcblk0p8, logical block 0
sh_mmcif: Cmd(d9 (none) kernel: mmcblk0: error -84 sending read1 1end_request: mmcblk0: error -nding read/write command, response 0x0, card status 0xd40
I/O errormend_request: I/O error, dev mmcblk0, sector 524302
k0, sector 1sh_mmcif: Cmd(d'17) err
196670
 
Dec 31 18:00: kernel: end_request: I/O error, dev mmcblk0, sector 1196672
 
Dec 31 18:00:19 (none) kernel: end_request: I/O error, devmmcblk0: error -84 sending read/write command, response 0x0, card status 0xd40
 mmcblk0, sectorend_request: I/O error, dev mmcblk0, sector 524303
 1196674
 
Dec 3sh_mmcif: Cmd(d'17) err
1 18:00:19 (none) kernel: end_request: I/O err966mmcblk0: error -84 sending read/write command, response 0x0, card status 0xd40
78
 
Dec 31 18:0end_request: I/O error, dev mmcblk0, sector 524306
0:19 (none) kernsh_mmcif: Cmd(d'17) err
el: end_request:mmcblk0: error -84 se error -84 sending read/write command, response 0x0, card status 0xd00:19 (none)end_request: I/O error, dev mmcblk0, sector 524308
Buffer I, logical block 1
 kernel: end_reqsh_mmcif: Cmd(d'17) err
uest: I/O error,mmcblk0: error -84 sendi read/write command, response 0x0, card status 0xd40
 dev mmcblk0, seend_reerror, dev mmcblk0, sector 524309
ctor 1196682
 
Dsh_mmd(d'17) err
ec 31 18:00:19 (mmcblk0: error -84 sending rea 524310
d_request: , card status 0xd40
 
Dec 31 18:00:19end_request: I/O error, dev mmcblk0, sect312
 (none) kernel: s:19 (none) kerend_request: I/O error, dev mmcblk0, sector 524314
nel: end_requestsh_mmcif: Cmd(d'17) err
: I/O error, devmmcblk0: error -84 sng read/write command, response 0x0, card status 0xd40
 mmcblk0, sectorend_requogical block 2
quest: I/O errorsh_mmcif: Cmd(d'17) err
, dev mmcblk0, smmcblk0: response 0x0, card status 0xd40
ector 1196692
 
end_request: I/O error, dev  18:0end_request: I/O error, dev mmcblk0, sec cesponse 0x0, card status 0xd40
 18:00:19 (none)end_request: I/O error, dev mmcblk0, sector 524321
 kernel: end_reqsh_mmcif: Cmd(d'17) err
uest: I/O error,mmcblk0: error -84 sending read/write command, response 0x0, card status 0xd40
 dev mmcblk0, seend_request: I/O error, dev mmcblk0, sector 524322
ctor 1196698
 

From run to run I see it different:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
 

KCSSIRQCR Write OK! -- SIRQCR_IRQ10E2  = 1
rs
ition 1 does not end on cylinder b        4097       85184     2594815+  5 Extended
Partition 4 does not end on cylinder boundary
/dev/mmcblk0p5            4097        4609       16384  83 Linux
/dev/mmcblk0p6            4609        8177      114176   0 Empty
/dev/mmcblk0p7            8    8193         512   0 Empty
/dev/mmcblk0p8            8193       18433      327680   0 Empty
/dev/mmcblk0p9           18433       18561        4096   0 Empty
/dev/m 1868    4096   0 Empty
/dev/mmcblk0p11          18689       18817        4096  83 Linux
/dev/mmcblk0p840  83 Linux
/dev/mmcblk0p13          63937       65463       48 Checking FS  Mounting EXT3-fs warning: mounting fs with errors, running e2fsck is recommended
Dec 31 18:00:17 (none) fs warning: mounting unchecked fs, running e2fsck is recommended
 

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
 

Units = cylinders of 64 * 512 = 32768 bytes
 
        Device Boot      Start      k0p5      Empty
/dev/mmcblk0p7            8177        8193         512   0 Empty
/dev/mmcblk0p9           18433       18561        4096   0 Empty
/dev/mmcblk0p10          18561       18689        4096   0 Empty
/dev/mmcblk0p11          18689       18817        4096  83 Linux
/dev/mmcblk0p12          18817       63937     1443840  83 Linux
lk0p13          63937       65463       48828  83 Linux
/dev/mmcblk0p14          65463            2048  83 Linux
/dev/mmcblk0p15          65655       84855      614400+ 83 Linux
Core Dump Partition Size = 48828, type = 
 Checking FS  Mounting EXT3-fs ws with errors, running e2fsck is recommended
Dec 31 18:00:16 (none) kernel: kjournald start0lk0:00:16 (none) kernel: EXT3-fs: recovery complete.
 
Dec 31 18:00:16 (none) kernel: EXT3-fs: mounted filesystem with writeback data mode.
 

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
 

4 heads, 16 sectors/track, 118272 cylinders
Units = cylinders of768 bytes
 

 
        Device Boot      Start         End      Blocks  Id System
/dev/mmcblk0p1   *           1         513       16384  83 Linux
Partition 1 does not end on cylinder boundary
/dev/mmcblk0pty
Partition 2 does not end on cylinder boundary
/dev/m            4081        4097         512   0 Empty
Partition 3 does not end on cylinder boundary
/dev/mmcblk0p4            4097       85184     2594815+  5 Extended
Partition 4 does not end on cylinder boundary
/dev/mmcblk0p5        v/mmcblk0p7            8177        8193         512   0 Empty
/dev/mmcblk0p8            8193       18433      327680   0 Empty
/dev/mmcblk0p9        
Dec(none) kernel: EXT3-fs: recovery complete.
 
Dec 31 18:00:16 (none) kernel: EXT3-fs: mounted filesystem with writeback data mode.
 
 done.
FreshAir Partition t mounting unchecked fs, running e2fsck is recommended
Dec 31 18:00:16 (none) kernel: EXT2-fs warning: mounting unchecked fs, running e2fsck is recommended
 
 done.
 done.
Fri Dec 31 18:00:16 CST 1999 To ex:00:17 CST 1999 To execute command __/etc/sysapps_script/S_3000_st/S_3ular_setup.sh start__
mmcblk0: retrying using ing read/write command, response 0x0, card status 0xd40
 mmcblk0: retryiend_request: I/O error, dev mmcblk0, d(d'1718:0mmcblk0: error -84 sending read/write command, response 0x0, card status 0xd40
0:19 (none) kernend_request: I/O error, dev mmcblk0, sector el: sh_mmcif: Cmd(d'17) sh_mmcif: Cmd(d'17) err
err
 

And this loop output with changing sector:

1
2
3
 

Dec 31 18:01:24 (none) kernel: mmcblmmcblk0: error -84 sending read/write command, response 0x0, card status 0xd40
k0: retrying usiend_request: I/O error, dev mmcblkec 31 18:01:24 mmcblk0: error -84 sending read/write command, response 0x0, card status 0xd40
(nokernel: eend_request: I/O error, dev mmcblk0, sector 82035
 

[rgrimes]

@immelrikt From reading your logs I have 2 comments, one it appears as if you may have a serial connection that is dropping characters and that is why you "see it different" between runs. My look at the differences all just appear to be missing characters. Your serial cable is too long most likely. Second you are getting a few mmcblk0 I/O errors, and those are never good.

I do not believe your partition table is corrupt. BUT before attempting to make any repairs you should try to get this serial connection running reliably as I have a feeling much is missing from your boot logs.

[2ndbedtime]

Removed - Dupe Post

[2ndbedtime]

@clear

Hello,

I have a similar problem with iDRAC7 on one R620. The server is starting normally, ‘configuring memory’ and then stucks at iDrac initialization. After long wait time it writes ‘iDRAC initialization failed’ and reboots. I soldered the UART pins and i got serial output. It stops at systemd[1]: Failed to insert ‘autofs4’ and after long wait shows the reset of output and stucks there.
I also tried to jump the A2,B2 pins in the sw_idrac_dbg region but it not disrupt the u-boot process.
Can you provide any insight about this?

@clear
I have exactly the same issue - did you manage to sort it?

[alucard666]

I successfully replaced emmc chip! All OK, idrac recovery firmware done, but problems with licence. I have read old EMMC, but in partition 11 there is no XML file in rsdsafe/lm directory, only binary LdsrDev. I think that LdsrDev is compiled xml. Anyone can help to extract XML license?

[codebreaker]

Great thread!

I’m working on fixing my R320. Read trough all posts twice and I am a bit confused regarding steps at replacing eMMC chip.
Basically, my eMMC failed so I’ve ordered H26M31001FPR to replace the existing one. I don’t need to recover the licence or anything from the chip, I just need the fans to stop going crazy.

In that case, I just replace the chip, pop-in an sd card with firmimg.d7 and wait for it to flash eMMC and I’m done?

If it can’t do automatically, I have to get into u-boot to get to the idrac7 prompt and then execute util recover -emmc -from sd -f firmimg.d7?

[rgrimes]

@codebreaker I am not sure how you know for certain that it is the emmc chip that has failed. If your assertion is true then yes, replacing the chip and then powering on with a sdcard with firmimg.d7 should reflash the emmc. If you dont have access to the uboot console I do not know how you could of determined that the emmc is bad, if your making that assumption on roaring fans that is NOT the only cause of this! One thing it can cause roaring fans is a simple as an unknown by dell PCIe card.

[codebreaker]

@rgrimes I tried to recover it with all of the software methods mentioned in this topic and beyond. Last time I checked, I could boot into linux but it is spewing "I/O error, dev mmcblk0…". I can also access u-boot console (using interupt) and I tried util recover -emmc -from sd -f firmimg.d7 and it did show error Failure writing blocks.... mmcinfo command returns Capacity 0. Conclusion in the previous posts was that the emmc has failed.

I did recovered it once by inserting sd card in the back. The blue LED flashed in 1/2 sec intervals and then after boot, solid amber, and it worked for a few minutes until I booted into Dell ISO and it automatically upgraded idrac to latest version… Now the back LED does not even flash blue, it is always off.
After replacing emmc the LED should start to blink on boot denoting that the bootloader is checking for the SD card?

[rgrimes]

@codebreaker Hum, have you checked the console since you "upgraded idrac to latest version" as this may be that you stepped versions in a wrong way and that has corrupted things. There are some notes about going from 1.x to 2.x iDrac code that if not done correctly does infact brick your iDrac. Your emmc is not damaged, or should not be by this incorrect updating, but getting it recovered is a PITA. The fact that you did successful recover and run leads me to believe your emmc is not physically damanged, or that would of failed too. A careful look at the current uboot log may provide some information.

The blinking LED can indicate different things depending on colour and rate, it can be blue or yellow and slow blink, fast blink or on solid. Some place there is a table of what these mean.

[2ndbedtime]

@2ndbedtime

Zitat von clear im Beitrag #102

---

Hello,

I have a similar problem with iDRAC7 on one R620. The server is starting normally, 'configuring memory' and then stucks at iDrac initialization. After long wait time it writes 'iDRAC initialization failed' and reboots. I soldered the UART pins and i got serial output. It stops at systemd[1]: Failed to insert 'autofs4' and after long wait shows the reset of output and stucks there.
I also tried to jump the A2,B2 pins in the sw_idrac_dbg region but it not disrupt the u-boot process.
Can you provide any insight about this?

@clear
I have exactly the same issue - did you manage to sort it?

---

I’ve added the following output to see if anyone can help.

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
 

U-Boot 2009.08 (May 11 2019 - 03:59:51) Avocent (0.0.3) EVB
 
CPU: SH-4A
BOARD: R0P7757LC00xxRL (Cn step) board
BOOT: Secure, HRK generated
DRAM:  240MB
  (240MB of 256MB total DRAM is available on U-Boot)
ENV:   Using primary env area.
Undefined env FWN
Undefined env FWN1
Undefined env fwu_act
Undefined env Failsafe_PowerON_Lockout
Undefined env cpld_recover_cnt
Undefined env ddr_recover_cnt
Restore env etherc0=D4:BE:D9:F0:99:6C
Restore env getherc0=D4:BE:D9:F0:99:6D
Restore env first_ac=yes
Restore env wdt2cnt=3
Restore env ethaddr=D4:BE:D9:F0:99:6C
Restore env eth2addr=D4:BE:D9:F0:99:6D
Restore env macs_in_res1=yes
Restore env ethact=sh_g_eth.0
Restore env dmn=disabled
Restore env wdt0cnt=4
In:    serial
Out:   serial
Err:   serial
PCIe:  Bridge loaded with 0x18000 bytes
WDT2:  Booted Lower Vector, 'uboot1'
sh_mmcif: 0, sh-sdhi: 1
Net:   sh_eth.0, sh_g_eth.0
INFO: 00:002 Start-up -to- util_idrac_main()
INFO: 00:004 U-Boot 2009.08 (May 11 2019 - 03:59:51) Avocent (0.0.3) EVB
INFO: 00:007 U-Boot checkin date(10-04-2018) Version(1.1.34)
INFO: 00:009 iDRAC PPID <NULL>
INFO: 00:003 SPI NOR init 4096 KiB N25Q032 bus=0 cs=0, speed=1000000, mode=3
INFO: 00:007 SH-4A Product: Major Ver=0x31  Minor Ver=0x13 C3 Little endian
             Family=0x10    Major Ver=0x30  Minor Ver=0x0b
INFO: 00:139 BCM54610 OUI=0x00d897  Model=0x26  Revision=0x0a PhyAddr=1
INFO: 00:007 Dedicated monolithic mgmt NIC enabled (vendor mode override)
INFO: 00:163 SD CARD:   Device: sh-sdhi   Manufacturer ID: 12   OEM: 3456
             Name: SMI     Tran Speed: 25000000   Rd Blk Len: 512
             SD ver 2.0   HC: No   cap(<2gb): 1991245824  cap(>2gb): 0
             ext_rev: 0    rst_n: 0  ext[96]: 0
INFO: 00:063 EMMC:   Device: sh_mmcif   Manufacturer ID: 90   OEM: 14a
             Name: HYNIX   Tran Speed: 25000000   Rd Blk Len: 512
             MMC ver 4.0   HC: Yes   cap(<2gb): 0  cap(>2gb): 7569408
             ext_rev: 5    rst_n: 0  ext[96]: 0
INFO: 00:024 CPLD: Major Ver=0x1  Minor Ver=0x0  Maint Ver=0x3
             Planar: Type=0x02  Rev=0x8  Rework=0x8  Scratch/PathRetry=0x00
PASS: 00:014 Coin cell detected good,  AD=0x392 low water=0x2c1
PASS: 00:008 PCIe SH7757_C0 Ver=0.15 MCTP en, CRC=0x8e9b6875 @0x8efbd4ec cnt=0x18000
INFO: 00:007 Init PCIe mailbox(PCIe 0xFFEE0150=0x40010000)
INFO: 00:006 mode=vhard 
INFO: 00:002 reset_cause=ac 
PASS: 00:005 Booted Lower Vector, 'uboot1' wdt2cnt=3
INFO: 00:005 wdt0cnt=4  cpld_recover_cnt=0  ddr_recover_cnt=0  
PASS: 00:007 Clear CH1/CH2, clear 4K shared memory@0xffcaa000 on AC power up
PASS: 00:007 SMR0 no sermux env, default 0xd4
INFO: 00:004 GRACR=0x3c HISEL=0x00 SIRQCR5_D=0x03 SIRQCR6_D=0x01 LADMSK0=0xff2
             MRSTCR0=0xfedffe7f MRSTCR1=0xfff3ff0f MRSTCR2=0x6f80feff
             BARMAP=0x1 BCR=0x85000000 NCER=0x01fc NCMCR=0x0006 NCCSR=0x0303
PASS: 00:022 etherc0=D4:BE:D9:F0:99:6C
             getherc0=D4:BE:D9:F0:99:6D
INFO: 00:009 Fan logic for monolithic planar type 2
             fan1 - def 0000 1fff 3d   fan2 - def 0000 1fff 3d   
             fan3 - def 0000 1fff 3d   fan4 - def 0000 1fff 3d   
             fan5 - def 0000 1fff 3d   fan6 - def 0000 1fff 3d   
             fan7 - def 0000 1fff 3d   fan8 - def 0000 1fff 3d   
INFO: 00:076 Env and backup CRC'ed ok
Erasing SPI flash at 0x100000...Writing to SPI flash...done
Erasing SPI flash at 0x110000...Writing to SPI flash...done
*** no text signature found ***
INFO: 02:502 Sync eMMC/SPI NOR/Alternate u-boot images
PASS: 00:264 Current u-boot1 1.1.34 verified with 'ubootN'
             Trailer Struct - Missing start token, exp=0xc0de1111 rec=0x0
             U-boot2 in sync with u-boot1 1.1.34 
INFO: 00:017 Verify OS Images N: ENV FWN is missing
PASS: 00:005 Boot device=emmc  Boot partition1/N
             Boot Path Retry:P1/N=0 P5/N-1=0
INFO: 00:000 03:459
OS_WDT0_EN:180 seconds,  Re-load ILRAM:
SPI_WP: Not attempted.
EMMC_WP: Not attempted.
Boot Path Retry:P1/N=0 P5/N-1=0
Copying kernel image ... OK
## Booting kernel from Legacy Image at 88000000 ...
   Image Name:   sh-linux
   Image Type:   SuperH Linux Kernel Image (gzip compressed)
   Data Size:    3081529 Bytes =  2.9 MB
   Load Address: 80001000
   Entry Point:  80002000
   Verifying Checksum ... OK
   Uncompressing Kernel Image ... OK
WDT2: Disable in do_bootm_linux()
 
Monolithic/DRB
systemd[1]: could not find module by name='autofs4'
systemd[1]: Failed to insert 'autofs4'
Jan  1 10:31:01 idrac8 syslogd 1.4.2: restart.
display_factory_info.sh[2255]: cat /etc/fw_ver
display_factory_info.sh[2255]: 2.63.01.60.62
display_factory_info.sh[2255]: 2.63.60.62.3
display_factory_info.sh[2255]: built for - system
display_factory_info.sh[2255]: Sat May 11 04:17:45 CDT 2019
display_factory_info.sh[2255]: 190511041745
display_factory_info.sh[2255]: IDRAC SVN Rev  =
display_factory_info.sh[2255]: Hudson Project = idrac-13g-IPS-release-A-X-Rev
display_factory_info.sh[2255]: Hudson Build # = 78
display_factory_info.sh[2255]: Release ID     =
display_factory_info.sh[2255]: MSC Revision = https[COLON]//pgre-svn2[DOT]us[DOT]dell[DOT]com/svn/LC/13g/branches/rts_https_wp2/msc 5367
display_factory_info.sh[2255]: cat /proc/cmdline
display_factory_info.sh[2255]: root=/dev/mmcblk0p2 rootwait rw rootfstype=squashfs mem=239616k console=ttyS2,115200 <NULL> mac1=D4:BE:D9:F0:99:6C mac2=D4:BE:D9:F0:99:6D mode=vhard reset_cause=ac nmi_buf=0x83000000 quiet console=ttySC2,115200 init=/sbin/init
display_factory_info.sh[2255]: cat /tmp/loguboot
display_factory_info.sh[2255]: L1, S13  INFO: 00:002 Start-up -to- util_idrac_main()
display_factory_info.sh[2255]: L1, S13  INFO: 00:004 U-Boot 2009.08 (May 11 2019 - 03:59:51) Avocent (0.0.3) EVB
display_factory_info.sh[2255]: L1, S13  INFO: 00:007 U-Boot checkin date(10-04-2018) Version(1.1.34)
display_factory_info.sh[2255]: L1, S13  INFO: 00:009 iDRAC PPID <NULL>
display_factory_info.sh[2255]: L1, S13  INFO: 00:003 SPI NOR init 4096 KiB N25Q032 bus=0 cs=0, speed=1000000, mode=3
display_factory_info.sh[2255]: L1, S13  INFO: 00:007 SH-4A Product: Major Ver=0x31  Minor Ver=0x13 C3 Little endian
display_factory_info.sh[2255]: Family=0x10    Major Ver=0x30  Minor Ve
display_factory_info.sh[2255]: L1, S13  INFO: 00:139 BCM54610 OUI=0x00d897  Model=0x26  Revision=0x0a PhyAddr=1
display_factory_info.sh[2255]: L1, S13  INFO: 00:007 Dedicated monolithic mgmt NIC enabled (vendor mode override)
display_factory_info.sh[2255]: L1, S13  INFO: 00:163 SD CARD:   Device: sh-sdhi   Manufacturer ID: 12   OEM: 3456
display_factory_info.sh[2255]: Name: SMI     Tran Speed: 25000000   Rd B
display_factory_info.sh[2255]: L1, S13  INFO: 00:063 EMMC:   Device: sh_mmcif   Manufacturer ID: 90   OEM: 14a
display_factory_info.sh[2255]: Name: HYNIX   Tran Speed: 25000000   Rd Blk
display_factory_info.sh[2255]: L1, S13  INFO: 00:024 CPLD: Major Ver=0x1  Minor Ver=0x0  Maint Ver=0x3
display_factory_info.sh[2255]: Planar: Type=0x02  Rev=0x8  Rework=0x8  Scratch/Path
display_factory_info.sh[2255]: L1, S13  PASS: 00:014 Coin cell detected good,  AD=0x392 low water=0x2c1
display_factory_info.sh[2255]: L1, S13  PASS: 00:008 PCIe SH7757_C0 Ver=0.15 MCTP en, CRC=0x8e9b6875 @0x8efbd4ec cnt=0x18000
display_factory_info.sh[2255]: L1, S13  INFO: 00:007 Init PCIe mailbox(PCIe 0xFFEE0150=0x40010000)
display_factory_info.sh[2255]: L1, S13  INFO: 00:006 mode=vhard
display_factory_info.sh[2255]: L1, S13  INFO: 00:002 reset_cause=ac
display_factory_info.sh[2255]: L1, S13  PASS: 00:005 Booted Lower Vector, 'uboot1' wdt2cnt=3
display_factory_info.sh[2255]: L1, S13  INFO: 00:005 wdt0cnt=4  cpld_recover_cnt=0  ddr_recover_cnt=0
display_factory_info.sh[2255]: L1, S13  PASS: 00:007 Clear CH1/CH2, clear 4K shared memory@0xffcaa000 on AC power up
display_factory_info.sh[2255]: L1, S13  PASS: 00:007 SMR0 no sermux env, default 0xd4
display_factory_info.sh[2255]: L1, S13  INFO: 00:004 GRACR=0x3c HISEL=0x00 SIRQCR5_D=0x03 SIRQCR6_D=0x01 LADMSK0=0xff2
display_factory_info.sh[2255]: MRSTCR0=0xfedffe7f MRSTCR1=0xfff3ff0
display_factory_info.sh[2255]: L1, S13  PASS: 00:022 etherc0=D4:BE:D9:F0:99:6C
display_factory_info.sh[2255]: getherc0=D4:BE:D9:F0:99:6D
display_factory_info.sh[2255]: L1, S13  INFO: 00:009 Fan logic for monolithic planar type 2
display_factory_info.sh[2255]: fan1 - def 0000 1fff 3d   fan2 - def 0000 1fff 3d
display_factory_info.sh[2255]: L1, S13  INFO: 00:076 Env and backup CRC'ed ok
display_factory_info.sh[2255]: L1, S13  INFO: 02:502 Sync eMMC/SPI NOR/Alternate u-boot images
display_factory_info.sh[2255]: L1, S13  PASS: 00:264 Current u-boot1 1.1.34 verified with 'ubootN'
display_factory_info.sh[2255]: Trailer Struct - Missing start token, exp=0xc0de1111 rec
display_factory_info.sh[2255]: L1, S13  INFO: 00:017 Verify OS Images N: ENV FWN is missing
display_factory_info.sh[2255]: L1, S13  PASS: 00:005 Boot device=emmc  Boot partition1/N
display_factory_info.sh[2255]: Boot Path Retry:P1/N=0 P5/N-1=0
display_factory_info.sh[2255]: L1, S13  INFO: 00:000 03:459
display_factory_info.sh[2255]: /bin/MemAccess -ww ffec0030 5500
display_factory_info.sh[2255]: +               0    2    4    6 :    8    A    C    E
display_factory_info.sh[2255]: ------------------------------------------------------
display_factory_info.sh[2255]: 0xffec0030 = 5500 0000 0400 2900 : e700 0100 8f00 0000
display_factory_info.sh[2255]: 0xffec0040 = 7a00 0e00 1f00 6b00 : fe00 2400 6f00 2000
display_factory_info.sh[2255]: ^
display_factory_info.sh[2255]: /bin/MemAccess -rb 0x14000000
display_factory_info.sh[2255]: +             0  1  2  3  4  5  6  7 :  8  9  A  B  C  D  E  F
display_factory_info.sh[2255]: --------------------------------------------------------------
display_factory_info.sh[2255]: 0x14000000 = 01 00 03 00 02 00 00 00 : 08 00 00 00 01 00 06 08
display_factory_info.sh[2255]: 0x14000010 = 00 0c 00 00 0f 00 0c 00 : 00 0f 0c 07 03 0c 0c 0f
display_factory_info.sh[2255]: 0x14000020 = 02 07 0f 0f 00 00 00 00 : 00 00 00 0b 08 00 03 01
display_factory_info.sh[2255]: 0x14000030 = 00 00 00 00 00 00 00 00 : 00 00 00 00 00 00 00 00
 

U-Boot 2009.08 (May 11 2019 - 03:59:51) Avocent (0.0.3) EVB
 
CPU: SH-4A
BOARD: R0P7757LC00xxRL (Cn step) board
BOOT: Secure, HRK generated
DRAM:  240MB
  (240MB of 256MB total DRAM is available on U-Boot)
ENV:   Using primary env area.
Undefined env FWN
Undefined env FWN1
Undefined env fwu_act
Undefined env Failsafe_PowerON_Lockout
Undefined env cpld_recover_cnt
Undefined env ddr_recover_cnt
Restore env etherc0=D4:BE:D9:F0:99:6C
Restore env getherc0=D4:BE:D9:F0:99:6D
Restore env first_ac=yes
Restore env wdt2cnt=3
Restore env ethaddr=D4:BE:D9:F0:99:6C
Restore env eth2addr=D4:BE:D9:F0:99:6D
Restore env macs_in_res1=yes
Restore env ethact=sh_g_eth.0
Restore env dmn=disabled
Restore env wdt0cnt=4
In:    serial
Out:   serial
Err:   serial
PCIe:  Bridge loaded with 0x18000 bytes
WDT2:  Booted Lower Vector, 'uboot1'
sh_mmcif: 0, sh-sdhi: 1
Net:   sh_eth.0, sh_g_eth.0
INFO: 00:002 Start-up -to- util_idrac_main()
INFO: 00:005 U-Boot 2009.08 (May 11 2019 - 03:59:51) Avocent (0.0.3) EVB
INFO: 00:006 U-Boot checkin date(10-04-2018) Version(1.1.34)
INFO: 00:009 iDRAC PPID <NULL>
INFO: 00:003 SPI NOR init 4096 KiB N25Q032 bus=0 cs=0, speed=1000000, mode=3
INFO: 00:007 SH-4A Product: Major Ver=0x31  Minor Ver=0x13 C3 Little endian
             Family=0x10    Major Ver=0x30  Minor Ver=0x0b
INFO: 00:140 BCM54610 OUI=0x00d897  Model=0x26  Revision=0x0a PhyAddr=1
INFO: 00:006 Dedicated monolithic mgmt NIC enabled (vendor mode override)
INFO: 00:164 SD CARD:   Device: sh-sdhi   Manufacturer ID: 12   OEM: 3456
             Name: SMI     Tran Speed: 25000000   Rd Blk Len: 512
             SD ver 2.0   HC: No   cap(<2gb): 1991245824  cap(>2gb): 0
             ext_rev: 0    rst_n: 0  ext[96]: 0
INFO: 00:062 EMMC:   Device: sh_mmcif   Manufacturer ID: 90   OEM: 14a
             Name: HYNIX   Tran Speed: 25000000   Rd Blk Len: 512
             MMC ver 4.0   HC: Yes   cap(<2gb): 0  cap(>2gb): 7569408
             ext_rev: 5    rst_n: 0  ext[96]: 0
INFO: 00:024 CPLD: Major Ver=0x1  Minor Ver=0x0  Maint Ver=0x3
             Planar: Type=0x02  Rev=0x8  Rework=0x0  Scratch/PathRetry=0x00
PASS: 00:014 Coin cell detected good,  AD=0x390 low water=0x2c1
PASS: 00:008 PCIe SH7757_C0 Ver=0.15 MCTP en, CRC=0x8e9b6875 @0x8efbd4ec cnt=0x18000
INFO: 00:008 Init PCIe mailbox(PCIe 0xFFEE0150=0x40010000)
INFO: 00:005 mode=vhard 
INFO: 00:003 reset_cause=BIOS 
PASS: 00:004 Booted Lower Vector, 'uboot1' wdt2cnt=3
INFO: 00:006 wdt0cnt=4  cpld_recover_cnt=0  ddr_recover_cnt=0  
PASS: 00:006 SMR0 no sermux env, default 0xd4
INFO: 00:004 GRACR=0x3c HISEL=0x00 SIRQCR5_D=0x03 SIRQCR6_D=0x01 LADMSK0=0xff2
             MRSTCR0=0xfedffe7f MRSTCR1=0xfff3ff0f MRSTCR2=0x6f80feff
             BARMAP=0x1 BCR=0x85000000 NCER=0x01fc NCMCR=0x0006 NCCSR=0x0303
PASS: 00:021 etherc0=D4:BE:D9:F0:99:6C
             getherc0=D4:BE:D9:F0:99:6D
INFO: 00:008 Fan logic is not modified on Non-AC power up
INFO: 00:052 Env and backup CRC'ed ok
*** no text signature found ***
INFO: 00:692 Sync eMMC/SPI NOR/Alternate u-boot images
PASS: 00:077 Current u-boot1 1.1.34 verified with 'ubootN'
             Trailer Struct - Missing start token, exp=0xc0de1111 rec=0x0
INFO: 00:013 Verify OS Images N: ENV FWN is missing
PASS: 00:005 Boot device=emmc  Boot partition1/N
             Boot Path Retry:P1/N=0 P5/N-1=0
INFO: 00:000 03:365
OS_WDT0_EN:180 seconds,  Re-load ILRAM:
SPI_WP: Not attempted.
EMMC_WP: Not attempted.
Boot Path Retry:P1/N=0 P5/N-1=0
Copying kernel image ... OK
## Booting kernel from Legacy Image at 88000000 ...
   Image Name:   sh-linux
   Image Type:   SuperH Linux Kernel Image (gzip compressed)
   Data Size:    3081529 Bytes =  2.9 MB
   Load Address: 80001000
   Entry Point:  80002000
   Verifying Checksum ... OK
   Uncompressing Kernel Image ... OK
WDT2: Disable in do_bootm_linux()
 
Monolithic/DRB
systemd[1]: could not find module by name='autofs4'
systemd[1]: Failed to insert 'autofs4'
 
 

[codebreaker]

@rgrimes Yes. That was all after the initial SD recovery. The LED is constantly off now, no blinking or anything.

Where could I find steps to recover from a bad upgrade?

This is u-boot log:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
 

U-Boot 2009.08 (Jan 22 2016 - 20:24:21) Avocent (0.0.3) EVB
 
CPU: SH-4A
BOARD: R0P7757LC00xxRL (Cn step) board
BOOT: Secure, HRK generated
DRAM:  240MB
  (240MB of 256MB total DRAM is available on U-Boot)
ENV:   Using primary env area.
In:    serial
Out:   serial
Err:   serial
PCIe:  Bridge loaded with 0x18000 bytes
WDT2:  Booted Lower Vector, 'uboot1'
sh_mmcif: 0, sh-sdhi: 1
Net:   sh_eth.0, sh_g_eth.0
INFO: 00:002 Start-up -to- util_idrac_main()
INFO: 00:004 U-Boot 2009.08 (Jan 22 2016 - 20:24:21) Avocent (0.0.3) EVB
INFO: 00:007 U-Boot checkin date(08-04-2015) Version(1.1.31)
INFO: 00:006 iDRAC PPID <NULL>
INFO: 00:003 SPI NOR init 4096 KiB MX25L3206E bus=0 cs=0, speed=1000000, mode=3
INFO: 00:007 SH-4A Product: Major Ver=0x31  Minor Ver=0x14 C4 Little endian
             Family=0x10    Major Ver=0x30  Minor Ver=0x0b
INFO: 00:140 BCM54610 OUI=0x00d897  Model=0x26  Revision=0x0a PhyAddr=1
INFO: 00:006 Dedicated monolithic mgmt NIC disabled
INFO: 00:100 SD CARD:   Device: sh-sdhi   Manufacturer ID: 3   OEM: 5344
             Name: SU04G   Tran Speed: 25000000   Rd Blk Len: 512
             SD ver 2.0   HC: Yes   cap(<2gb): 3965190144  cap(>2gb): 0
             ext_rev: 0    rst_n: 0  ext[96]: 0
INFO: 00:063 EMMC:   Device: sh_mmcif   Manufacturer ID: 90   OEM: 14a
             Name: HYNIX   Tran Speed: 25000000   Rd Blk Len: 512
             MMC ver 4.0   HC: Yes   cap(<2gb): 0  cap(>2gb): 7569408
             ext_rev: 5    rst_n: 0  ext[96]: 0
INFO: 00:024 CPLD: Major Ver=0x1  Minor Ver=0x0  Maint Ver=0x4
             Planar: Type=0x07  Rev=0x4  Rework=0x0  Scratch/PathRetry=0x00
PASS: 00:013 Coin cell detected good,  AD=0x386 low water=0x2c1
PASS: 00:009 PCIe SH7757_C0 Ver=0.15 MCTP en, CRC=0x8e9b6875 @0x8efbd704 cnt=0x18000
INFO: 00:007 Init PCIe mailbox(PCIe 0xFFEE0150=0x40010000)
INFO: 00:006 mode=normal 
INFO: 00:002 reset_cause=ac 
PASS: 00:005 Booted Lower Vector, 'uboot1' wdt2cnt=0
INFO: 00:006 wdt0cnt=0  cpld_recover_cnt=0  ddr_recover_cnt=0  
PASS: 00:006 Clear CH1/CH2, clear 4K shared memory@0xffcaa000 on AC power up
PASS: 00:007 SMR0 no sermux env, default 0xd4
INFO: 00:005 GRACR=0x3c HISEL=0x00 SIRQCR5_D=0x03 SIRQCR6_D=0x01 LADMSK0=0xff2
             MRSTCR0=0xfedffe7f MRSTCR1=0xfff3ff0f MRSTCR2=0x6f80feff
             BARMAP=0x1 BCR=0x85000000 NCER=0x01fc NCMCR=0x0006 NCCSR=0x0303
PASS: 00:021 etherc0=F0:1F:AF:DE:50:20
             getherc0=F0:1F:AF:DE:50:21
INFO: 00:009 Fan logic for monolithic planar type 7
             fan1 - def 0000 1fff 3d   fan2 - def 0000 1fff 3d   
             fan3 - def 0000 1fff 3d   fan4 - def 0000 1fff 3d   
             fan5 - def 0000 1fff 3d   fan6 - def 0000 1fff 3d   
             fan7 - def 0000 1fff 3d   fan8 - def 0000 1fff 3d   
INFO: 00:077 Env and backup CRC'ed ok
Erasing SPI flash at 0x100000...Writing to SPI flash...done
Erasing SPI flash at 0x110000...Writing to SPI flash...done
*** no text signature found ***
INFO: 01:811 Sync eMMC/SPI NOR/Alternate u-boot images
PASS: 00:263 Current u-boot1 1.1.31 verified with 'ubootN'
             Trailer Struct - Missing start token, exp=0xc0de1111 rec=0x0
             U-boot2 in sync with u-boot1 1.1.31 
PASS: 06:202 Verify OS Images N: CRC32 OK: Kernel=0x90a67757 Rootfs=0xf45eb017
PASS: 00:007 Boot device=emmc  Boot partition1/N
             Boot Path Retry:P1/N=0 P5/N-1=0
INFO: 00:071 No 'userexe' defined
INFO: 00:000 08:892
Hit any key to stop autoboot:  0 
WDT2: Disable in abortboot()
OSWDT: Disable in abortboot()
CPLD_BMCRDY: Enable BMC_MIN_RDY in abortboot().  Prevent BIOS reset.
 
NOTE: After stopping u-boot in this development mode.  You may need to
      warm/cold reset the server when booting iDRAC manually as BIOS
      may have already viewed iDRAC as unresponsive.
 
iDRAC8=> util recover -emmc -from sd -f firmimg.d7
 

UTIL RECOVER:Transport:sd  TargetMMC:EMMC  File:firmimg.d7 
reading firmimg.d7
 
100899558 bytes read
UTIL RECOVER:SD load passed from FAT fs.
UTIL RECOVER:Transport time [sec:mil]: 17:464
 
Clear OS images in partition/s.
Clear kernelN, rootfsN, ubootN
'EMMC' blk size=[0x200][512]  Erase to 0xffffffff
Mem buf size=[0x06000000][100663296]  Total bytes=[0x08000000][134217728]
blocks[0x1:0x40001][1:262145]
mmc write failed, err=-840x88000000]..fill buffer..erase/write                 
util flash:
Failure writing blocks [1:196609] RC=0xffffffff
UTIL PASS
iDRAC8=> 
iDRAC8=> util recover -emmc -from sd
 

UTIL RECOVER:Transport:sd  TargetMMC:EMMC  File:firmimg.d7 
reading firmimg.d7
 
100899558 bytes read
UTIL RECOVER:SD load passed from FAT fs.
UTIL RECOVER:Transport time [sec:mil]: 17:464
 
Clear OS images in partition/s.
Clear kernelN, rootfsN, ubootN
'EMMC' blk size=[0x200][512]  Erase to 0xffffffff
Mem buf size=[0x06000000][100663296]  Total bytes=[0x08000000][134217728]
blocks[0x1:0x40001][1:262145]
mmc write failed, err=-840x88000000]..fill buffer..erase/write                 
util flash:
Failure writing blocks [1:196609] RC=0xffffffff
UTIL PASS
iDRAC8=>
iDRAC8=> mmcinfo
Device: sh_mmcif
Manufacturer ID: 90
OEM: 14a
Name: HYNIX 
Tran Speed: 25000000
Rd Block Len: 512
MMC version 4.0
High Capacity: Yes
Capacity: 0
Bus Width: 8-bit
iDRAC8=> 
 
 

[rgrimes]

@2ndbedtime what model server do you have? I ask cause I spotted this in your log display_factory_info.sh[2255]: Hudson Project = idrac-13g-IPS-release-A-X-Rev 13g would indicate a Rx30, and this thread is dealing with Rx20. You classify your problem as exactly the same, yet the log looks to me to show that the linux kernel loaded, and then for some un displayed reason it reset to uboot. Has someone glashed a Rx30 idrac firmware into a Rx20 machine? From what I see so far there are no indications of a failed emmc chip.

[rgrimes]

@codebreaker what model server do you have? You appear to have a Rx30 as I see this in your uboot log: iDRAC8=>. procedures and expections can be different between the idrac families and you may be failing cause your trying to apply the wrong firmimg.d7 file, which iirc should be firmimg.d8 for a idrac8, though I have not verified that.

ATTENTION TO ALL: If your NOT dealing with a 12g Dell server, aka Rx20, please do NOT expect all that is written here to apply to your server!! Infact you may damage your server by following some of the instructions in this thread that are very 12g specifc.

[2ndbedtime]

@rgrimes Hi there, it is an r720.
I am unsure where to go from here as I can’t flash a standard r720 bios on it thru the front sd card. I also cannot interrupt uboot.

Any suggestions?

Thanks !

Edit: some more information
- no light on rear of iDRAC
- no front lcd screen
- same errors while booting as page 1 of this thread
- I managed to get a blue backlight on the lcd screen once while resetting the pins a1-b1 on idrac sw on the mobo.
Pins a2-b2 seem to do nothing in terms of interrupting boot.

[rgrimes]

@2ndbedtime Well one thing that has happened to the iDrac console interface is due to some security issues it has been shutdown by later versions of the idrac software, your software seems to be display_factory_info.sh[2255]: 2.63.01.60.62 display_factory_info.sh[2255]: 2.63.60.62.3 which is very new.

You say you have a r720 yet I now see at least 2 things that indicate to me the iDrac is running r730/idrac8 firmware. Any ideas as to how that happened?

You say you cannot flash a standard r720 bios (sic, I think you mean iDrac image). This may be due to changes in how to do this when iDrac8 is running, or it may be due to the iDrac8 refusing to load iDrac7 code. This appears to be a real pickle of a situation.

[rgrimes]

@2ndbedtime I did a quick dig, there is a 2.63.* version of iDrac for both R720 and R730, any chance you flashed the wrong one?

ATTENTION EVERYONE: Flashing the iDrac past 2.50 or there abouts well disable the uboot console interrupt due to an exploit in the idrac. I believe, but have not verified you can get the console back by using a sd card to downgrade the firmware to something before 2.50.

[2ndbedtime]

@rgrimes

@2ndbedtime Well one thing that has happened to the iDrac console interface is due to some security issues it has been shutdown by later versions of the idrac software, your software seems to be display_factory_info.sh[2255]: 2.63.01.60.62 display_factory_info.sh[2255]: 2.63.60.62.3 which is very new.

You say you have a r720 yet I now see at least 2 things that indicate to me the iDrac is running r730/idrac8 firmware. Any ideas as to how that happened?

You say you cannot flash a standard r720 bios (sic, I think you mean iDrac image). This may be due to changes in how to do this when iDrac8 is running, or it may be due to the iDrac8 refusing to load iDrac7 code. This appears to be a real pickle of a situation.

@rgrimes

I bought the server in its current configuration recently - I got it cheap because iDrac was not working, I thought I might be able to fix it.

I might try to restore version 2.63.60.62 with SD card while reading serial output. Maybe it can restore the current image without needing to interrupt.
I will try very soon.

[2ndbedtime]

@rgrimes

ATTENTION EVERYONE: Flashing the iDrac past 2.50 or there abouts well disable the uboot console interrupt due to an exploit in the idrac. I believe, but have not verified you can get the console back by using a sd card to downgrade the firmware to something before 2.50.

I believe this is true, they have patched the ability to bypass uboot after a certain firmware upgrade. It was spoken about earlier in this thread.

[codebreaker]

@rgrimes

@codebreaker what model server do you have? You appear to have a Rx30 as I see this in your uboot log: iDRAC8=>. procedures and expections can be different between the idrac families and you may be failing cause your trying to apply the wrong firmimg.d7 file, which iirc should be firmimg.d8 for a idrac8, though I have not verified that.

ATTENTION TO ALL: If your NOT dealing with a 12g Dell server, aka Rx20, please do NOT expect all that is written here to apply to your server!! Infact you may damage your server by following some of the instructions in this thread that are very 12g specifc.

@rgrimes I have a Dell R320. To my understanding, The reason that iDrac8 is shown there is because 12G and 13G server share the same firmware (reddit - psa_read_this_before_you_upgrade_your_firmware_on).

If I remember correctly this is how it went. I got 4x R320. Then I proceeded to upgrade everything on the server using the SUU-LIN32_17.10.200.209.ISO (idrac 2.50.50.50). Worked great on 3 of the 4 servers. Then I realized that the fans was spinning faster so I downgraded to 2.30.30.30. I did this to all 3x servers. Worked fine.
Last of the 4 server had a problem - fans were at 100% and a message that it failed to load iDRAC after 10 or 15 min waiting for it. It booted into OS after that but iDrac was not available and fans remained at 100%
Next I tried to recover idrac on the 4th server with SD card using 2.30.30.30, and it worked. Then I rebooted the server while having the USB inserted and it booted into SUU and it upgraded everything. After that it returned to the previous state by fans beeing at 100% and a message that it failed to load iDRAC after 10 or 15 min waiting for it, but this time the LED in the back was not blinking like the last time. It stayed off.

After that I found this forum. Soldered headers to the motherboard, connected to serial and tried to manually flash firmimg.d7, result being in the log mentioned above. I can also boot into linux and log is as show bellow:

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
 

U-Boot 2009.08 (Jan 22 2016 - 20:24:21) Avocent (0.0.3) EVB
 
CPU: SH-4A
BOARD: R0P7757LC00xxRL (Cn step) board
BOOT: Secure, HRK generated
DRAM:  240MB
  (240MB of 256MB total DRAM is available on U-Boot)
ENV:   Using primary env area.
In:    serial
Out:   serial
Err:   serial
WDT2:  Booted Lower Vector, 'uboot1'
sh_mmcif: 0, sh-sdhi: 1
Net:   sh_eth.0, sh_g_eth.0
INFO: 00:002 Start-up -to- util_idrac_main()
INFO: 00:004 U-Boot 2009.08 (Jan 22 2016 - 20:24:21) Avocent (0.0.3) EVB
INFO: 00:007 U-Boot checkin date(08-04-2015) Version(1.1.31)
INFO: 00:006 iDRAC PPID <NULL>
INFO: 00:003 SPI NOR init 4096 KiB MX25L3206E bus=0 cs=0, speed=1000000, mode=3
INFO: 00:007 SH-4A Product: Major Ver=0x31  Minor Ver=0x14 C4 Little endian
             Family=0x10    Major Ver=0x30  Minor Ver=0x0b
INFO: 00:140 BCM54610 OUI=0x00d897  Model=0x26  Revision=0x0a PhyAddr=1
INFO: 00:007 Dedicated monolithic mgmt NIC disabled
INFO: 00:099 SD CARD:   Device: sh-sdhi   Manufacturer ID: 3   OEM: 5344
             Name: SU04G   Tran Speed: 25000000   Rd Blk Len: 512
             SD ver 2.0   HC: Yes   cap(<2gb): 3965190144  cap(>2gb): 0
             ext_rev: 0    rst_n: 0  ext[96]: 0
INFO: 00:063 EMMC:   Device: sh_mmcif   Manufacturer ID: 90   OEM: 14a
             Name: HYNIX   Tran Speed: 25000000   Rd Blk Len: 512
             MMC ver 4.0   HC: Yes   cap(<2gb): 0  cap(>2gb): 7569408
             ext_rev: 5    rst_n: 0  ext[96]: 0
INFO: 00:024 CPLD: Major Ver=0x1  Minor Ver=0x0  Maint Ver=0x4
             Planar: Type=0x07  Rev=0x4  Rework=0x0  Scratch/PathRetry=0x00
PASS: 00:014 Coin cell detected good,  AD=0x388 low water=0x2c1
PASS: 00:008 PCIe SH7757_C0 Ver=0.15 MCTP en, CRC=0x8e9b6875 @0x8efbd704 cnt=0x18000
INFO: 00:008 Init PCIe mailbox(PCIe 0xFFEE0150=0x40010000)
INFO: 00:005 mode=normal 
INFO: 00:003 reset_cause=NMI_id_button 
PASS: 04:911 Write trace buf mem@0x83000000 to SPI NOR@0x140000 for 0x80000 
PASS: 00:008 Booted Lower Vector, 'uboot1' wdt2cnt=0
INFO: 00:005 wdt0cnt=0  cpld_recover_cnt=0  ddr_recover_cnt=0  
PASS: 00:006 SMR0 no sermux env, default 0xd4
INFO: 00:004 GRACR=0x3c HISEL=0x00 SIRQCR5_D=0x03 SIRQCR6_D=0x01 LADMSK0=0xff2
             MRSTCR0=0xfedffe7f MRSTCR1=0xfff3ff0f MRSTCR2=0x6f80feff
             BARMAP=0x1 BCR=0x85000000 NCER=0x01fc NCMCR=0x0006 NCCSR=0x0303
PASS: 00:022 etherc0=F0:1F:AF:DE:50:20
             getherc0=F0:1F:AF:DE:50:21
INFO: 00:007 Fan logic is not modified on Non-AC power up
INFO: 00:053 Env and backup CRC'ed ok
*** no text signature found ***
INFO: 00:656 Sync eMMC/SPI NOR/Alternate u-boot images
PASS: 00:076 Current u-boot1 1.1.31 verified with 'ubootN'
             Trailer Struct - Missing start token, exp=0xc0de1111 rec=0x0
PASS: 06:213 Verify OS Images N: CRC32 OK: Kernel=0x90a67757 Rootfs=0xf45eb017
PASS: 00:008 Boot device=emmc  Boot partition1/N
             Boot Path Retry:P1/N=0 P5/N-1=0
INFO: 00:000 12:377
 

WDT2: Disabled
Initialization complete, proceed with boot
*** no text signature found ***
 
No.  Device
---------------------
 1   EVB SD/MMC
 4   FLASH
 
Current Device ==> 1
 
OS_WDT0_EN:180 seconds,  Re-load ILRAM:
SPI_WP: Not attempted.
EMMC_WP: Not attempted.
Boot Path Retry:P1/N=0 P5/N-1=0
Copying kernel image ... OK
## Booting kernel from Legacy Image at 82000000 ...
   Image Name:   sh-linux
   Image Type:   SuperH Linux Kernel Image (gzip compressed)
   Data Size:    2627909 Bytes =  2.5 MB
   Load Address: 80001000
   Entry Point:  80002000
   Verifying Checksum ... OK
   Uncompressing Kernel Image ... OK
WDT2: Disable in do_bootm_linux()
 
Monolithic/DRB
systemd[1]: could not find module by name='autofs4'
systemd[1]: Failed to insert 'autofs4'
 
Welcome to developer console!
Type "journalctl -b" to view system logs. Type "systemctl reboot" to reboot.
/home/root # journal commit I/O error
Dec 31 18:00:57 idrac8 syslogd 1.4.2: restart.
journal commit I/O error
journal commit I/O error
syslogd: /mmc1/idraclogs: Read-only file system
Dec 31 18:03:39 idrac8 syslogd 1.4.2: restart.
 
 

[rgrimes]

@codebreaker Ok, i may be confused by changes Dell has made in the newer images of iDrac7/8. I do still believe there are differences in the images as when I go digging in release notes the "supported systems" in the 2 different downloads ONLY list wither Rx20 or Rx30 series machines. I shall continue to assert that loading Rx30 firmware on a Rx20 machine well cause you much heartache.

Now as to your current state, I wonder if it can be "downgraded" back to that 2.30.30 that worked, via a sdcard downgrade. If that gets you back to working I would just
leave it there unless there is some great reason you need 2.63.