Skip to content

Commit

Permalink
Consolidate diagnostic information to incident page
Browse files Browse the repository at this point in the history
  • Loading branch information
mfisher87 committed Nov 23, 2023
1 parent b02514b commit 71290d3
Show file tree
Hide file tree
Showing 2 changed files with 22 additions and 30 deletions.
23 changes: 5 additions & 18 deletions changes/2023-11-node-failure-incident-response/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,27 +4,14 @@ description: |
Motherboard was replaced in response to this incident.
---

## Hardware changes

* Ordered a replacement `Supermicro X9SCL-F rev1.11a` from eBay (~$20 + shipping).
* TODO: Install
See [related incident](/incidents/2023-11-12-node-failure/index.md) for diagnostics
information.


## Diagnosis

Diagnosed a motherboard failure. Rationale:
## Hardware changes

* Symptoms began after a full shutdown.
* Symptoms:
* Fans spin for ~1 second on pushing power button, then stop. Repeats after ~1
second delay, indefinitely.
* No display
* No beep from built-in speaker
* No POST
* Power cycling stops after holding powr button for 5 seconds.
* Symptoms unchanged when removing all components (one by one): disks, RAM sticks,
CPU.
* Symptoms unchanged with multiple PSUs, PSU cables, and wall outlets.
* Ordered a replacement `Supermicro X9SCL-F rev1.11a` from eBay (~$20 + shipping).
* TODO: Install replacement


## TODO
Expand Down
29 changes: 17 additions & 12 deletions incidents/2023-11-12-node-failure/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,15 +11,20 @@ each cycle, but no beep from the motherboard speaker. The boot loop can be stopp
holding the power button.


## Tried

* Replaced CMOS CR2032 battery: No change in symptoms
* Removed RAM: No change in symptoms
* Removed 5 disks: No change in symptoms


## To try

* Replace PSU
* Remove all disks: Label SATA cables, remove power connections
* Replace motherboard: I really hope not...
## Diagnosis

Diagnosed a motherboard failure. Rationale:

* Symptoms began after a full shutdown.
* Symptoms:
* Fans spin for ~1 second on pushing power button, then stop. Repeats after ~1
second delay, indefinitely.
* No display
* No beep from built-in speaker
* No POST
* Power cycling stops after holding powr button for 5 seconds.
* Symptoms unchanged when removing all components (one by one): disks, RAM sticks,
CPU.
* Symptoms unchanged when replacing (one by one): PSU, PSU cables, wall outlets, CMOS
CR2032 battery.
* Symptoms unchanged with multiple PSUs, PSU cables, and wall outlets.

0 comments on commit 71290d3

Please sign in to comment.