Dealing With Flakey CI Commands With a Retry Loop in Bash
One of the most frustrating things to deal with in Continuous Integration is flakey commands. Whether it’s flakey tests, or intermittent networking issues, when your build fails for issues outside of your control not only does it cause frustration, it reduces the trust in your CI process.
One strategy for dealing with this type of issue is to introduce some retry logic into your commands. This can easily be accomplished with good old bash.
For example, pretend that I have $FLAKEY_COMMAND and I want to retry it three times before finally failing my build. I could wrap the whole thing up in a bash loop like this.
counter=1
max=3
$FLAKEY_COMMAND
while [[ $? -ne 0 && $counter -lt $max ]]; do
counter=$((counter+1))
$FLAKEY_COMMAND
done
This script will run my command, if the exit code (the output of $?) is non zero (i.e something went wrong) and my counter is less than three, then it will retry the command. You can increase or decrease the number of attempts by adjusting the max variable.
This is not a foolproof strategy, but is one approach to handle flakey commands in your CI pipeline.
Thank you for reading! Share your thoughts with me on bluesky, mastodon, or via email.
Check out some more stuff to read down below.
Most popular posts this month
- Setting up ANTLR4 on Windows
- Meritocracy?
- Possible Plagiarism Made me Cringe
- SQLite DB Migrations with PRAGMA user_version
- Using Plex with Nextcloud
Recent Favorite Blog Posts
This is a collection of the last 8 posts that I bookmarked.
- The Rise of Bluesky from Communications of the ACM
- Podcaster, DJ, and writer DJ Louie XIV on going for it (even if you’re terrified) from The Creative Independent
- Useful Bluesky Tools from Robb Knight • Posts • Atom Feed
- Re: Bluesky from Colin Devroe
- From the Red Hell to the Sky of Blue from Straphanger
- We don’t need to use what we make from Derek Sivers blog
- Ubuntu Summit 2024: A joyful experience filled with sorrow from Planet KDE | English
- Sabotage from jwz
Articles from blogs I follow around the net
13/12/2024
# I can't believe it's been over a month since the last post. Not very good for someone who's supposed to be back. Still, I've also been struggling to get back to making music again; I've had a couple of ideas and put them on SoundClou…
via Colin Walker - Daily Feed December 18, 2024Christmas with Grubbs – an animated holiday special I worked on that you and your kids will love.
I am part of an animated holiday special and you can watch it on YouTube for free! Christmas With Grubbs is an animated holiday special based on Max Weaver's comic. It's about a little boy and his imaginary friend who get into all sorts of mischie…
via WIL WHEATON dot NET December 17, 2024Businessweek: Crypto Got What It Wanted in November’s Election. Now What?
The industry is now in a position to weaken financial rules that might protect consumers from the next crypto crash.
via Citation Needed December 17, 2024Generated by openring