The guys aren’t being cowards here. It’s like the song goes, “you don’t tug on Superman’s cape,” etc…

When the building is being pulled down around you, only the dumb henchman stays around to watch.