A shift in an important piece

The tensioner on the bike keeps coming loose. So I need to drill a small hole and put a bolt in there to make sure that the grip is stable. When this comes loose the chain gets too floppy and falls off the gear. This is a problem because that can cause a crack in the shell that holds everything together .