OK, they make these things called holsters

Some are even made to hold your gun securely until you need it, but you may need to spend a little more