So, you are one of those guys :). To answer this question the answer is Absolutely Not. There is a fine difference between masturbating and having sex. Most of the time people get confused between these two whether sex is more harmful or masturbation, well to be honest both are and not.
Does Masturbation affect Muscle Growth? Short Answer is “NO”, but this doesn’t mean you start fapping because long answer is different.