Having direct doxastic control would not be particularly desirable if exercising it required a failure of epistemic rationality. With that thought in mind, recent writers have invoked the view that epistemic rationality gives us options to defend the possibility of a significant form of direct doxastic control. Specifically, they suggest that when the evidence for p is sufficient but not conclusive, it would be epistemically rational either to believe p or to be agnostic on p, and they argue that we can in these cases effectively decide to form either attitude without irrationality. This paper argues against the version of epistemic permissivism invoked by these writers and shows that other plausible versions of permissivism do not support their cause. It concludes that if we can exercise direct doxastic control without irrationality, it is not because epistemic rationality gives us options.