Ugh, I love it.
Dean is not holding Cas back at any point. He COULDN’T. He’s nowhere NEAR strong enough to hold Cas back.
He is reaching out to Cas, and Cas is CHOOSING TO HOLD HIMSELF BACK, because Dean thinks he should and Cas trusts Dean’s judgement.