Here is what he says of how powerful yoga is in one's karma. And that is why I believe, if somebody drops out, it is not in their karma to clean up their slate in this birth.
¨Yoga practice is self-effort to neutralize evil prarabdha which obstruct self-realization. If prarabdha is powerful, yoga is more powerful.¨
- Swami Sivananda Saraswati