Perhaps it would be helpful to consider all your interests as being outlets of the same creative impulse. It's much better to have something on the go that you want to do at a certain point than force yourself to compose because you feel as if you should give priority to one discipline or artistic medium. Unless your project is actual work with a deadline, composing should not become a chore and you should only come to it when you have something you want to write and feel ready to do so. Often, taking a break can be helpful to step back from something. I always have a few weeks of the year when I don't practice one of my instruments, so that when I come back to it for a new project it feels fresh and my ear is more ready to analyse how to improve my playing. I think it would be more worrying if you felt you had nothing to say or no ideas for new projects.