Limit Custom Activities to few Entities

I need to create a custom activity and make it available only for one custom entity

i dont this custom activity to be used anywhere else.

is there any direct or indirect way to do this?

Thanks

Varun