Restrict custom attribute so that it can be applied only to Specific types in C#?

I have a custom attribute which is applied to class properties and the class itself. Now all the classes that must apply my custom attribute are derived from a single base class.

How can I restrict my Custom Attribute so that it can be applied to only those classes, that must derive from my base class? How do I do this?