I think giving users the notice of losing an ability by system message is good.
For example…
when you use the ability ‘whirlwind’, the ability disappeared because there is a chance that used ability will be forgotten by the character so there will be a system message like “You forgot something” in the chat log.