Voting for a taxonomy term

Hi.

I have been looking for some time and either could not find what I want or completely missed it.

My site has predefined taxonomy terms which are used in a Story content type. On the each story page I would like to let a user (also anonymous one) the ability to mark a taxonomy term as fits to the node. Yes/No is enough, no need for a five-star like voting. Now, when a user goes to the page of the taxonomy term, there will be a block, naturally by a views query, that will sort the stories by the voting people gave to the said term.

The vote up-down module give us only a node granularity, where I need indeed a taxonomy term granularity.

Any help is appreciated!

Thanks!