Doesn't Windows offer that possibility?
Look under Control Panel for something like "Sound and multimedia"
On one of the TABs you should be able to find Video compression codecs (and separately Audio compression codecs) .
If you click on it you get a list of codecs.
Via "Properties" you can also "remove" the codec.