Have you tested with WinDvD if that AC3 filter is perhaps causing it?
(I personally prefer
this one).
That filter is fully configurable. E.g. you can select "Direct Sound" or "Wave Out" as audio renderer (as is also shown on the page linked to here above).
(Isn't there perhaps a similar possibility on WinDVD's AC3 filter?)