Today, I got a weird behaviour: Every few seconds, the stereo channels got swapped in the output (both SPDIF and Toslink). There were no dmesg messages or the like. I even rebooted, didn't help. Then I plugged the power of the RPi (cold reset). After it, it is working again.
I'm posting this mainly if somebody else has this problem.