Good news. I did a system reset in FW 1.6.0 just after updating firmware (my previous reset was in FW 1.5.4) like Armin. I cannot hear any difference now while playing with the latency switch. I suggest everybody else that noticed the differences to try this and report the results.
From now on I will do a system reset every time I update the FW just in case.