So apparently I lost on time even tough it wasn't my move... 20. Qh3 is listed as played move, but somehow the timer seems to have keep on running. For me it looked like everything was normal and the other player was thinking, but after his timer went to zero it informed me that I was in fact the one who lost due to time running out.
I've had situations when it hasn't registered the move for a while because bad connection, but in that case it doesn't show the move as played. And I even checked that the move shows even if I'm not logged in (using another browser).