There is a minimum score protection, when your scores drops lower than 1000, it will stop decreasing even if you fails a challenge.