I've been reading an entry from the Sasha Goldshtein blog named "Design for Performance Up-Front" in which he gives some interesting thoughts. I've specially liked this one

If a user clicks a button and the application crashes, it's a problem. If a user clicks a button and the application takes 5 seconds to respond when it should be unnoticeable, it's a problem. It's the same problem.