One thing is that we can only move forward in time. I have always heard the second law of thermodynamics (entropy always increases) defines the "arrow of time": you cannot go back to a previous ordered state unless you add work, thus you are forced to march forward in time.