In addition to what other people are saying there are additional factors like minimum layer time. If you find that layers with less material are being done slower it might be because of this.

In general a well tuned profile will prioritize quality over speed. You can bump things up or use a more aggressively tuned profile but your results may vary.