day-dreaming isn’t intrinsically bad. People do need time to think about stuff, and have their mind drift from topic to topic. Some modern teaching practices advocate deliberate “brain breaks” for students.

The issue with phones isn’t so much that students are sometimes off task, but rather that the phone consumes their attention entirely. It uses up the students’ useful concentration as well as their ‘rest’ time.