Roughly half of workers recently surveyed said they would turn down a job offer that mandated full-time in-office work.