I left the Distillery district just a little after your start time 4.30ish, i was home in Brooklin before 6.
Queen st to Kingston road, north on Brimley, turned on to Danforth/Mccowan, to Lawrence, east to Scarboro Golf Club road, North up to Ellesmere, right turn then north on Military trail, wind around a few back streets and got on the 401 at Neilson road. East to Meadowvale, north past the zoo to bears<sp> road, north to Taunton, east to Scarb/Durham side road, i could have then taken HWY7, but took the 407 all the way to lakeshore.
You have to find what roads work best at your commute time, having the app waze or google maps helps quite a bit. I never really have the same commute route in the afternoons.