Holden Colorado: Can driving 4WD on bitumen road cause damage?

Recently while driving my new Holden Colorado on a bitumen road I noticed it was in 4WD, presumably because I inadvertently engaged the 4WD button while loading or ejecting a CD from the player that is located immediately below the 4WD controls. Are you aware if this is a common occurrence, and would any significant damage have resulted by driving the vehicle over a distance of 50-100 km.