Whereas implementing a mobile application (app) in support of organizational processes is quite common in contemporary organizations, only few empirical studies have investigated the effects of app implementation on employee behavior. This study aims at exploring the effects of a fleet-management app on the behavior of drivers, in particular the extent to which they are involved in risky behavior. We hypothesize that use of the app before driving reduces such behavior, and that this effect is mitigated by the existence of notifications while driving. These hypotheses are tested with data about 11,805 trips by 109 drivers employed in a large-scale organization. The preliminary results support the research hypotheses and confirm that the implementation of a fleet-management app has an organizational impact via an app-induced change in driver behavior.