Interplay of exciton or electron transfer and relaxation: I. Mori approach