In this work charge-driven incorporation of CdTe/CdS and CdS quantum dots inside potassium dihydrogen phosphate crystals is shown, as the photophysical and structural properties of obtained composites are thoroughly investigated. In addition, the impact of the matrix on the photostability and thermal sensitivity of incorporated quantum dots was studied and compared for cases of calcium carbonate, potassium bromide and barium sulfate as the host matrices.