Doesn't cause a problem where there isn't one. Remove the loose crumbly material, wet the boundary surfaces with a brush or spray bottle, and then apply concrete screed as bagged goods. Level, smooth out, done.
Thank you all for the many replies. Have prepared the shaft so far, a bit of styrofoam still at the bottom between the pipes and tomorrow the concrete screed will go in... THX