How to setup the ntp.service so that it only executes on multiuser.target level but not on the graphical.target?

I suppose it could be done somehow by adding a new service on the graphical.target level that conflicts with ntp and does nothing. Would this be an appropriate way? Otherwise I’m open to any suggestions.