Caffeine I have quit a few times and that has the worst physical withdrawal of anything I have quit (hard drugs & alcohol I have never used enough to become physically habituated). Speed probably the most difficult emotionally/psychologically.

I don’t worry about caffeine anymore, just maintain the habit.