Long-term holders are in command amid a lack of speculators — and they're showing little interest in selling.