Nvidia's physical moat, the GPU chip itself, is real but limited in durability. AMD, Google, Amazon, and Microsoft all have competitive GPU and custom silicon architectures. The chip moat alone would not support a 34x trailing PE.
The CUDA software ecosystem is the deeper and more defensible moat. CUDA has been the dominant programming model for GPU-accelerated computing since 2006. Over 15 years, developers have built more than 30,000 libraries, frameworks, and tools on top of it. PyTorch, TensorFlow, and virtually every major AI framework is optimized for CUDA. The collective developer investment in CUDA-specific code is estimated in the hundreds of thousands of person-years.
Switching from CUDA to an alternative like AMD's ROCm requires rewriting or porting code, retraining development teams, and accepting performance uncertainty. For the broader population of AI developers and researchers, CUDA inertia is near-total.
Nvidia compounds the software advantage through its NIM microservices, NeMo framework, and the expanding suite of enterprise AI software products. These generate recurring software revenue that is more predictable than hardware sales and commands higher margins. The software business is small relative to hardware today but represents a meaningful diversification of the moat.
The question for long-term holders is whether any custom silicon alternatives, Google's TPUs, Amazon's Trainium, Microsoft's Maia, will reach a scale and ecosystem quality that challenges CUDA's dominance. None has done so yet, and switching costs for the developer ecosystem make it a slow process even if the hardware reaches parity.