I think the end point will be a massive chip with fast interconnects and a (relatively) huge amount of on die memory talking over a fast bus to something like nvme on steroids.

My new Thinkpad has nvme and the difference is huge compared to my very fast desktop at work which has SATA connected SSD's.