Where to start
Host memory, accelerator memory, network fabrics and storage pathways.
What to compare
Capacity, bandwidth, latency, locality, topology and total system compatibility.
A question worth asking
A fast compute engine can still wait on data. Treat memory and communication as part of the architecture.
Bring the system into view
Define the task and acceptable response time. Identify the working data size, supported software and operating constraints. Ask for measurements that reflect those conditions.