In-Depth Comparison of NVIDIA Tesla "Maxwell" GPU Accelerators

Home > Wikis > In-Depth Comparison of NVIDIA Tesla “Maxwell” GPU Accelerators

In-Depth Comparison of NVIDIA Tesla “Maxwell” GPU Accelerators

Edit

<em>This article provides in-depth details of the NVIDIA Tesla M-series GPU accelerators (codenamed "Maxwell"). "Maxwell" GPUs improve upon the previous-generation <a href="https://www.microway.com/knowledge-center-articles/in-depth-comparison-of-nvidia-tesla-kepler-gpu-accelerators/" target="_blank" rel="noopener">"Kepler" architecture</a>, although they do not necessarily replace all "Kepler" models.</em>

<h2>Important changes available in the "Maxwell" GPU architecture include:</h2>
<ul>
	<li><strong>Energy-efficiency</strong> - Maxwell GPUs deliver nearly twice the power-efficiency of Kepler GPUs.</li>
	<li><strong>SMM architecture</strong> - the Maxwell Multiprocessor (SMM) provides power-efficient performance, with 40% higher performance per CUDA core. Each SMM contains 128 CUDA cores (changed from 192 cores in Kepler).</li>
	<li><strong>Larger, dedicated shared memory</strong> in each SMM. The L1 cache is now separate from Shared Memory (they competed for space on Kepler).</li>
	<li><strong>Larger L2 caches</strong> are available on Maxwell GPUs (ranging from 2MB to 3MB, which is two to four times the size of L2 on Kepler).</li>
	<li><strong>Reduced latencies</strong> on GPU instructions improve utilization and throughput. Furthermore, the throughput of many Integer instructions has been improved.</li>
	<li><strong>Shared memory atomics</strong> improve upon Kepler's <em>device memory atomics</em> by allowing threads to perform atomic operations on locations in shared memory.</li>
	<li><strong>Maximum active thread blocks</strong> are increased from 16 to 32 per SMM.</li>
	<li><strong>Dual NVENC H.264 encoders</strong> for increased throughput of video workloads. H.265 support is also added.</li>
</ul>

<h2>"Maxwell" Tesla GPU Specifications</h2>
The table below summarizes the features of the available Tesla GPU Accelerators. To learn more about any of these products, or to find out how best to leverage their capabilities, please speak with an <a href="https://www.microway.com/contact/" title="Talk to an Expert – Contact Microway">HPC expert</a>.

<table>
  <thead>
    <tr>
      <th>Feature</th>
      <th>Tesla M40</th>
      <th>Tesla M60</th>
    </tr>
  </thead>
  <tbody>
    <tr><td class="rowhead">GPU Chip(s)</td><td>Maxwell GM200</td><td>2x Maxwell GM204</td></tr>
    <tr><td class="rowhead">Recommended Workload</td><td>Machine Learning & Single-Precision apps</td><td>Virtualized Desktops (VDI)</td></tr>
    <tr><td class="rowhead">Peak Single Precision (GPU Boost)</td><td>6.84 TFLOPS</td><td>9.64 TFLOPS (both GPUs combined)</td></tr>
    <tr><td class="rowhead">Peak Double Precision (GPU Boost)</td><td>0.213 TFLOPS</td><td>0.301 TFLOPS (both GPUs combined)</td></tr>
    <tr><td class="rowhead">Onboard GDDR5 Memory<sup>1</sup></td><td>12 GB or 24GB</td><td>16GB (8GB per GPU)</td></tr>
    <tr><td class="rowhead">Memory Bandwidth<sup>1</sup></td><td>288 GB/s</td><td>160 GB/s per GPU</td></tr>
    <tr><td class="rowhead">L2 Cache</td><td>3 MB</td><td>2MB per GPU</td></tr>
    <tr><td class="rowhead">PCI-Express Generation</td><td colspan=2>3.0</td></tr>
    <tr><td class="rowhead">Achievable PCI-E transfer bandwidth</td><td colspan=2>12 GB/s</td></tr>
    <tr><td class="rowhead"># of SMM Units</td><td>24</td><td>32 (16 per GPU)</td></tr>
    <tr><td class="rowhead"># of CUDA Cores</td><td>3072</td><td>4096 (2048 per GPU)</td></tr>
    <tr><td class="rowhead">Memory Clock</td><td>3004 MHz</td><td>2505 MHz</td></tr>
    <tr><td class="rowhead">GPU Base Clock</td><td>948 MHz</td><td>899 MHz</td></tr>
    <tr><td class="rowhead">GPU Boost Support</td><td colspan=2>Yes - Dynamic</td></tr>
    <tr><td class="rowhead">GPU Boost Clocks</td><td>23 levels between 532 MHz and 1114 MHz</td><td>25 levels between 532 MHz and 1177 MHz</td></tr>
    <tr><td class="rowhead">Compute Capability</td><td colspan=2>5.2</td></tr>
    <tr><td class="rowhead">Workstation Support</td><td colspan=2>-</td></tr>
    <tr><td class="rowhead">Server Support</td><td colspan=2>Yes</td></tr>
    <tr><td class="rowhead">Wattage (TDP)</td><td>250W</td><td>300W</td></tr>
  </tbody>
</table>
<em>1. Measured with ECC disabled. Memory capacity and performance are reduced by 6.25% with ECC enabled.</em>

<h2>Comparison between "Kepler" and "Maxwell" GPU Architectures</h2>
<table>
  <thead>
    <tr>
      <th>Feature</th>
      <th>Kepler GK104</th>
      <th>Kepler GK110(b)</th>
      <th>Kepler GK210</th>
      <th>Maxwell GM200</th>
      <th>Maxwell GM204</th>
    </tr>
  </thead>
  <tbody>
    <tr><td class="rowhead">Compute Capability</td><td>3.0</td><td>3.5</td><td>3.7</td><td colspan=2>5.2</td></tr>
    <tr><td class="rowhead">Threads per Warp</td><td colspan=5>32</td></tr>
    <tr><td class="rowhead">Max Warps per SM</td><td colspan=5>64</td></tr>
    <tr><td class="rowhead">Max Threads per SM</td><td colspan=5>2048</td></tr>
    <tr><td class="rowhead">Max Thread Blocks per SM</td><td colspan=3>16</td><td colspan=2>32</td></tr>
    <tr><td class="rowhead">32-bit Registers per SM</td><td colspan=2>64 K</td><td>128 K</td><td colspan=2>64 K</td></tr>
    <tr><td class="rowhead">Max Registers per Thread Block</td><td colspan=5>64 K</td></tr>
    <tr><td class="rowhead">Max Registers per Thread</td><td colspan=5>255</td></tr>
    <tr><td class="rowhead">Max Threads per Thread Block</td><td colspan=5>1024</td></tr>
    <tr><td class="rowhead">L1 Cache Configuration</td><td colspan=3>split with shared memory</td><td colspan=2>24KB dedicated L1 cache</td></tr>
    <tr><td class="rowhead">Shared Memory Configurations</td><td colspan=2>16KB + 48KB L1 Cache<br /><br />32KB + 32KB L1 Cache<br /><br />48KB + 16KB L1 Cache<br /><br /><em>(64KB total)</em></td><td>16KB + 112KB L1 Cache<br /><br />32KB + 96KB L1 Cache<br /><br />48KB + 80KB L1 Cache<br /><br /><em>(128KB total)</em></td><td colspan=2>96KB dedicated</td></tr>
    <tr><td class="rowhead">Max Shared Memory per Thread Block</td><td colspan=5>48KB</td></tr>
    <tr><td class="rowhead">Max X Grid Dimension</td><td colspan=5>2<sup>32-1</sup></td></tr>
    <tr><td class="rowhead">Hyper-Q</td><td colspan=5>Yes</td></tr>
    <tr><td class="rowhead">Dynamic Parallelism</td><td colspan=5>Yes</td></tr>
  </tbody>
</table>
<hr />

<h2>Additional Tesla "Maxwell" GPU products</h2>
NVIDIA has also released Tesla M4, Tesla M6, and Tesla M10 GPUs. These products are primarily for embedded and hyperscale deployments. These models are not expected to be used in the HPC space.

Cancel

Edit

Edit

In-Depth Comparison of NVIDIA Tesla “Maxwell” GPU Accelerators

Edit

Archives

Meta

Technical Information

Talk to an Expert

Configure Your Solution

Schedule a Consultation

Knowledge Center Categories

Customer Testimonials

Technologies

Products

Knowledge Center

Pre-Configured Systems

NVIDIA DGX H100™

NVIDIA DGX POD™

EOL – NVIDIA DGX A100™

AI Anywhere Solution

Edit

Edit

In-Depth Comparison of NVIDIA Tesla “Maxwell” GPU Accelerators

Edit

Archives

Meta

Technical Information

Talk to an Expert

Configure Your Solution

Schedule a Consultation

Knowledge Center Categories

Knowledge Center Tags

Customer Testimonials