Estimating the Performance of a New Computer System

Edit

<em>Transistor density doubles every ~2 years. Ideally, this means we can provide you computers that contain twice as much memory and perform twice as fast. In practice, it's much more nuanced.</em>

<h2>Benchmark Your Application</h2>
The best performance comparison will always be benchmark testing of the application(s) that will run on your computer. You can check with your software vendor to determine if they have a list of such benchmarks results. In our experience, most software vendors don't have the resources to maintain such lists (or they are several years out of date).

If you're willing, you may contact one of Microway's technical experts to <a href="https://www.microway.com/take-a-test-drive/" title="Take a Test Drive">request a Test Drive</a>. We can provide a remote log-in to one of our systems to demonstrate the performance increase. Certain scientific applications are pre-installed, so get in touch!

<h2>Alternatives to Benchmarking</h2>
If no benchmarks are published for your application(s), it's still possible to find results tailored to your field. Read through the list of applications and problem descriptions below. If any are similar to your application, contact a Microway representative to learn what speedups you should expect.

One of our representatives can also give you rough guidelines on the factors that have changed between the generation of hardware you're currently using and the latest generation. For example, Intel Xeon CPUs released before 2012 typically completed four floating-point operations per clock cycle. With the release of CPUs supporting AVX, this increased to eight floating-point operations per cycle.

<h2>Industry-Standard CPU Performance Benchmarks - SPEC CPU2006</h2>
<h3>SPEC CPU2006 Benchmarks (Floating Point)</h3>
<table>
  <thead>
    <tr>
      <th>Application Area</th>
      <th>Benchmark</th>
      <th>Brief Description</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>CFD</td>
      <td>LESlie3d</td>
      <td>Large-Eddy Simulations with Linear-Eddy Model in 3D. Supports turbulence phenomena such as mixing, combustion, acoustics and general fluid mechanics. For SPEC, solve a subset of such flows, namely the temporal mixing layer. This type of flow occurs in the mixing regions of all combustors that employ fuel injection (which is nearly all combustors).</td>
    </tr>
    <tr>
      <td>CFD</td>
      <td>bwaves</td>
      <td>Simulates blast waves in 3D transonic transient laminar viscous flow.</td>
    </tr>
    <tr>
      <td>CFD</td>
      <td>LBM</td>
      <td>Implements the "Lattice-Boltzmann Method" to simulate incompressible fluids in 3D (computationally the most important part of a larger code which is used in the field of material science to simulate the behavior of fluids with free surfaces, in particular the formation and movement of gas bubbles in metal foams).</td>
    </tr>
    <tr>
      <td>Computational Electromagnetics</td>
      <td>GemsFDTD</td>
      <td>Solves the Maxwell equations in 3D using the finite-difference time-domain (FDTD) method. For SPEC, the radar cross section (RCS) of a perfectly conducting (PEC) object is computed.</td>
    </tr>
    <tr>
      <td>FEA</td>
      <td>CalculiX</td>
      <td>Finite element code for linear and nonlinear 3D structural applications. Uses the SPOOLES solver library to solve CrunchiX.</td>
    </tr>
    <tr>
      <td>FEA</td>
      <td>deal II</td>
      <td>Program library targeted at adaptive finite elements and error estimation. For SPEC, solves a Helmholtz-type equation with non-constant coefficients in 3D (used for incompressible fluid flow, static or time-harmonic electromagnetics, static and quasi-static elasto-plasticity, general relativity, and implicit time stepping schemes for seismic, acoustic, and electromagnetic applications).</td>
    </tr>
    <tr>
      <td>Image Ray-tracing</td>
      <td>POVRAY</td>
      <td>For SPEC, render a 1280x1024 anti-aliased image of a chessboard and abstract objects; all object surfaces are procedurally textured (e.g., Perlin noise function).</td>
    </tr>
    <tr>
      <td>Linear Programming, Optimization</td>
      <td>SoPlex</td>
      <td>Solves a linear program using a simplex algorithm and sparse linear algebra. Test cases include railroad planning and military airlift models.</td>
    </tr>
    <tr>
      <td>Molecular Dynamics</td>
      <td>GROMACS</td>
      <td>Simulates the Newtonian equations of motion for systems with hundreds to millions of particles. For SPEC, performs a simulation of the protein Lysozyme in a solution of water and ions (23,179 atoms).</td>
    </tr>
    <tr>
      <td>Molecular Dynamics</td>
      <td>NAMD</td>
      <td>Simulates large biomolecular systems. For SPEC, simulates apolipoprotein A-I (92,224 atoms).</td>
    </tr>
    <tr>
      <td>Quantum Chemistry</td>
      <td>GAMESS</td>
      <td>Supports a wide range of quantum chemical computations. For SPEC, self-consistent field (SCF) calculations are performed using the Restricted Hartree Fock method, Restricted open-shell Hartree-Fock, and Multi-Configuration SCF.</td>
    </tr>
    <tr>
      <td>Quantum Chemistry</td>
      <td>Tonto</td>
      <td>Open source quantum chemistry package. The test case places a constraint on a molecular Hartree-Fock wavefunction calculation to better match experimental X-ray diffraction data.</td>
    </tr>
    <tr>
      <td>Quantum Chromodynamics</td>
      <td>MILC</td>
      <td>A gauge field generating program for lattice gauge theory programs with dynamical quarks. For SPEC, the serial version of <code>su3imp</code> is used.</td>
    </tr>
    <tr>
      <td>Physics / CFD</td>
      <td>ZEUS-MP</td>
      <td>A CFD code developed for the simulation of astrophysical phenomena (ideal, non-relativistic, hydrodynamics and magnetohydrodynamics, including externally applied gravitational fields and self-gravity). For SPEC, simulates a 3D blastwave with the presence of a uniform magnetic field along the x-direction.</td>
    </tr>
    <tr>
      <td>Physics / General Relativity</td>
      <td>CactusADM</td>
      <td>Solves the Einstein evolution equations, which describe how spacetime curves as response to its matter content (a set of ten coupled nonlinear partial differential equations). A staggered-leapfrog numerical method is used to carry out the update.</td>
    </tr>
    <tr>
      <td>Speech Recognition</td>
      <td>Sphinx-3</td>
      <td>A widely-known speech recognition system from Carnegie Mellon University.</td>
    </tr>
    <tr>
      <td>Weather</td>
      <td>WRF</td>
      <td>next-generation mesocale numerical weather prediction system from scales of meters to thousands of kilometers. For SPEC, simulate a 30km area over 2 days.</td>
    </tr>
  </tbody>
</table>
<a href="https://www.spec.org/cpu2006/CFP2006/" title="CFP2006 (Floating Point Component of SPEC CPU2006)" target="_blank" rel="noopener"><em>Official SPEC CPU2006 Benchmarks (Floating Point) descriptions</em></a>

<h3>SPEC CPU2006 Benchmarks (Integer)</h3>
<table>
  <thead>
    <tr>
      <th>Application Area</th>
      <th>Benchmark</th>
      <th>Brief Description</th>
    </tr>
  </thead>
  <tbody>
    <tr>
      <td>Artificial Intelligence</td>
      <td>Sjeng</td>
      <td>A highly-ranked chess program that also plays several chess variants. It attempts to find the best move via a combination of alpha-beta or priority proof number tree searches, advanced move ordering, positional evaluation and heuristic forward pruning.</td>
    </tr>
    <tr>
      <td>Artificial Intelligence</td>
      <td>gobmk</td>
      <td>Plays the game of Go, a simply described but deeply complex game. The program plays Go and executes a set of commands to analyze Go positions.</td>
    </tr>
    <tr>
      <td>C Compiler</td>
      <td>gcc</td>
      <td>Based on gcc Version 3.2 - generates code for an AMD Opteron processor.</td>
    </tr>
    <tr>
      <td>Combinatorial Optimization</td>
      <td>MCF</td>
      <td>Vehicle scheduling. Uses a network simplex algorithm (which is also used in commercial products) to schedule public transport.</td>
    </tr>
    <tr>
      <td>Compression</td>
      <td>bzip2</td>
      <td>Julian Seward's bzip2 version 1.0.3, modified to do most work in memory, rather than doing I/O.</td>
    </tr>
    <tr>
      <td>Discrete Event Simulation</td>
      <td>OMNeT++</td>
      <td>Uses the OMNet++ discrete event simulator to model a large Ethernet campus network (about 8000 computers and 900 switches/hubs).</td>
    </tr>
    <tr>
      <td>Gene Sequence Search</td>
      <td>HMMER</td>
      <td>Protein sequence analysis using profile hidden Markov models (profile HMMs). Used in computational biology to search for patterns in DNA sequences.</td>
    </tr>
    <tr>
      <td>Path-finding</td>
      <td>A-star</td>
      <td>Pathfinding library for 2D maps, including the well known A* algorithm.</td>
    </tr>
    <tr>
      <td>Physics / Quantum Computing</td>
      <td>libquantum</td>
      <td>Simulates a quantum computer, running Shor's polynomial-time factorization algorithm.</td>
    </tr>
    <tr>
      <td>Programming Language</td>
      <td>perlbench</td>
      <td>Derived from Perl V5.8.7. The workload includes SpamAssassin, MHonArc (an email indexer), and specdiff (SPEC's tool that checks benchmark outputs).</td>
    </tr>
    <tr>
      <td>Video Compression</td>
      <td>H264ref</td>
      <td>A reference implementation of H.264/AVC - encodes a videostream using 2 parameter sets. The H.264/AVC standard has largely replaced the older MPEG2 standard.</td>
    </tr>
    <tr>
      <td>XML Processing</td>
      <td>Xalan-C++</td>
      <td>Transforms XML documents to other document types (100 MB test data).</td>
    </tr>
  </tbody>
</table>
<a href="https://www.spec.org/cpu2006/CINT2006/" title="CINT2006 (Integer Component of SPEC CPU2006)" target="_blank" rel="noopener"><em>Official SPEC CPU2006 Benchmarks (Integer) descriptions</em></a>

Cancel