Skip to content

About

Simplified single-processor Manhattan-grid model for explicit communication cost (Dally, CACM 2022)

Resources

Stars

1 star

Watchers

0 watching

Forks

Repository files navigation

Explicit Communication Models

Bill Dally (On the Model of Computation, CACM 2022) proposed modeling algorithm data movement explicitly on a Manhattan grid. This repository describes models inspired by that approach and versioned instruction sets for programs running on them.

Models

Each model has its own specification under models/.

Model Description
1. Simplified Dally grid model Original
2. Dally single core with tape Grid with one processor, 2 input/output tapes
3. Spatial computer Grid with processors every 128 steps, tapes at the bottom edge.

Instruction sets

Choose a model to specify the machine, access costs, I/O, and coordinate bounds, and an instruction-set version to specify the available operations. These are separate choices, subject to the model's I/O support. See instruction-sets/ for versions v0–v4.

The existing v0–v3 operations retain their meanings. v4 adds recv d and send s for sequential 32-bit tape I/O. Receiving writes the next input word to d; sending appends the word from s to the output. The single-core-with-tape model excludes these operations from its energy and time scores to focus on solution-dependent computation. Other instructions are charged for their scratch reads and writes.

The spatial computer also uses v4, with one ordered instruction stream per processor and one tape pair per column. It charges on-chip tape transport and scratch access, and accounts for concurrent execution and mesh capacity.

Existing model animation

The live matmul animation illustrates model 1, with its original distance-based bill. Its animation clocks do not represent the timing of models 2 or 3.

Naive 4×4 matmul under the simplified Bill Dally model

The original geometry, function-call semantics, and worked example are in the simplified Bill Dally model specification.

About

Simplified single-processor Manhattan-grid model for explicit communication cost (Dally, CACM 2022)

Resources

Stars

1 star

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages