Linda (coordination language)

In computer science, Linda is a coordination model that aids communication in parallel computing environments. Developed by David Gelernter, it is meant to be used alongside a full-fledged computation language like Fortran or C where Linda's role is to "create computational activities and to support communication among them".^[3][4][5]

David Gelernter wrote the first version of Linda as a Ph.D. candidate in 1979, naming it after Linda Lovelace, who appeared in the pornographic film Deep Throat. At the time, the main language for parallel processing was Ada, which Gelernter considered an "inelegant and bulky" language.^[6]

It was widely released in 1986, when Gelernter, along with his Yale colleague Nicholas Carriero and Sudhir Ahuja at AT&T Bell Laboratories, published "Linda and Friends" in an IEEE journal.^[7]

By the early 1990s, Linda was widely used by corporations to more efficiently conduct big data analyses, including Wall Street brokerages as well as AT&T, Boeing, and United Technologies. There were even companies that specialized in creating specialized parallel computing applications based on Linda, the largest of which was Scientific Computing Associates, a New Haven-based company founded by several Yale computer scientists (Gelernter occasionally consulted for them but did not work there).^[6] Interest in Linda dropped in the mid-1990s, only to make a comeback in the late 1990s with several corporations implementing Linda in Java, including Sun Microsystems and IBM.^[3]

The Linda model provides a distributed shared memory, known as a tuple space because its basic addressable unit is a tuple, an ordered sequence of typed data objects; specifically in Linda, a tuple is a sequence of up to 16 typed fields enclosed in parentheses". The tuple space is "logically shared by processes" which are referred to as workers that store and retrieve tuples.^[8]

One of Linda's main advantages is that it's simple, with only six operations that workers perform on the tuples to access tuplespace:^[9]

• out: Puts a tuple into the tuplespace
• in: Takes out a tuple that matches a given pattern from the tuplespace (if there's no match, the operation is blocked)
• rd: Copies a tuple that matches a given pattern from the tuplespace (if there's no match, the operation is blocked)
• eval: Creates a new process to evaluate tuples
• inp: A non-blocking version of in (if there's no match, an error message is returned)
• rdp: A non-blocking version of rd (if there's no match, an error message is returned)

Compared to other parallel-processing models, Linda is more orthogonal in treating process coordination as a separate activity from computation, and it is more general in being able to subsume various levels of concurrency—uniprocessor, multi-threaded multiprocessor, or networked—under a single model. Its orthogonality allows processes computing in different languages and platforms to interoperate using the same primitives. Its generality allows a multi-threaded Linda system to be distributed across multiple computers without change.

Whereas message-passing models require tightly coupled processes sending messages to each other in some sequence or protocol, Linda processes are decoupled from other processes, communicating only through the tuplespace; a process need have no notion of other processes except for the kinds of tuples consumed or produced. Criticisms of Linda from the multiprocessing community tend to focus on the decreased speed of operations in Linda systems as compared to Message Passing Interface (MPI) systems.^{[citation needed]} While not without justification, these claims were largely refuted for an important class of problems.^[10] Detailed criticisms of the Linda model can also be found in Steven Ericsson-Zenith's book Process Interaction Models.^[11]

Researchers have proposed more primitives to support different types of communication and co-ordination between (open distributed) computer systems, and to solve particular problems arising from various uses of the model.^{[citation needed]} Researchers have also experimented with various means of implementing the virtual shared memory for this model.^{[citation needed]} Many of these researchers proposed larger modifications to the original Linda model, developing a family of systems known as Linda-like systems and implemented as orthogonal technology (unlike original version). An example of this is the language Ease designed by Steven Ericsson-Zenith.

Linda's approach has also been compared to that of flow-based programming.^[12]

The Linda-calculus is a formalisation of the above model with the difference that in the following ${\displaystyle \mathrm {outeval} }$ subsumes both out and eval operations.^[13]

We abstract the concrete representation of tuples. We just assume that we have a set of tuples ${\displaystyle t\in {\mathcal {T}}}$ and we are allowed to form and apply a substitution function ${\displaystyle \sigma }$ on tuples substituting variables for terms that yields a tuple. For example, given we have a tuple ${\displaystyle t=({\mathit {hello}},x)}$, then applying a substitution ${\displaystyle \sigma =\{{\mathit {world}}/x\}}$ on ${\displaystyle t}$ yields ${\displaystyle ({\mathit {hello}},{\mathit {world}})}$

The Linda-calculus processes are defined by the following grammar.

${\displaystyle P,Q::=t\;|\;\mathrm {outeval} (P).Q\;|\;\mathrm {rd} (t).P\;|\;\mathrm {in} (t).P\;|\;P+Q\;|\;\mathbf {rec} X.P\;|\;X}$

The syntax includes the aftermentioned Linda operations, non-deterministic choice, and recursion. The substitution function is extended to processes recursively.

A tuple space is represented as a multiset of the processes. We write ${\displaystyle M\,|\,P}$ for ${\displaystyle M\uplus \{P\}}$ where ${\displaystyle M}$ is a multiset, ${\displaystyle \{P\}}$ a singleton multiset, and ${\displaystyle \uplus }$ is the multiset union operation. The semantics is then defined as a reduction relation on a multiset ${\displaystyle M\rightarrow M'}$ as follows.

${\displaystyle {\begin{array}{lrcll}{\text{(outeval)}}&M\,|\,\mathrm {outeval} (P).Q&\rightarrow &M\,|\,P\,|\,Q&\\{\text{(read)}}&M\,|\,\mathrm {rd} (t).P\,|\,t'&\rightarrow &M\,|\,P\sigma \,|\,t'&{\text{if exists }}\sigma {\text{ such that }}t\sigma =t'\\{\text{(input)}}&M\,|\,\mathrm {in} (t).P\,|\,t'&\rightarrow &M\,|\,P\sigma &{\text{if exists }}\sigma {\text{ such that }}t\sigma =t'\\{\text{(left choice)}}&M\,|\,P+Q&\rightarrow &M\,|\,P&\\{\text{(right choice)}}&M\,|\,P+Q&\rightarrow &M\,|\,Q&\\{\text{(recursion)}}&M\,|\,\mathbf {rec} X.P&\rightarrow &M\,|\,P\{\mathbf {rec} X.P/X\}&\\\end{array}}}$

Note that (input) consumes the tuple ${\displaystyle t'}$ from the tuple space whereas (read) only reads it. The resulting operational semantics is synchronous.

Linda was originally implemented in C and Fortran, but has since been implemented in many programming languages, including:

• C: C-Linda, TCP-Linda, LinuxTuples
• C++: CppLinda, Boreas
• C#: pSpaces
• Erlang: Erlinda
• Go: pSpaces
• Java: JavaSpaces, jRESP, TSpaces, LightTS, LIME, pSpaces
• JavaScript: pSpaces
• Lisp
• Lua: LuaTS Lua Lanes
• Prolog: SICStus Prolog Linda
• Python: PyLinda
• Ruby: Rinda
• Swift: pSpaces

Some of the more notable Linda implementations include:

• C-Linda or TCP-Linda - the earliest commercial and a widespread implementation of virtual shared memory for supercomputers and clustered systems from Scientific Computing Associates, founded by Martin Schultz.
• JavaSpaces - a Java-based tuplespace implementation that helped popularize distributed computing.
• TSpaces - a Java-based tuplespace platform from IBM.^{[undue weight? – discuss]}

• Dataflow
• Data flow diagram
• Dataflow programming
• Flow-based programming
• Parallel computing