# Finite-state machine

From Wikipedia the free encyclopedia

A **finite-state machine** (**FSM**) or **finite-state automaton** (**FSA**, plural: *automata*), **finite automaton**, or simply a **state machine**, is a mathematical model of computation. It is an abstract machine that can be in exactly one of a finite number of *states* at any given time. The FSM can change from one state to another in response to some inputs; the change from one state to another is called a *transition*.^{[1]} An FSM is defined by a list of its states, its initial state, and the inputs that trigger each transition. Finite-state machines are of two types—deterministic finite-state machines and non-deterministic finite-state machines.^{[2]} For any non-deterministic finite-state machine, an equivalent deterministic one can be constructed.

The behavior of state machines can be observed in many devices in modern society that perform a predetermined sequence of actions depending on a sequence of events with which they are presented. Simple examples are: vending machines, which dispense products when the proper combination of coins is deposited; elevators, whose sequence of stops is determined by the floors requested by riders; traffic lights, which change sequence when cars are waiting; combination locks, which require the input of a sequence of numbers in the proper order.

The finite-state machine has less computational power than some other models of computation such as the Turing machine.^{[3]} The computational power distinction means there are computational tasks that a Turing machine can do but an FSM cannot. This is because an FSM's memory is limited by the number of states it has. A finite-state machine has the same computational power as a Turing machine that is restricted such that its head may only perform "read" operations, and always has to move from left to right. FSMs are studied in the more general field of automata theory.

## Example: coin-operated turnstile

[edit]An example of a simple mechanism that can be modeled by a state machine is a turnstile.^{[4]}^{[5]} A turnstile, used to control access to subways and amusement park rides, is a gate with three rotating arms at waist height, one across the entryway. Initially the arms are locked, blocking the entry, preventing patrons from passing through. Depositing a coin or token in a slot on the turnstile unlocks the arms, allowing a single customer to push through. After the customer passes through, the arms are locked again until another coin is inserted.

Considered as a state machine, the turnstile has two possible states: *Locked* and *Unlocked*.^{[4]} There are two possible inputs that affect its state: putting a coin in the slot (*coin*) and pushing the arm (*push*). In the locked state, pushing on the arm has no effect; no matter how many times the input *push* is given, it stays in the locked state. Putting a coin in – that is, giving the machine a *coin* input – shifts the state from *Locked* to *Unlocked*. In the unlocked state, putting additional coins in has no effect; that is, giving additional *coin* inputs does not change the state. A customer pushing through the arms gives a *push* input and resets the state to *Locked*.

The turnstile state machine can be represented by a state-transition table, showing for each possible state, the transitions between them (based upon the inputs given to the machine) and the outputs resulting from each input:

Current State Input Next State Output Locked coin Unlocked Unlocks the turnstile so that the customer can push through. push Locked None Unlocked coin Unlocked None push Locked When the customer has pushed through, locks the turnstile.

The turnstile state machine can also be represented by a directed graph called a state diagram *(above)*. Each state is represented by a node (*circle*). Edges (*arrows*) show the transitions from one state to another. Each arrow is labeled with the input that triggers that transition. An input that doesn't cause a change of state (such as a *coin* input in the *Unlocked* state) is represented by a circular arrow returning to the original state. The arrow into the *Locked* node from the black dot indicates it is the initial state.

## Concepts and terminology

[edit]A *state* is a description of the status of a system that is waiting to execute a *transition*. A transition is a set of actions to be executed when a condition is fulfilled or when an event is received. For example, when using an audio system to listen to the radio (the system is in the "radio" state), receiving a "next" stimulus results in moving to the next station. When the system is in the "CD" state, the "next" stimulus results in moving to the next track. Identical stimuli trigger different actions depending on the current state.

In some finite-state machine representations, it is also possible to associate actions with a state:

- an entry action: performed
*when entering*the state, and - an exit action: performed
*when exiting*the state.

## Representations

[edit]### State/Event table

[edit]Several state-transition table types are used. The most common representation is shown below: the combination of current state (e.g. B) and input (e.g. Y) shows the next state (e.g. C). The complete action's information is not directly described in the table and can only be added using footnotes.^{[further explanation needed]} An FSM definition including the full action's information is possible using state tables (see also virtual finite-state machine).

Current state Input | State A | State B | State C |
---|---|---|---|

Input X | ... | ... | ... |

Input Y | ... | State C | ... |

Input Z | ... | ... | ... |

### UML state machines

[edit]The Unified Modeling Language has a notation for describing state machines. UML state machines overcome the limitations^{[citation needed]} of traditional finite-state machines while retaining their main benefits. UML state machines introduce the new concepts of hierarchically nested states and orthogonal regions, while extending the notion of actions. UML state machines have the characteristics of both Mealy machines and Moore machines. They support actions that depend on both the state of the system and the triggering event, as in Mealy machines, as well as entry and exit actions, which are associated with states rather than transitions, as in Moore machines.^{[citation needed]}

### SDL state machines

[edit]The Specification and Description Language is a standard from ITU that includes graphical symbols to describe actions in the transition:

- send an event
- receive an event
- start a timer
- cancel a timer
- start another concurrent state machine
- decision

SDL embeds basic data types called "Abstract Data Types", an action language, and an execution semantic in order to make the finite-state machine executable.^{[citation needed]}

### Other state diagrams

[edit]There are a large number of variants to represent an FSM such as the one in figure 3.

## Usage

[edit]In addition to their use in modeling reactive systems presented here, finite-state machines are significant in many different areas, including electrical engineering, linguistics, computer science, philosophy, biology, mathematics, video game programming, and logic. Finite-state machines are a class of automata studied in automata theory and the theory of computation. In computer science, finite-state machines are widely used in modeling of application behavior (control theory), design of hardware digital systems, software engineering, compilers, network protocols, and computational linguistics.

## Classification

[edit]Finite-state machines can be subdivided into acceptors, classifiers, transducers and sequencers.^{[6]}

### Acceptors

[edit]**Acceptors** (also called *detectors* or **recognizers**) produce binary output, indicating whether or not the received input is accepted. Each state of an acceptor is either *accepting* or *non accepting*. Once all input has been received, if the current state is an accepting state, the input is accepted; otherwise it is rejected. As a rule, input is a sequence of symbols (characters); actions are not used. The start state can also be an accepting state, in which case the acceptor accepts the empty string. The example in figure 4 shows an acceptor that accepts the string "nice". In this acceptor, the only accepting state is state 7.

A (possibly infinite) set of symbol sequences, called a formal language, is a regular language if there is some acceptor that accepts *exactly* that set. For example, the set of binary strings with an even number of zeroes is a regular language (cf. Fig. 5), while the set of all strings whose length is a prime number is not.^{[7]}^{: 18, 71 }

An acceptor could also be described as defining a language that would contain every string accepted by the acceptor but none of the rejected ones; that language is *accepted* by the acceptor. By definition, the languages accepted by acceptors are the regular languages.

The problem of determining the language accepted by a given acceptor is an instance of the algebraic path problem—itself a generalization of the shortest path problem to graphs with edges weighted by the elements of an (arbitrary) semiring.^{[8]}^{[9]}^{[jargon]}

An example of an accepting state appears in Fig. 5: a deterministic finite automaton (DFA) that detects whether the binary input string contains an even number of 0s.

*S*_{1} (which is also the start state) indicates the state at which an even number of 0s has been input. S_{1} is therefore an accepting state. This acceptor will finish in an accept state, if the binary string contains an even number of 0s (including any binary string containing no 0s). Examples of strings accepted by this acceptor are ε (the empty string), 1, 11, 11..., 00, 010, 1010, 10110, etc.

### Classifiers

[edit]**Classifiers** are a generalization of acceptors that produce *n*-ary output where *n* is strictly greater than two.^{[10]}

### Transducers

[edit]*Transducers* produce output based on a given input and/or a state using actions. They are used for control applications and in the field of computational linguistics.

In control applications, two types are distinguished:

- Moore machine
- The FSM uses only entry actions, i.e., output depends only on state. The advantage of the Moore model is a simplification of the behaviour. Consider an elevator door. The state machine recognizes two commands: "command_open" and "command_close", which trigger state changes. The entry action (E:) in state "Opening" starts a motor opening the door, the entry action in state "Closing" starts a motor in the other direction closing the door. States "Opened" and "Closed" stop the motor when fully opened or closed. They signal to the outside world (e.g., to other state machines) the situation: "door is open" or "door is closed".

- Mealy machine
- The FSM also uses input actions, i.e., output depends on input and state. The use of a Mealy FSM leads often to a reduction of the number of states. The example in figure 7 shows a Mealy FSM implementing the same behaviour as in the Moore example (the behaviour depends on the implemented FSM execution model and will work, e.g., for virtual FSM but not for event-driven FSM). There are two input actions (I:): "start motor to close the door if command_close arrives" and "start motor in the other direction to open the door if command_open arrives". The "opening" and "closing" intermediate states are not shown.

### Sequencers

[edit]*Sequencers* (also called *generators*) are a subclass of acceptors and transducers that have a single-letter input alphabet. They produce only one sequence, which can be seen as an output sequence of acceptor or transducer outputs.^{[6]}

### Determinism

[edit]A further distinction is between *deterministic* (DFA) and *non-deterministic* (NFA, GNFA) automata. In a deterministic automaton, every state has exactly one transition for each possible input. In a non-deterministic automaton, an input can lead to one, more than one, or no transition for a given state. The powerset construction algorithm can transform any nondeterministic automaton into a (usually more complex) deterministic automaton with identical functionality.

A finite-state machine with only one state is called a "combinatorial FSM". It only allows actions upon transition *into* a state. This concept is useful in cases where a number of finite-state machines are required to work together, and when it is convenient to consider a purely combinatorial part as a form of FSM to suit the design tools.^{[11]}

## Alternative semantics

[edit]There are other sets of semantics available to represent state machines. For example, there are tools for modeling and designing logic for embedded controllers.^{[12]} They combine hierarchical state machines (which usually have more than one current state), flow graphs, and truth tables into one language, resulting in a different formalism and set of semantics.^{[13]} These charts, like Harel's original state machines,^{[14]} support hierarchically nested states, orthogonal regions, state actions, and transition actions.^{[15]}

## Mathematical model

[edit]In accordance with the general classification, the following formal definitions are found.

A *deterministic finite-state machine* or *deterministic finite-state acceptor* is a quintuple , where:

- is the input alphabet (a finite non-empty set of symbols);
- is a finite non-empty set of states;
- is an initial state, an element of ;
- is the state-transition function: (in a nondeterministic finite automaton it would be , i.e. would return a set of states);
- is the set of final states, a (possibly empty) subset of .

For both deterministic and non-deterministic FSMs, it is conventional to allow to be a partial function, i.e. does not have to be defined for every combination of and . If an FSM is in a state , the next symbol is and is not defined, then can announce an error (i.e. reject the input). This is useful in definitions of general state machines, but less useful when transforming the machine. Some algorithms in their default form may require total functions.

A finite-state machine has the same computational power as a Turing machine that is restricted such that its head may only perform "read" operations, and always has to move from left to right. That is, each formal language accepted by a finite-state machine is accepted by such a kind of restricted Turing machine, and vice versa.^{[16]}

A *finite-state transducer* is a sextuple , where:

- is the input alphabet (a finite non-empty set of symbols);
- is the output alphabet (a finite non-empty set of symbols);
- is a finite non-empty set of states;
- is the initial state, an element of ;
- is the state-transition function: ;
- is the output function.

If the output function depends on the state and input symbol () that definition corresponds to the *Mealy model*, and can be modelled as a Mealy machine. If the output function depends only on the state () that definition corresponds to the *Moore model*, and can be modelled as a Moore machine. A finite-state machine with no output function at all is known as a semiautomaton or transition system.

If we disregard the first output symbol of a Moore machine, , then it can be readily converted to an output-equivalent Mealy machine by setting the output function of every Mealy transition (i.e. labeling every edge) with the output symbol given of the destination Moore state. The converse transformation is less straightforward because a Mealy machine state may have different output labels on its incoming transitions (edges). Every such state needs to be split in multiple Moore machine states, one for every incident output symbol.^{[17]}

## Optimization

[edit]Optimizing an FSM means finding a machine with the minimum number of states that performs the same function. The fastest known algorithm doing this is the Hopcroft minimization algorithm.^{[18]}^{[19]} Other techniques include using an implication table, or the Moore reduction procedure.^{[20]} Additionally, acyclic FSAs can be minimized in linear time.^{[21]}

## Implementation

[edit]### Hardware applications

[edit]In a digital circuit, an FSM may be built using a programmable logic device, a programmable logic controller, logic gates and flip flops or relays. More specifically, a hardware implementation requires a register to store state variables, a block of combinational logic that determines the state transition, and a second block of combinational logic that determines the output of an FSM. One of the classic hardware implementations is the Richards controller.

In a *Medvedev machine*, the output is directly connected to the state flip-flops minimizing the time delay between flip-flops and output.^{[22]}^{[23]}

Through state encoding for low power state machines may be optimized to minimize power consumption.

### Software applications

[edit]The following concepts are commonly used to build software applications with finite-state machines:

- Automata-based programming
- Event-driven finite-state machine
- Virtual finite-state machine
- State design pattern

### Finite-state machines and compilers

[edit]Finite automata are often used in the frontend of programming language compilers. Such a frontend may comprise several finite-state machines that implement a lexical analyzer and a parser. Starting from a sequence of characters, the lexical analyzer builds a sequence of language tokens (such as reserved words, literals, and identifiers) from which the parser builds a syntax tree. The lexical analyzer and the parser handle the regular and context-free parts of the programming language's grammar.^{[24]}

## See also

[edit]- Abstract state machines
- Alternating finite automaton
- Communicating finite-state machine
- Control system
- Control table
- Decision tables
- DEVS
- Hidden Markov model
- Petri net
- Pushdown automaton
- Quantum finite automaton
- SCXML
- Semiautomaton
- Semigroup action
- Sequential logic
- State diagram
- Synchronizing word
- Transformation semigroup
- Transition system
- Tree automaton
- Turing machine
- UML state machine

## References

[edit]**^**Wang, Jiacun (2019).*Formal Methods in Computer Science*. CRC Press. p. 34. ISBN 978-1-4987-7532-8.**^**"Finite State Machines – Brilliant Math & Science Wiki".*brilliant.org*. Retrieved 2018-04-14.**^**Belzer, Jack; Holzman, Albert George; Kent, Allen (1975).*Encyclopedia of Computer Science and Technology*. Vol. 25. USA: CRC Press. p. 73. ISBN 978-0-8247-2275-3.- ^
^{a}^{b}Koshy, Thomas (2004).*Discrete Mathematics With Applications*. Academic Press. p. 762. ISBN 978-0-12-421180-3. **^**Wright, David R. (2005). "Finite State Machines" (PDF).*CSC215 Class Notes*. David R. Wright website, N. Carolina State Univ. Archived from the original (PDF) on 2014-03-27. Retrieved 2012-07-14.- ^
^{a}^{b}Keller, Robert M. (2001). "Classifiers, Acceptors, Transducers, and Sequencers" (PDF).*Computer Science: Abstraction to Implementation*(PDF). Harvey Mudd College. p. 480. **^**John E. Hopcroft and Jeffrey D. Ullman (1979).*Introduction to Automata Theory, Languages, and Computation*. Reading/MA: Addison-Wesley. ISBN 978-0-201-02988-8.**^**Pouly, Marc; Kohlas, Jürg (2011).*Generic Inference: A Unifying Theory for Automated Reasoning*. John Wiley & Sons. Chapter 6. Valuation Algebras for Path Problems, p. 223 in particular. ISBN 978-1-118-01086-0.**^**Jacek Jonczy (Jun 2008). "Algebraic path problems" (PDF). Archived from the original (PDF) on 2014-08-21. Retrieved 2014-08-20., p. 34**^**Felkin, M. (2007). Guillet, Fabrice; Hamilton, Howard J. (eds.).*Quality Measures in Data Mining - Studies in Computational Intelligence*. Vol. 43. Springer, Berlin, Heidelberg. pp. 277–278. doi:10.1007/978-3-540-44918-8_12. ISBN 978-3-540-44911-9.**^**Brutscheck, M., Berger, S., Franke, M., Schwarzbacher, A., Becker, S.: Structural Division Procedure for Efficient IC Analysis. IET Irish Signals and Systems Conference, (ISSC 2008), pp.18–23. Galway, Ireland, 18–19 June 2008. [1]**^**"Tiwari, A. (2002). Formal Semantics and Analysis Methods for Simulink Stateflow Models" (PDF).*sri.com*. Retrieved 2018-04-14.**^**Hamon, G. (2005).*A Denotational Semantics for Stateflow*. International Conference on Embedded Software. Jersey City, NJ: ACM. pp. 164–172. CiteSeerX 10.1.1.89.8817.**^**"Harel, D. (1987). A Visual Formalism for Complex Systems. Science of Computer Programming, 231–274" (PDF). Archived from the original (PDF) on 2011-07-15. Retrieved 2011-06-07.**^**"Alur, R., Kanade, A., Ramesh, S., & Shashidhar, K. C. (2008). Symbolic analysis for improving simulation coverage of Simulink/Stateflow models. International Conference on Embedded Software (pp. 89–98). Atlanta, GA: ACM" (PDF). Archived from the original (PDF) on 2011-07-15.**^**Black, Paul E (12 May 2008). "Finite State Machine".*Dictionary of Algorithms and Data Structures*. U.S. National Institute of Standards and Technology. Archived from the original on 13 October 2018. Retrieved 2 November 2016.**^**Anderson, James Andrew; Head, Thomas J. (2006).*Automata theory with modern applications*. Cambridge University Press. pp. 105–108. ISBN 978-0-521-84887-9.**^**Hopcroft, John E. (1971). An*n*log*n*algorithm for minimizing states in a finite automaton (PDF) (Technical Report). Vol. CS-TR-71-190. Stanford Univ.^{[permanent dead link]}**^**Almeida, Marco; Moreira, Nelma; Reis, Rogerio (2007). On the performance of automata minimization algorithms (PDF) (Technical Report). Vol. DCC-2007-03. Porto Univ. Archived from the original (PDF) on 17 January 2009. Retrieved 25 June 2008.**^**Edward F. Moore (1956). C.E. Shannon and J. McCarthy (ed.). "Gedanken-Experiments on Sequential Machines".*Annals of Mathematics Studies*.**34**. Princeton University Press: 129–153. Here: Theorem 4, p.142.**^**Revuz, D. (1992). "Minimization of Acyclic automata in Linear Time".*Theoretical Computer Science*.**92**: 181–189. doi:10.1016/0304-3975(92)90142-3.**^**Kaeslin, Hubert (2008). "Mealy, Moore, Medvedev-type and combinatorial output bits".*Digital Integrated Circuit Design: From VLSI Architectures to CMOS Fabrication*. Cambridge University Press. p. 787. ISBN 978-0-521-88267-5.**^**Slides Archived 18 January 2017 at the Wayback Machine,*Synchronous Finite State Machines; Design and Behaviour*, University of Applied Sciences Hamburg, p.18**^**Aho, Alfred V.; Sethi, Ravi; Ullman, Jeffrey D. (1986).*Compilers: Principles, Techniques, and Tools*(1st ed.). Addison-Wesley. ISBN 978-0-201-10088-4.

## Further reading

[edit]### General

[edit]- Sakarovitch, Jacques (2009).
*Elements of automata theory*. Translated from the French by Reuben Thomas. Cambridge University Press. ISBN 978-0-521-84425-3. Zbl 1188.68177. - Wagner, F., "Modeling Software with Finite State Machines: A Practical Approach", Auerbach Publications, 2006, ISBN 0-8493-8086-3.
- ITU-T,
*Recommendation Z.100 Specification and Description Language (SDL)* - Samek, M.,
*Practical Statecharts in C/C++*, CMP Books, 2002, ISBN 1-57820-110-1. - Samek, M.,
*Practical UML Statecharts in C/C++, 2nd Edition*, Newnes, 2008, ISBN 0-7506-8706-1. - Gardner, T.,
*Advanced State Management*Archived 2008-11-19 at the Wayback Machine, 2007 - Cassandras, C., Lafortune, S., "Introduction to Discrete Event Systems". Kluwer, 1999, ISBN 0-7923-8609-4.
- Timothy Kam,
*Synthesis of Finite State Machines: Functional Optimization*. Kluwer Academic Publishers, Boston 1997, ISBN 0-7923-9842-4 - Tiziano Villa,
*Synthesis of Finite State Machines: Logic Optimization*. Kluwer Academic Publishers, Boston 1997, ISBN 0-7923-9892-0 - Carroll, J., Long, D.,
*Theory of Finite Automata with an Introduction to Formal Languages*. Prentice Hall, Englewood Cliffs, 1989. - Kohavi, Z.,
*Switching and Finite Automata Theory*. McGraw-Hill, 1978. - Gill, A.,
*Introduction to the Theory of Finite-state Machines*. McGraw-Hill, 1962. - Ginsburg, S.,
*An Introduction to Mathematical Machine Theory*. Addison-Wesley, 1962.

### Finite-state machines (automata theory) in theoretical computer science

[edit]- Arbib, Michael A. (1969).
*Theories of Abstract Automata*(1st ed.). Englewood Cliffs, N.J.: Prentice-Hall, Inc. ISBN 978-0-13-913368-8. - Bobrow, Leonard S.; Arbib, Michael A. (1974).
*Discrete Mathematics: Applied Algebra for Computer and Information Science*(1st ed.). Philadelphia: W. B. Saunders Company, Inc. ISBN 978-0-7216-1768-8. - Booth, Taylor L. (1967).
*Sequential Machines and Automata Theory*(1st ed.). New York: John Wiley and Sons, Inc. Library of Congress Card Catalog Number 67-25924. - Boolos, George; Jeffrey, Richard (1999) [1989].
*Computability and Logic*(3rd ed.). Cambridge, England: Cambridge University Press. ISBN 978-0-521-20402-6. - Brookshear, J. Glenn (1989).
*Theory of Computation: Formal Languages, Automata, and Complexity*. Redwood City, California: Benjamin/Cummings Publish Company, Inc. ISBN 978-0-8053-0143-4. - Davis, Martin; Sigal, Ron; Weyuker, Elaine J. (1994).
*Computability, Complexity, and Languages and Logic: Fundamentals of Theoretical Computer Science*(2nd ed.). San Diego: Academic Press, Harcourt, Brace & Company. ISBN 978-0-12-206382-4. - Hopcroft, John; Ullman, Jeffrey (1979).
*Introduction to Automata Theory, Languages, and Computation*(1st ed.). Reading Mass: Addison-Wesley. ISBN 978-0-201-02988-8. - Hopcroft, John E.; Motwani, Rajeev; Ullman, Jeffrey D. (2001).
*Introduction to Automata Theory, Languages, and Computation*(2nd ed.). Reading Mass: Addison-Wesley. ISBN 978-0-201-44124-6. - Hopkin, David; Moss, Barbara (1976).
*Automata*. New York: Elsevier North-Holland. ISBN 978-0-444-00249-5. - Kozen, Dexter C. (1997).
*Automata and Computability*(1st ed.). New York: Springer-Verlag. ISBN 978-0-387-94907-9. - Lewis, Harry R.; Papadimitriou, Christos H. (1998).
*Elements of the Theory of Computation*(2nd ed.). Upper Saddle River, New Jersey: Prentice-Hall. ISBN 978-0-13-262478-7. - Linz, Peter (2006).
*Formal Languages and Automata*(4th ed.). Sudbury, MA: Jones and Bartlett. ISBN 978-0-7637-3798-6. - Minsky, Marvin (1967).
*Computation: Finite and Infinite Machines*(1st ed.). New Jersey: Prentice-Hall. - Papadimitriou, Christos (1993).
*Computational Complexity*(1st ed.). Addison Wesley. ISBN 978-0-201-53082-7. - Pippenger, Nicholas (1997).
*Theories of Computability*(1st ed.). Cambridge, England: Cambridge University Press. ISBN 978-0-521-55380-3. - Rodger, Susan; Finley, Thomas (2006).
*JFLAP: An Interactive Formal Languages and Automata Package*(1st ed.). Sudbury, MA: Jones and Bartlett. ISBN 978-0-7637-3834-1. - Sipser, Michael (2006).
*Introduction to the Theory of Computation*(2nd ed.). Boston Mass: Thomson Course Technology. ISBN 978-0-534-95097-2. - Wood, Derick (1987).
*Theory of Computation*(1st ed.). New York: Harper & Row, Publishers, Inc. ISBN 978-0-06-047208-5.

### Abstract state machines in theoretical computer science

[edit]- Gurevich, Yuri (July 2000). "Sequential Abstract State Machines Capture Sequential Algorithms" (PDF).
*ACM Transactions on Computational Logic*.**1**(1): 77–111. CiteSeerX 10.1.1.146.3017. doi:10.1145/343369.343384. S2CID 2031696.

### Machine learning using finite-state algorithms

[edit]- Mitchell, Tom M. (1997).
*Machine Learning*(1st ed.). New York: WCB/McGraw-Hill Corporation. ISBN 978-0-07-042807-2.

### Hardware engineering: state minimization and synthesis of sequential circuits

[edit]- Booth, Taylor L. (1967).
*Sequential Machines and Automata Theory*(1st ed.). New York: John Wiley and Sons, Inc. Library of Congress Card Catalog Number 67-25924. - Booth, Taylor L. (1971).
*Digital Networks and Computer Systems*(1st ed.). New York: John Wiley and Sons, Inc. ISBN 978-0-471-08840-0. - McCluskey, E. J. (1965).
*Introduction to the Theory of Switching Circuits*(1st ed.). New York: McGraw-Hill Book Company, Inc. Library of Congress Card Catalog Number 65-17394. - Hill, Fredrick J.; Peterson, Gerald R. (1965).
*Introduction to the Theory of Switching Circuits*(1st ed.). New York: McGraw-Hill Book Company. Library of Congress Card Catalog Number 65-17394.

### Finite Markov chain processes

[edit]- "We may think of a Markov chain as a process that moves successively through a set of states
*s*,_{1}*s*, …,_{2}*s*. … if it is in state_{r}*s*it moves on to the next stop to state_{i}*s*with probability_{j}*p*. These probabilities can be exhibited in the form of a transition matrix" (Kemeny (1959), p. 384)_{ij}

- "We may think of a Markov chain as a process that moves successively through a set of states

Finite Markov-chain processes are also known as subshifts of finite type.

- Booth, Taylor L. (1967).
*Sequential Machines and Automata Theory*(1st ed.). New York: John Wiley and Sons, Inc. Library of Congress Card Catalog Number 67-25924. - Kemeny, John G.; Mirkil, Hazleton; Snell, J. Laurie; Thompson, Gerald L. (1959).
*Finite Mathematical Structures*(1st ed.). Englewood Cliffs, N.J.: Prentice-Hall, Inc. Library of Congress Card Catalog Number 59-12841. Chapter 6 "Finite Markov Chains".

## External links

[edit]- Finite State Automata at Curlie
*Modeling a Simple AI behavior using a Finite State Machine*Example of usage in Video Games- Free On-Line Dictionary of Computing description of Finite-State Machines
- NIST Dictionary of Algorithms and Data Structures description of Finite-State Machines
- A brief overview of state machine types, comparing theoretical aspects of Mealy, Moore, Harel & UML state machines.