High-Dimensional Computing as a Nanoscalable ParadigmShow others and affiliations
2017 (English)In: IEEE Transactions on Circuits and Systems Part 1: Regular Papers, ISSN 1549-8328, E-ISSN 1558-0806, Vol. 64, no 9, p. 2508-2521Article in journal (Refereed) Published
Abstract [en]
We outline a model of computing with high-dimensional (HD) vectors-where the dimensionality is in the thousands. It is built on ideas from traditional (symbolic) computing and artificial neural nets/deep learning, and complements them with ideas from probability theory, statistics, and abstract algebra. Key properties of HD computing include a well-defined set of arithmetic operations on vectors, generality, scalability, robustness, fast learning, and ubiquitous parallel operation, making it possible to develop efficient algorithms for large-scale real-world tasks. We present a 2-D architecture and demonstrate its functionality with examples from text analysis, pattern recognition, and biosignal processing, while achieving high levels of classification accuracy (close to or above conventional machine-learning methods), energy efficiency, and robustness with simple algorithms that learn fast. HD computing is ideally suited for 3-D nanometer circuit technology, vastly increasing circuit density and energy efficiency, and paving a way to systems capable of advanced cognitive tasks.
Place, publisher, year, edition, pages
IEEE, 2017. Vol. 64, no 9, p. 2508-2521
Keywords [en]
alternative computing, bio-inspired computing, hyperdimensional computing, vector symbolic architectures, in-memory computing, 3D RRAM, pattern recognition
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:oru:diva-116406DOI: 10.1109/tcsi.2017.2705051ISI: 000409058000026OAI: oai:DiVA.org:oru-116406DiVA, id: diva2:1901753
Note
This work was supported by the Systems on Nanoscale Information fabriCs, one of the six SRC STARnet Centers, sponsored by MARCO and DARPA.
2024-09-302024-09-302024-10-01Bibliographically approved