On effects of compression with hyperdimensional computing in distributed randomized neural networks
2021 (English)In: Advances in Computational Intelligence: 16th International Work-Conference on Artificial Neural Networks, IWANN 2021, Virtual Event, June 16–18, 2021, Proceedings, Part II / [ed] Ignacio Rojas; Gonzalo Joya; Andreu Català, Springer, 2021, Vol. 12862, p. 155-167Conference paper, Published paper (Refereed)
Abstract [en]
A change of the prevalent supervised learning techniques is foreseeable in the near future: from the complex, computational expensive algorithms to more flexible and elementary training ones. The strong revitalization of randomized algorithms can be framed in this prospect steering. We recently proposed a model for distributed classification based on randomized neural networks and hyperdimensional computing, which takes into account cost of information exchange between agents using compression. The use of compression is important as it addresses the issues related to the communication bottleneck, however, the original approach is rigid in the way the compression is used. Therefore, in this work, we propose a more flexible approach to compression and compare it to conventional compression algorithms, dimensionality reduction, and quantization techniques.
Place, publisher, year, edition, pages
Springer, 2021. Vol. 12862, p. 155-167
Series
Lecture Notes in Computer Science, ISSN 0302-9743, E-ISSN 1611-3349
Keywords [en]
distributed randomized neural networks, compression, vector symbolic architectures, hyperdimensional computing
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:oru:diva-116448DOI: 10.1007/978-3-030-85099-9_13ISI: 000696688800013Scopus ID: 2-s2.0-85115177088ISBN: 9783030850982 (print)ISBN: 9783030850999 (electronic)OAI: oai:DiVA.org:oru-116448DiVA, id: diva2:1902635
Conference
16th International Work-Conference on Artificial Neural Networks (IWANN 2021), Online, June 16-18, 2021
Funder
EU, Horizon 2020, 839179
Note
The work of D.K. was supported by the European Union’s Horizon 2020 Programme under the Marie Skłodowska-Curie Individual Fellowship Grant (839179) and in part by the DARPA’s AIE (HyDDENN) program and by AFOSR FA9550-19-1-0241.
2024-10-022024-10-022024-10-02Bibliographically approved