SemOI2 - Building Adaptive and Cost-Effective Recognition Applications With Semantic Augmentation
2022 (English)In: CEUR Workshop Proceedings, CEUR-WS , 2022Conference paper, Published paper (Refereed)
Abstract [en]
Neural nets are the backbone for many innovative applications when it comes to making sense out of unstructured data. This technology, however, also has some significant downsides. Training these neural nets requires vast amounts of annotated training data and computational power and is, thus, expensive. Adding, altering, or removing concepts all trigger costly retraining of the neural net. Semantic technologies can curb these systemic disadvantages. They can be connected to the neural net and augment the detection. The ontology can be easily adapted to new situations and use cases without requiring much computational power. This paper presents a prototype application for connecting the general-purpose OpenImages detection with a semantic. Free-to-use training datasets provide a cost-efficient way to use neural nets - often, there exist even pre-trained models for the large machine learning frameworks. The semantic contextualizes the low-level knowledge and enables the realization of specific use cases. We further propose a methodology to transfer the probability of the image detection and the prominence of items in the picture to the ground truth of the ontology by introducing a new measurement Semantic Confidence (SC).
Place, publisher, year, edition, pages
CEUR-WS , 2022.
Series
CEUR Workshop Proceedings, E-ISSN 1613-0073 ; 3121
Keywords [en]
CNN, Image Recognition, Ontology, OpenImages, Semantic Augmentation, Cost effectiveness, Large dataset, Neural networks, Semantics, Annotated training data, Computational power, Cost effective, Ontology's, Openimage, Semantic augmentations, Semantic technologies, Training dataset, Unstructured data
National Category
Computer Sciences
Identifiers
URN: urn:nbn:se:hj:diva-59491Scopus ID: 2-s2.0-85128757790OAI: oai:DiVA.org:hj-59491DiVA, id: diva2:1740186
Conference
AAAI 2022 Spring Symposium on Machine Learning and Knowledge Engineering for Hybrid Intelligence, AAAI-MAKE 2022, 21 March 2022 through 23 March 2022
2023-02-282023-02-282023-02-28Bibliographically approved