Neural Heuristics for Scaling Constructional Language Processing

Paul Van Eecke, Jens Nevens, Katrien Beuls

Onderzoeksoutput: Articlepeer review

9 Downloads (Pure)


Constructionist approaches to language make use of form-meaning pairings, called constructions, to capture all linguistic knowledge that is necessary for comprehending and producing natural language expressions. Language processing consists then in combining the constructions of a grammar in such a way that they solve a given language comprehension or production problem. Finding such an adequate sequence of constructions constitutes a search problem that is combinatorial in nature and becomes intractable as grammars increase in size. In this paper, we introduce a neural methodology for learning heuristics that substantially optimise the search processes involved in constructional language processing. We validate the methodology in a case study for the CLEVR benchmark dataset. We show that our novel methodology outperforms state-of-the-art techniques in terms of size of the search space and time of computation, most markedly in the production direction. The results reported on in this paper have the potential to overcome the major efficiency obstacle that hinders current efforts in learning large-scale construction grammars, thereby contributing to the development of scalable constructional language processing systems.
Originele taal-2English
Pagina's (van-tot)287-314
Aantal pagina's27
TijdschriftJournal of Language Modelling
Nummer van het tijdschrift2
StatusPublished - 28 dec 2022


Duik in de onderzoeksthema's van 'Neural Heuristics for Scaling Constructional Language Processing'. Samen vormen ze een unieke vingerafdruk.

Citeer dit