1 |
A Systematic Assessment of Syntactic Generalization in Neural Language Models
|
|
|
|
In: Association for Computational Linguistics (2021)
|
|
BASE
|
|
Show details
|
|
2 |
SyntaxGym: An Online Platform for Targeted Evaluation of Language Models
|
|
|
|
In: Association for Computational Linguistics (2021)
|
|
BASE
|
|
Show details
|
|
3 |
SyntaxGym: An Online Platform for Targeted Evaluation of Language Models
|
|
|
|
In: Association for Computational Linguistics (2021)
|
|
Abstract:
Targeted syntactic evaluations have yielded insights into the generalizations learned by neural network language models. However, this line of research requires an uncommon confluence of skills: both the theoretical knowledge needed to design controlled psycholinguistic experiments, and the technical proficiency needed to train and deploy large-scale language models. We present SyntaxGym, an online platform designed to make targeted evaluations accessible to both experts in NLP and linguistics, reproducible across computing environments, and standardized following the norms of psycholinguistic experimental design. This paper releases two tools of independent value for the computational linguistics community: 1. A website, syntaxgym.org, which centralizes the process of targeted syntactic evaluation and provides easy tools for analysis and visualization; 2. Two command-line tools, syntaxgym and lm-zoo, which allow any user to reproduce targeted syntactic evaluations and general language model inference on their own machine. ; NIH (Award T32NS105587)
|
|
URL: https://hdl.handle.net/1721.1/138281.2
|
|
BASE
|
|
Hide details
|
|
4 |
Linking artificial and human neural representations of language
|
|
|
|
In: Association for Computational Linguistics (2021)
|
|
BASE
|
|
Show details
|
|
5 |
A Systematic Assessment of Syntactic Generalization in Neural Language Models ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Does the brain represent words? An evaluation of brain decoding studies of language understanding ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Word learning and the acquisition of syntactic--semantic overhypotheses ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|