Article

SuperGLUE: The AI race

2024-04-04

Abstract excerpt

The SuperGLUE (Super General Language Understanding Evaluation) benchmark is utilized in the evaluation of natural language processing (NLP) systems. It comprises eight challenging tasks that test complex linguistic and cognitive abilities. This review focuses on five language models that achieved the best performances in executing the tasks of this benchmark up to the year 2023: Vega v2, ST-MOE-32B, METRO, ERNIE...

Topics

Open a Topic to create a Post that cites this publication.

Identifiers and source

Literature Corpus work: 51b4d865-9095-5547-a151-bd11d8a1afe2
DOI: 10.22541/au.171221411.13617323/v1

Open publication

Related research

Semantic proximity does not establish scientific evidence.

Click a neighbor to travelStep 1 · 12 closest

SuperGLUE: The AI raceDOI 10.22541/au.171221411.13617323/v1Read

A Comparative Survey of Large Language Models: Foundation, Instruction-Tuned, and Multimodal VariantsSemantic proximity Read

Upscaling A Smaller LLM to More Parameters via Manual Regressive DistillationSemantic proximity Read

Engineering A Large Language Model From ScratchSemantic proximity Read

Transformation of Large Language Models: A State of ArtSemantic proximity Read

Bridging Finance and AI: A Comprehensive Survey of Large Language Models in Financial ApplicationsSemantic proximity Read

Benchmarking of Commercial Large Language Models: ChatGPT, Mistral, and LlamaSemantic proximity Read

Unified Efficient Fine-Tuning Techniques for Open-Source Large Language ModelsSemantic proximity Read

Optimizing Large Language Model Scaling with Micro Batch Pipeline and Inference ParallelismSemantic proximity Read

A Survey of Large Language Models: Evolution, Architectures, Adaptation, Benchmarking, Applications, Challenges, and Societal ImplicationsSemantic proximity Read

Boost Large Language Model Performance through Self-Training with Reward Guided Tree SearchSemantic proximity Read

A Comprehensive Review of DeepSeek: Performance, Architecture and CapabilitiesSemantic proximity Read

ChatGPT vs. Bard: A Comparative StudySemantic proximity Read