<LK Lab, Benchmark> TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models (2022.04)

<LK Lab, Benchmark> TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models (2022.04)

관심있는 NLP 논문을 읽어보고 간단히 정리했습니다. (Language & Knowledge Lab의 Retreival 관련) 혹시 부족하거나 잘못된 내용이 있다면 댓글 부탁드립니다 ️ [KAIST, LG AI Research, Korea University] - LM이 이전의 지식을 그대로 보유하고 있는지, 그리고 최신의 지식을 습득했는지 확인할 수 있는 벤치마크 - TWiki-Diffsets, TWiki-Probes 두 개의 셋으로 구성 - diff data에 대해 LM을 continual learning 하는 것이 perplexity 관점에서 준수하다는 결과 배경 LM의 능력을 평가하는 데이터셋은 대부분 static train / test 데이터셋의 misalignment는 closed-boo..

원문링크 : <LK Lab, Benchmark> TemporalWiki: A Lifelong Benchmark for Training and Evaluating Ever-Evolving Language Models (2022.04)

 등록된 다른 글

5.3. 거듭제곱의 원리

5.3. 거듭제곱의 원리

[Short Paper Reveiw] AutoML-GPT: Automatic Machine Learning with GPT

[Short Paper Reveiw] AutoML-GPT: Automatic Machine Learning with GPT

[BOJ] 1780 : 종이의 개수 [분할](Python)

[BOJ] 1780 : 종이의 개수 [분할](Python)

<LLM> [Google DeepMind] Gemma: Open Models Based on GeminiResearch and Technology (2024.02)

<LLM> [Google DeepMind] Gemma: Open Models Based on GeminiResearch and Technology (2024.02)

<Benchmark, CoT> [Google, REVEAL] A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chains (2024.02)

<Benchmark, CoT> [Google, REVEAL] A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chains (2024.02)

SQuAD paper review(해석)

SQuAD paper review(해석)

Analysis of Algorithms(1) : Analysis of Algorithms Introduction

Analysis of Algorithms(1) : Analysis of Algorithms Introduction

<Instruction> WizardCoder: Empowering Code Large Language Models with Evol-Instruct

<Instruction> WizardCoder: Empowering Code Large Language Models with Evol-Instruct