Deep Neural Network(3)

Deep Neural Network(3)

1. Parameters vs Hyperparameters What are hyperparameters? 최종적으로 parameter인 w,b를 결정하는데 영향을 주는 것들이다. learning rate 알파, iterations 횟수, hidden layer 개수 L, hidden unit 개수 n, activation function 종류 등 Applied deep learning is a very empirical process hyper parameter를 조정하면서 cost값이 작아지는 조건을 찾아나가는 것이다. 2. What does this have to do with the brain? Forward and backward propagation 교수님은 deep learning의 구조가 인..

원문링크 : Deep Neural Network(3)

 등록된 다른 글

<KD, Fusion> Knowledge Fusion of Large Language Models (2024.01)

<KD, Fusion> Knowledge Fusion of Large Language Models (2024.01)

<Multi-modal> FLAVA: A Foundational Language And Vision Alignment Model

<Multi-modal> FLAVA: A Foundational Language And Vision Alignment Model

<LK Lab, CoT> The CoT Collection: Improving Zero-shot and Few-shot Learning of Language MOdels via Chain-of-Thought Fine-Tuning (2023.10)

<LK Lab, CoT> The CoT Collection: Improving Zero-shot and Few-shot Learning of Language MOdels via Chain-of-Thought Fine-Tuning (2023.10)

<LK Lab, Retrieval> [RoSPr] Efficiently Enhancing Zero-Shot Performance of Instruction Following Model via Retrieval of Soft Prompt (2023.10)

<LK Lab, Retrieval> [RoSPr] Efficiently Enhancing Zero-Shot Performance of Instruction Following Model via Retrieval of Soft Prompt (2023.10)

<Data Type> [BitNet b1.58] The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits (2024.02)

<Data Type> [BitNet b1.58] The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits (2024.02)

Vector

Vector

<Multi-modal> [LLaVA-1.5] Improved Baselines with Visual Instruction Tuning

<Multi-modal> [LLaVA-1.5] Improved Baselines with Visual Instruction Tuning

Setting Up your Optimization Problem

Setting Up your Optimization Problem