知识增量Knowledge Deltav0.1无限进步

卡片库

398 个词,按八类排成目录。

理解模型Models

AI 是什么

17
人工智能Artificial Intelligence机器学习Machine Learning深度学习Deep Learning生成式人工智能Generative Artificial Intelligence通用人工智能Artificial General Intelligence大语言模型Large Language Model小语言模型Small Language Model基础模型Foundation Model模型Model参数Parameter权重Weight超参数Hyperparameter自然语言处理Natural Language Processing分类任务Classification回归预测Regression窄域人工智能Artificial Narrow Intelligence超人工智能Artificial Superintelligence

模型的结构

19
神经网络Neural Network层Layer激活函数Activation FunctionTransformer 架构Transformer注意力机制Attention自注意力Self-Attention多头注意力Multi-Head Attention编码器Encoder解码器Decoder自回归生成Autoregressive Generation嵌入向量Embedding上下文窗口Context Window词元Token分词器Tokenizer位置编码Positional Encoding混合专家模型Mixture of Experts扩散模型Diffusion Model生成对抗网络Generative Adversarial Network变分自编码器Variational Autoencoder

怎样生成答案

19
推理运行Inference解码策略Decoding Strategy贪心解码Greedy Decoding束搜索Beam Search随机采样Sampling温度Temperature核采样Nucleus Sampling前 k 项采样Top-k Sampling词元分数LogitsSoftmax 函数Softmax随机种子Random Seed推理型模型Reasoning Model测试时计算Test-Time Compute幻觉Hallucination键值缓存Key-Value Cache输入预填充Prefill逐步生成阶段Decode PhaseFlashAttentionFlashAttention长上下文能力Long-Context Capability

训练与微调

23
训练Training预训练Pretraining自监督学习Self-Supervised Learning监督学习Supervised Learning无监督学习Unsupervised Learning微调Fine-Tuning监督微调Supervised Fine-Tuning指令微调Instruction Tuning强化学习Reinforcement Learning人类反馈强化学习Reinforcement Learning from Human FeedbackAI 反馈强化学习Reinforcement Learning from AI Feedback奖励模型Reward Model近端策略优化Proximal Policy Optimization直接偏好优化Direct Preference Optimization参数高效微调Parameter-Efficient Fine-Tuning低秩适配Low-Rank Adaptation量化低秩适配Quantized Low-Rank Adaptation知识蒸馏Knowledge Distillation量化Quantization剪枝Pruning检查点Checkpoint持续预训练Continued Pretraining上下文学习In-Context Learning

训练里的数学

14
训练集Training Set验证集Validation Set测试集Test Set训练轮次Epoch批大小Batch Size训练步Training Step损失函数Loss Function交叉熵Cross-Entropy梯度下降Gradient Descent反向传播Backpropagation学习率Learning Rate优化器OptimizerAdam 优化器Adaptive Moment Estimation正则化Regularization

怎样评价模型

13
准确率Accuracy精确率Precision召回率RecallF1 分数F1 Score混淆矩阵Confusion Matrix概率校准Probability Calibration模型评估Evaluation基准测试Benchmark评测数据污染Benchmark Data Contamination数据泄漏Data Leakage过拟合Overfitting泛化Generalization困惑度Perplexity (metric)

图像、声音和视频

8
多模态Multimodal视觉语言模型Vision-Language Model光学字符识别Optical Character Recognition自动语音识别Automatic Speech Recognition文本转语音Text-to-Speech声音克隆Voice Cloning文本生成图像Text-to-Image Generation文本生成视频Text-to-Video Generation

学会提问Prompting

委派任务Agents

选好工具Tools

补齐基础Coding

文件与格式

8
MarkdownMarkdownJSONJavaScript Object NotationYAMLYAML Ain't Markup LanguageXMLExtensible Markup LanguageCSVComma-Separated ValuesUnicodeUnicodeUTF-8Unicode Transformation Format, 8-bit正则表达式Regular Expression

语言与运行

13
SQLStructured Query LanguagePythonPython计算笔记本Computational Notebook命令行界面Command-Line Interface终端TerminalShellShell文件路径File Path当前工作目录Current Working Directory环境变量Environment Variable软件包与模块Package and Module软件依赖Software Dependency虚拟环境Virtual Environment脚本Script

Git 与协作

23
GitGit仓库RepositoryGitHubGitHub提交Commit分支Branch合并Merge差异比较Diff合并请求Pull Request补丁Patch统一差异格式Unified diff差异块Hunk工作树Working tree暂存区Staging area / Index克隆Clone获取远程更新Fetch拉取并整合Pull推送Push派生仓库Fork远程仓库配置Remote问题与任务记录Issue项目说明文件README许可证License发布版本Release

网络与网页

17
图形用户界面Graphical user interface集成开发环境Integrated development environment前端Frontend后端Backend超文本标记语言HyperText Markup Language层叠样式表Cascading Style SheetsJavaScript语言JavaScript统一资源定位符Uniform Resource LocatorHTTP与HTTPSHTTP / HTTPS端口Port本机回环名称Localhost域名系统Domain Name System域名Domain name服务器Server客户端Client安全远程连接协议Secure Shell容器Container

硬件

6
中央处理器Central Processing Unit图形处理器Graphics Processing Unit显存Video Random-Access Memory系统内存Random-Access Memory统一内存Unified Memory固态存储Solid-State Drive

处理数据Data

读写文献Literature

科研规范Integrity