Loading...
自我改进系统(SIS)
受控系统,提出对提示词、工具或策略的更改,并仅在经过独立评估和批准后才予以保留
In 30 seconds
- What
- 智能体提出对提示词或策略的修改,在隔离环境中用测试套件加以验证,只有在获得人工批准后才部署。
- When to use
- 故障代价高昂的生产系统,你需要在不破坏现有功能的前提下安全地演进行为。
- Watch out
- 评测套件会变得陈旧或不完整,导致有问题的改动通过验证,照样进入生产环境。
Loading technique guide…
受控系统,提出对提示词、工具或策略的更改,并仅在经过独立评估和批准后才予以保留
Loading technique guide…
模式: 能够随时间自动分析、修改并改进自身能力与性能的系统
原因: 支持持续优化,减少人工维护,并自动适应需求变化
关键洞察: 结合监控、分析与安全部署机制,实现自主的能力增强
通过这些精选资源加深理解
Self-Instruct: Aligning Language Model with Self Generated Instructions (Wang et al., 2022)
Constitutional AI: Harmlessness from AI Feedback (Bai et al., 2022)
Self-Taught Optimizer (STO): Recursively Self-Improving Code Generation (Zelikman et al., 2023)
Large Language Models Can Self-Improve (Huang et al., 2022)
AI Alignment: A Comprehensive Survey (Ji et al., 2023)
Measuring Progress on Scalable Oversight for Large Language Models (Bowman et al., 2022)
Red Teaming Language Models to Reduce Harms (Ganguli et al., 2022)
Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedback (Bai et al., 2022)
Genetic Programming: On the Programming of Computers by Means of Natural Selection (Koza, 1992)
NEAT: Evolving Neural Networks through Augmenting Topologies (Stanley & Miikkulainen, 2002)
Age-Fitness Pareto Optimization (Schmidt & Lipson, 2010)
Automated Algorithm Design via Evolutionary Computation (Pappa et al., 2014)