快讯
开发者谈 session warming：默认关闭，因会让推理服务商误判客户端活跃度
作者称团队此前加入了 session warming 功能，但目前默认禁用。作者表示，该功能本质上是向推理服务商“撒谎”，让客户端显得比实际更活跃，并消除了服务商可用于优化自身资源的信号，因此好奇推理服务商对此会作何反应。
查看原文
we added session warming a while ago but it's disabled by default i was curious how inference providers would feel about this it is effectively lying to them that your client is more active than it is and removes a signal they can use optimize their resources