我们上线了一个LLM的wiki站,介绍了LLM的各种概念和生产环境上部署使用的各种优化方法。学不完,学不完啊
https://bentoml.com/llm/
https://bentoml.com/llm/
Bentoml
LLM Inference Handbook
A practical handbook for engineers building, optimizing, scaling and operating LLM inference systems in production.
👍18❤6
#share
- https://x.com/evilcos/status/1949678504737673472
- https://github.com/astraea-dot-sh/0x50d4.github.io/blob/main/_posts/2024-04-03-python-malware.md
- https://x.com/evilcos/status/1949678504737673472
- https://github.com/astraea-dot-sh/0x50d4.github.io/blob/main/_posts/2024-04-03-python-malware.md
X (formerly Twitter)
Cos(余弦)😶🌫️ (@evilcos) on X
大家注意下这个投毒风险,某黑客组织在 V2EX 伪装招聘发帖,福利比较诱惑,面试者会被诱导基于这个黑客组织提前准备好的带毒仓库作为项目模板开发一个页面,面试者如果下载并调试执行,电脑就会中毒并可能导致加密货币及一些账号权限被盗等损失。
细节直接见帖子及评论区:https://t.co/lSZgMCTZTB
细节直接见帖子及评论区:https://t.co/lSZgMCTZTB
#share 头回见对这两个概念的清楚解释
https://discuss.python.org/t/should-it-be-possible-to-use-none-as-a-type-instead-of-nonetype/101862/2
https://discuss.python.org/t/should-it-be-possible-to-use-none-as-a-type-instead-of-nonetype/101862/2
Discussions on Python.org
Should it be possible to use None as a type (instead of NoneType)?
The type of None is NoneType [not a built-in, it’s type(None)], but in typing we use None as a type: my_var: None|int = 3 Besides of typing, Pyhon does not accept None as a type. Technically None is indeed not a type. OTOH None is quite special. I think…
❤5
#share https://lucumr.pocoo.org/2025/8/18/code-mcps/
Armin 认为与其在MCP中暴露许多不同的tool(API),不如暴露单个编程语言的界面,让MCP成为执行代码的工具,反正LLM也很擅长生成代码。
我有些疑惑,如果是这样,MCP不就仅仅是一个预装SDK的编程环境,那还要MCP做什么?让LLM自己决定添加任意SDK就好了
Armin 认为与其在MCP中暴露许多不同的tool(API),不如暴露单个编程语言的界面,让MCP成为执行代码的工具,反正LLM也很擅长生成代码。
我有些疑惑,如果是这样,MCP不就仅仅是一个预装SDK的编程环境,那还要MCP做什么?让LLM自己决定添加任意SDK就好了
Armin Ronacher's Thoughts and Writings
Your MCP Doesn’t Need 30 Tools: It Needs Code
Exploration into providing MCPs with the most powerful of all tools: code.
Forwarded from bupt.moe
#security
NPM
更新:
多个npm包的作者 Qix- 被钓鱼,npm账号失陷。黑客上传了多个有恶意代码的npm包。具体包列表可以在以下链接查看:https://github.com/debug-js/debug/issues/1005#issuecomment-3266868187
编者注:考虑到黑客动手的速度之快,可以认为是一次定向的钓鱼攻击。热门包的维护者应该考虑从TOTP转到FIDO2。
NPM
debug 包出现大新闻,任何安装/运行了这个包的电脑均应视为已失陷。更新:
多个npm包的作者 Qix- 被钓鱼,npm账号失陷。黑客上传了多个有恶意代码的npm包。具体包列表可以在以下链接查看:https://github.com/debug-js/debug/issues/1005#issuecomment-3266868187
编者注:考虑到黑客动手的速度之快,可以认为是一次定向的钓鱼攻击。热门包的维护者应该考虑从TOTP转到FIDO2。
Golang 害人不浅😂🤣
https://github.com/bentoml/BentoML/pull/5475/files
https://github.com/bentoml/BentoML/pull/5475/files
GitHub
feat: add bentoml deployment start command by jianshen92 · Pull Request #5475 · bentoml/BentoML
What does this PR address?
bentoml deployment start <deployment_name> to mirror the Start button in BentoCloud.
Syntatic sugar for bentoml deployment update <deployment_name&am...
bentoml deployment start <deployment_name> to mirror the Start button in BentoCloud.
Syntatic sugar for bentoml deployment update <deployment_name&am...
😁6