#python #cli #consumer_gpu #dpo #fine_tuning #gguf #huggingface #llm #llmops #local_ai #local_llm #lora #low_vram #machine_learning #ollama #peft #python #pytorch #qlora #sft #transformers

Soup is a tool that helps you fine-tune and post-train large language models with one command, using one config file and little setup. It can work on a local GPU, even a 4 GB laptop GPU for an 8B model with layer streaming, so you can train without SSH or cloud hassle. This saves time, reduces setup pain, and makes model training easier to start and manage.

https://github.com/MakazhanAlpamys/Soup

#python #agent #agent_security #ai_infra #ai_red_teaming #ai_security #llm #llm_evaluation #llm_jailbreak #llm_security #mcp_scan #openclaw_security #prompt_injection #prompt_security #scanner #security #security_tools #skill_scanner #skills_security #vulnerability

A.I.G (AI-Infra-Guard) is a Tencent Zhuque Lab tool for AI red teaming and security checks. It scans AI infrastructure, MCP servers, agent skills, and jailbreak risks, and it can run with Docker, a web UI, or an API. This helps you find weak points early, understand real security risks, and fix problems before they affect your AI systems.

https://github.com/Tencent/AI-Infra-Guard