below/HelloSilicon
An introduction to ARM64 assembly on Apple Silicon Macs
Language:Assembly
Total stars: 3338
Stars trend:
#assembly
#aarch64, #apple, #applesilicon, #arm, #arm64, #assembler, #assembly, #clangassembler, #darwin, #ios, #m1, #macho, #macos
An introduction to ARM64 assembly on Apple Silicon Macs
Language:Assembly
Total stars: 3338
Stars trend:
21 May 2024
12am █▏ +9
1am █▌ +12
2am ▉ +7
3am █▍ +11
4am ▌ +4
5am ▊ +6
6am ▋ +5
7am ▉ +7
8am ▎ +2
9am ▋ +5
10am ▌ +4
11am ▌ +4#assembly
#aarch64, #apple, #applesilicon, #arm, #arm64, #assembler, #assembly, #clangassembler, #darwin, #ios, #m1, #macho, #macos
dipampaul17/KVSplit
Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.
Language:Python
Total stars: 144
Stars trend:
#python
#applesilicon, #generativeai, #kvcache, #llamacpp, #llm, #m1, #m2, #m3, #memoryoptimization, #metal, #optimization, #quantization
Run larger LLMs with longer contexts on Apple Silicon by using differentiated precision for KV cache quantization. KVSplit enables 8-bit keys & 4-bit values, reducing memory by 59% with <1% quality loss. Includes benchmarking, visualization, and one-command setup. Optimized for M1/M2/M3 Macs with Metal support.
Language:Python
Total stars: 144
Stars trend:
16 May 2025
7pm ▏ +1
8pm █████▌ +44
9pm ████▊ +38
10pm ███▋ +29
11pm ██▎ +18#python
#applesilicon, #generativeai, #kvcache, #llamacpp, #llm, #m1, #m2, #m3, #memoryoptimization, #metal, #optimization, #quantization