Qwen just dropped: Qwen3-VL-30B-A3B-Thinking

A powerhouse multimodal model built on a Mixture-of-Experts stack—designed for deep text + vision + video reasoning, long-context understanding (256K→1M), robust OCR (32 languages), GUI/tool use, and even converting diagrams/screens into working code.

We’ve published a fresh, hands-on guide:
“How to Install & Run Qwen3-VL-30B-A3B-Thinking Locally” — tuned for a GPU VM workflow (We used NodeShift, but it works anywhere).

What’s inside the guide
✅ Clean environment setup (CUDA-aligned PyTorch, optional FlashAttention-2)
✅ Image & video inference
✅ “Thinking” variant notes + practical VRAM plans (single-/multi-GPU)
✅ Troubleshooting (FA2 mismatches, SDPA fallback)
✅ Ready-to-copy commands & code blocks for Jupyter/terminal

Check out the full guide here: https://nodeshift.cloud/blog/how-to-install-run-qwen3-vl-30b-a3b-thinking-locally

AI21 Labs just launched Jamba Reasoning 3B — a compact, hybrid Transformer–Mamba model built for serious reasoning on modest hardware.

Why it’s special
✅ ~3B params (26 Mamba + 2 Attention) → fast, memory-light, edge-friendly
✅ 256K context without the usual KV-cache blow-up
✅ Strong benchmarks: IFBench 52.0, Humanity’s Last Exam 6.0, MMLU-Pro 61.0
✅ On-device speed that holds up as context grows (≈43–44 tok/s at 16–32K)

We just published a new step-by-step guide:
“How to Install & Run AI21-Jamba-Reasoning-3B Locally (GPU VM)”

What’s inside
✅ Pick the right GPU & VRAM (rule-of-thumb table)
✅ Clean setup on a CUDA 12.1.1 image (Python 3.11, Torch cu121)
✅ vLLM serving (OpenAI-compatible) with the right flags for Mamba SSM
✅ Transformers alternative path + FlashAttention 2 tips
✅ A one-file Streamlit UI to chat with the model on your own server

Check out the full guide here: https://nodeshift.cloud/blog/how-to-install-run-ai21-jamba-reasoning-3b-locally

VNGRS Releases Kumru-2B — A Turkish-Native Lightweight Language Model

VNGRS has officially released Kumru-2B, a compact yet powerful Turkish-native LLM built entirely from scratch. Trained on ~500 GB of curated text (≈300B tokens) and fine-tuned on over 1M supervised examples, Kumru-2B is designed specifically for the Turkish language — featuring a modern 50K-token Turkish-optimized tokenizer, 8K context window, and native support for math and code.

Why Kumru-2B is Special
✅ Built from scratch for Turkish — not a multilingual adaptation.
✅ Efficient tokenizer: uses ~40% fewer tokens than multilingual models like GPT-4o or Gemma.
✅ Punches above its weight — outperforms much larger models like Llama-3.3-70B and Qwen2-72B on Turkish-centric tasks.
✅ Runs smoothly on local or cloud GPUs, making it ideal for research, startups, and developers.

In our latest blog, we walk you through everything you need to:
✅ Deploy a GPU-powered VM on NodeShift Cloud
✅ Install Python 3.11 + CUDA 12.1.1 environment
✅ Run the model with a simple Python script
✅ Launch an interactive Streamlit WebUI to chat with Kumru-2B directly in your browser

Whether you’re building NLP tools, studying Turkish linguistics, or experimenting with LLMs, this guide helps you get started in minutes.

Read the full tutorial here: https://nodeshift.cloud/blog/how-to-install-run-vngrs-ai-kumru-2b-locally

OCR needs has evolved beyond just extracting text, enterprises now need the OCR that can understand the documents and turns them into structured, AI-ready markdown.
That’s why Nanonets-OCR2 by Nanonets is a game-changer for anyone working with scanned docs, academic papers, business reports, invoices, or forms etc.

What can it do?
✅ Converts mathematical equations to LaTeX
✅ Describes images using structured <img> tags
✅ Detects signatures & watermarks
✅ Handles checkboxes, radio buttons, and complex tables
✅ Extracts flowcharts & org charts as Mermaid code
✅ Supports handwritten documents and multiple languages
✅ Provides Visual Question Answering (VQA) directly from the document

We’ve just published a complete guide to install and run Nanonets-OCR2 locally or in GPU accelerated environment with NodeShift Cloud for continuous delivery, so you can start automating document workflows with full control and scalability.
🔗 Read the guide here: https://nodeshift.cloud/blog/convert-documents-to-structured-markdown-html-with-nanonets-ocr2?utm_source=telegram&utm_medium=social&utm_campaign=nanonets_ocr2_guide

The wait is over, now you could run Korea’s first fully open source 10B-parameter AI model - right on your machine!

Meet KORMo-10B-sft, a 10B-parameter bilingual Korean-English LLM built entirely from scratch and released 100% open-source - weights, code, and even training data.
Developed by KAIST's MLP Lab, KORMo sets a new benchmark for transparency, reproducibility, and real-world performance - bridging the gap between open research and applied AI specially in non-english domains.

In our latest article, we break down how to install and run KORMo-10B-sft locally, explore its most powerful features, and show how NodeShift Cloud makes deploying massive open models effortless, from Colab to production GPUs.
🔗 Read here: https://nodeshift.cloud/blog/how-to-install-and-run-kormo-the-first-fully-open-source-korean-english-llm?utm_source=telegram&utm_medium=social&utm_campaign=kormo_10b_launch

Liquid AI just dropped something special — the LFM2-8B-A1B model is here!

This new on-device-friendly Mixture-of-Experts (MoE) model packs 8.3B total parameters (only 1.5B active!) and blends 18 convolutional LIV layers + 6 GQA attention layers for hybrid speed and quality. It supports 32K context length, runs smoothly even on modest GPUs, and rivals much larger 3–4B dense models in performance — perfect for agentic tasks, RAG, data extraction, and multi-turn reasoning.

We’ve just published a step-by-step installation and setup guide for LFM2-8B-A1B, where we walk through everything — from spinning up a GPU VM on NodeShift Cloud to running the model locally using Transformers.

Here’s what we covered in the guide:
✅ Model benchmarks, specs, and comparison tables
✅ Full environment setup (CUDA, Python, PyTorch)
✅ Hugging Face authentication and correct Transformers commit
✅ Script to run the model locally
✅ GPU configuration cheatsheet for every use case

Check out the complete guide here: https://nodeshift.cloud/blog/how-to-install-run-lfm2-8b-a1b-locally

Kwaipilot just dropped KAT-Dev-72B-Exp — their most ambitious open-source coder yet. It’s a 72B-parameter, RL-tuned LLM built for software engineering, debugging, and automated code reasoning—the experimental sibling of the proprietary KAT-Coder.

Benchmark highlight: On SWE-Bench Verified, KAT-Dev-72B-Exp hits 74.6% when evaluated strictly with the SWE-agent scaffold.

What’s inside the guide
✅ Fast setup on a GPU VM (NodeShift-style, works anywhere)
✅ Transformers BF16 quickstart + multi-GPU tips
✅ 4-bit (bitsandbytes) single-GPU recipe for tight VRAM
✅ A polished Streamlit web UI to chat in the browser
✅ vLLM/TGI notes for production-grade serving & throughput
✅ VRAM & storage planning for 72B (quantized vs full-precision)
✅ SWE-agent eval knobs (temp=0.6, max_turns=150, history=100)
✅ “Hard-mode” prompts to stress test reasoning & code repair

If you care about long-context debugging, multi-turn repair, and RL-hardened coding agents, this one’s for you.

Check out the complete guide here: https://nodeshift.cloud/blog/how-to-install-run-kat-dev-72b-exp-locally

Following the global launch of the Qwen3-VL series, which redefined multimodal AI with its vision-language fusion and massive context capabilities, the new Qwen3-VL-4B and 8B-Thinking editions take a sharper turn toward intelligence per parameter.
These smaller, more efficient models have the same deep multimodal understanding as their larger counterparts - but now enhanced with a “Thinking” mode that lets them reason, plan, and act with remarkable depth.

From generating code from screenshots to understanding complex STEM visuals and long videos, they deliver cognitive precision in a lightweight footprint you can actually run locally.

We’ve just published a step-by-step guide on how to install and run Qwen3-VL-Thinking locally, fully optimized with NodeShift Cloud.
- Small models, big reasoning power
- Thinking-enhanced multimodal intelligence
- Instant GPU environments, no setup needed

🔗 Read here: https://nodeshift.cloud/blog/how-to-install-and-run-qwen3-vl-4b-8b-thinking-locally?utm_source=telegram&utm_medium=social&utm_campaign=qwen3_vl_thinking_launch

AI at Meta just released MobileLLM-Pro — their new 1.08B-parameter on-device language model!

MobileLLM-Pro is built for speed, efficiency, and privacy, bringing large-model intelligence directly to phones, edge accelerators, and low-VRAM GPUs. It features:
🔹 128k context window for long-form understanding
🔹 Local-global attention (3:1) for faster prefill & smaller KV cache
🔹 Near-lossless int4 quantization
🔹 Base & instruction-tuned variants
🔹 Competitive accuracy vs Gemma 3 1B and Llama 3.2 1B

We’ve just published a complete step-by-step guide on how to install, configure, and run MobileLLM-Pro locally.

In this guide, you’ll learn how to:
🔹 Set up a CUDA-based GPU VM on NodeShift
🔹 Install Python 3.11, PyTorch CUDA, and key dependencies
🔹 Authenticate with Hugging Face for the gated model
🔹 Run the base inference script directly in terminal
🔹 Build a browser chat interface

Check out the full tutorial here: https://nodeshift.cloud/blog/how-to-install-run-facebook-mobilellm-pro-locally

Meet LangCode, the next-gen multi-LLM coding agent that brings Gemini, Claude, OpenAI, and Ollama together, right inside your local terminal.

LangChain-code or LangCode in short, serves as an AI-powered development environment with:
- Deep and ReAct modes for fast or complex reasoning
- Safe, reviewable code diffs before every change
- Smart routing to pick the best LLM for each task
- MCP-based tool integrations and customizable project rules

And with NodeShift Cloud, you can install and run LangCode locally, effortlessly, securely, and with zero setup friction.
In our latest guide, you’ll learn:
🔹 How to install and configure LangCode locally
🔹 How to launch its interactive coding interface
🔹 How to enable Local LLM setup with Ollama
🔹 How to start building faster, safer, and smarter with AI

🔗 Read the full guide here: https://nodeshift.cloud/blog/build-faster-safer-with-langcode-your-ultimate-multi-llm-local-ai-copilot?utm_source=telegram&utm_medium=social&utm_campaign=langcode_guide

DeepSeek AI releases DeepSeek-OCR — a next-gen Vision-Language OCR model!

DeepSeek-OCR is a cutting-edge vision-language model built on DeepSeek-VL-v2, designed for intelligent optical character recognition and document understanding.

It excels at turning complex images, scanned documents, and charts into clean, structured Markdown or text with incredible accuracy.

Specialties:
✅ Context-aware multilingual OCR
✅ FlashAttention 2 acceleration for high-speed GPU inference
✅ Visual-text compression & layout reasoning
✅ Converts entire documents, PDFs, and images into readable Markdown

What we covered in our latest tutorial:
✅ Full step-by-step setup on a GPU VM (NodeShift Cloud)
✅ Installing CUDA, Python 3.12, PyTorch 2.6.0 (CUDA 11.8)
✅ Configuring FlashAttention 2
✅ Running DeepSeek-OCR for image-to-markdown conversion

Read the complete setup & usage guide here: https://nodeshift.cloud/blog/how-to-install-run-deepseek-ocr-locally

How far can AI go in understanding the language of biology?
Meet the model that has already helped uncover a novel cancer therapy pathway, validated in living cells, proving that large language models can drive real biological discovery.

C2S-Scale-Gemma-27B - an innovative Gemma model developed by the collaboration of Yale University, Google Research, and Google DeepMind that can translate complex single-cell gene expression data into “cell sentences” that AI can understand.

Our latest guide walks you through how to install and deploy C2S-Scale-Gemma-27B on NodeShift Cloud, letting you explore AI-powered cell analysis, drug response prediction, and biomarker discovery, all from your own GPU setup.
🔗 Read the full guide: https://nodeshift.cloud/blog/how-to-install-run-c2s-scale-gemma-2-27b-for-single-cell-biological-discovery?utm_source=telegram&utm_medium=social&utm_campaign=c2s_gemma2_blog

Arch-Router-1.5B is Katanemo’s compact, preference-aligned routing model that reads a conversation + your user-defined “routes” (domain/action pairs) and returns the single best route as clean JSON (e.g., {"route":"bug_fixing"}).

What’s special about it?
✅ Transparent & controllable routing for multi-model stacks
✅ Tiny footprint, low latency, production-oriented
✅ Swap target models without retraining the router

We just published a step-by-step guide to get Arch-Router-1.5B running on a GPU VM and a browser-based Streamlit WebUI so you can play with routes live.

What this guide covers:
✅ GPU configuration cheatsheet (FP16, int8/int4, vLLM)
✅ End-to-end setup on a GPU VM (Ubuntu + CUDA + PyTorch)
✅ Quickstart Python script (clean JSON outputs)
✅ Streamlit WebUI to edit route sets & test conversations
✅ Optional FastAPI microservice pattern for production
✅ Tips on batching, quantization, and stability (attention masks, temp)
✅ Troubleshooting + next steps for gateways/agents

If you’re building agents, gateways, or API proxies and want rock-solid preference routing, this will save you hours.

Read the full guide: https://nodeshift.cloud/blog/how-to-install-run-katanemo-arch-router-1-5b-locally

Tired of open models lagging behind proprietary ones?

Bee-8B-RL by Open-Bee changes the game. An 8B-parameter Multimodal LLM trained on the meticulously curated Honey-Data-15M corpus, built using their transparent HoneyPipe data curation framework.
Unlike noisy open datasets, Honey-Data-15M blends short and long Chain-of-Thought (CoT) reasoning over 15M clean, enriched samples that power Bee-8B-RL to deliver SOTA reasoning, visual understanding, and factual accuracy rivaling closed models like InternVL3.5-8B.

Now, you can run it locally, fast, efficient, and fully open.
In our latest guide, we show you how to install and run Bee-8B-RL on your own machine with NodeShift Cloud, unlocking a smooth, high-performance environment for experimentation, deployment, and innovation.

🔗 Read the full guide: https://nodeshift.cloud/blog/how-to-install-and-run-bee-8b-rl-locally?utm_source=telegram&utm_medium=social&utm_campaign=bee8b_rl_launch

Ai2 releases olmOCR-2-7B-1025-FP8 — an OCR-specialized Vision-Language Model built for real-world document intelligence!

olmOCR-2-7B-1025-FP8 is AllenAI’s powerful OCR VLM distilled from Qwen2.5-VL-7B-Instruct, fine-tuned on the olmOCR-mix-1025 dataset, and further optimized with GRPO reinforcement learning to handle math formulas, tables, long/tiny text, and noisy scans. With FP8 quantization (via llmcompressor), it achieves outstanding accuracy while drastically cutting memory usage — reaching ~82.4 ± 1.1 overall on olmOCR-Bench when paired with the official olmOCR toolkit (v0.4.0).

We’ve just published a brand-new step-by-step guide that shows you exactly how to install and run olmOCR-2-7B-1025-FP8 locally on a GPU-powered Virtual Machine using NodeShift Cloud.

In this guide, we cover:
✅ Complete environment setup using NodeShift GPU VMs
✅ Installing dependencies
✅ Setting up and running the olmOCR pipeline
✅ Generating high-accuracy Markdown outputs from scanned PDFs
✅ Optimized GPU configurations for FP8 quantized inference

Whether you’re building large-scale document pipelines or experimenting with multimodal OCR models — this guide helps you deploy olmOCR seamlessly, from setup to high-throughput inference.

Read the full guide here: https://nodeshift.cloud/blog/how-to-install-run-olmocr-2-7b-1025-fp8-locally

LLaDA2.0-Mini-Preview is a diffusion-style Mixture-of-Experts (MoE) model with 16B total parameters (~1.4B active) — built for strong reasoning and coding performance while keeping inference light. Only a small subset of experts fire per token, giving it near-7B quality with just ~1–2B-class compute. It supports tool use, 4K context, and runs seamlessly with transformers using trust_remote_code=True.

We just published a new step-by-step guide on how to deploy and run LLaDA2.0-Mini-Preview on NodeShift Cloud — from VM setup to browser-based interaction.

What this guide covers:
✅ Creating a GPU Node on NodeShift Cloud
✅ Installing CUDA, PyTorch, and essential dependencies
✅ Running the model locally with a Python script
✅ Launching an interactive Streamlit WebUI for chatting with the model
✅ Detailed GPU configuration table for every VRAM tier

Whether you’re a developer, researcher, or enthusiast, this guide helps you get LLaDA2-Mini running smoothly — delivering powerful reasoning and coding performance at an affordable cost.

Read the full guide: https://nodeshift.cloud/blog/how-to-install-run-llada2-0-mini-preview-locally

Liquid AI has officially released its new LFM2-VL series, a next-generation family of multimodal (image + text) models that blend visual perception with deep language understanding. The lineup comes in three variants:

✔️ LFM2-VL-450M — lightweight and edge-optimized
✔️ LFM2-VL-1.6B — balanced for accuracy and efficiency
✔️ LFM2-VL-3B — advanced precision reasoning model

Each model combines Liquid AI’s SigLIP2 NaFlex vision encoder with powerful language backbones, supporting 512×512 image inputs, dynamic token scaling, and efficient bfloat16 inference. Whether you’re working on document OCR, visual QA, or detailed image captioning — this series delivers performance that scales with your hardware and needs.

We’ve just published a complete step-by-step guide to help you install and run all three models locally or on the NodeShift Cloud.

Here’s what we cover in this guide:
✅ Model introductions, benchmark comparisons, and GPU configuration table
✅ End-to-end setup on NodeShift GPU VM (with CUDA + Python 3.11)
✅ Running LFM2-VL-450M via terminal and Gradio UI
✅ Scaling up to LFM2-VL-1.6B and LFM2-VL-3B for advanced multimodal reasoning
✅ Includes code snippets, installation commands, and sample outputs

Read the full guide here: https://nodeshift.cloud/blog/how-to-install-run-liquidai-lfm2-vl-locally

Imagine creating minutes-long, high-quality 720p videos, all from text or a single image, right on your own machine.
That’s exactly what LongCat-Video (13.6B parameters) makes possible.

What it offers:
- Unified model for Text-to-Video, Image-to-Video, & Video-Continuation
- Generates smooth, coherent long videos with no color drift or frame drops
- Efficient inference powered by Block Sparse Attention
- Trained with multi-reward RLHF for cinematic realism

With NodeShift Cloud, you can now install, run, and scale LongCat-Video locally or on the cloud in just a few steps, unlocking studio-grade AI video generation for everyone.
🔗 Dive into the full guide here: https://nodeshift.cloud/blog/how-to-install-and-run-longcat-video-locally-generate-stunning-long-videos-with-ai?utm_source=telegram&utm_medium=social&utm_campaign=longcat_video_launch

Tired of slow, laggy OCR pipelines? LightOnOCR-1B emerges as a fast and lightweight open source OCR model that outpaces many well known OCRs on benchmarks.
With a Pixtral-based Vision Transformer and Qwen3 text decoder, it delivers end-to-end differentiable OCR, no external steps needed.
- 5× faster than dots.ocr
- Processes 493k pages/day for <$0.01 per 1,000 pages
- Handles math, tables, receipts, forms, and multi-column layouts effortlessly
- State-of-the-art accuracy (76.1 overall on Olmo-Bench)

You can now install and run it locally, right on your machine, with the help of the latest step-by-step guide powered by NodeShift Cloud.
🔗 Read the full guide here: https://nodeshift.cloud/blog/how-to-install-and-run-lightonocr-1b-locally-the-fastest-open-ocr-model-for-document-understanding?utm_source=telegram&utm_medium=social&utm_campaign=lightonocr1b_launch

Datalab just released their next-generation OCR model — Chandra!

Chandra is a powerful vision-language OCR model built for precise document understanding. It doesn’t just extract text — it reconstructs full document layouts into clean Markdown, HTML, or JSON formats, handling tables, forms, diagrams, handwriting, math equations, and multi-column pages with ease.

Supporting over 40 languages, Chandra achieves an impressive 83.1% overall accuracy on the olmOCR benchmark, outperforming many open and commercial OCR systems.

We’ve just published a comprehensive guide that walks you through everything — from setting up Chandra on a GPU-powered NodeShift Cloud VM, installing dependencies, and running the model with Transformers and vLLM, to launching a full Streamlit web app for interactive document analysis in the browser.

Whether you’re a researcher, developer, or just passionate about document AI, this guide will help you get Chandra running end-to-end — from terminal to web UI.

Check out the full guide here: https://nodeshift.cloud/blog/how-to-install-run-chandra-ocr-locally

Baidu's PaddleOCR-VL is the new SOTA vision-language model redefining document understanding and trending as one of the top OCR models along with big models like DeepSeek OCR.
This is a compact yet insanely capable OCR-VLM that blends:
- NaViT-style dynamic visual encoding
- ERNIE-4.5-0.3B language model
- Support for 109 languages
- Lightning-fast, resource-efficient inference

It doesn’t just read documents, it understands and explains them. From complex tables and formulas to multi-lingual text and charts, PaddleOCR-VL achieves state-of-the-art accuracy while staying lightweight enough for real-world deployment.
At NodeShift, we made it even easier to install, run, and benchmark PaddleOCR-VL locally, so you can experience its power without the complex setup friction.
🔗 Read here: https://nodeshift.cloud/blog/how-to-install-and-run-paddleocr-vl-locally?utm_source=telegram&utm_medium=social&utm_campaign=paddleocr-vl-launch