iCreatAI News
Skip to content
  1. Hugging Face Blog60

    llama.cpp v1.0.0 : A stronger foundation for the local AI ecosystem

    llama.cpp released libraries v1.0.0, marking a commitment to stable public APIs for downstream developers, with both llama.cpp and ggml now reflecting API and ABI incompatibilities through major-version bumps. The project states it supports more than 150 architecture variants and all mainstream speculative decoding methods, and distributes pre-release artifacts across Linux, macOS, Windows, Android and iOS plus channels including Docker, Homebrew, conda-forge, MacPorts, Winget and XCFramework. It also describes continued investment in CI infrastructure and self-hosted runners with hardware support from NVIDIA, AMD, Qualcomm, Arm, IBM and Intel.

    Why it matters: Signals a versioning milestone for a widely depended-on local inference library, useful for developers tracking API stability and platform support.

  2. Hugging Face Blog66

    LLMON: An LLM-Native Markup Language, now in Granite 4.1 3B and 8B

    IBM researchers introduce LLMON (LLM Object Notation), an XML-like markup language that uses reserved special-token delimiters to explicitly mark instructions, data, requirements and execution bindings in an LLM's context, addressing the brittleness of JSON-style formats for causal models. They release two experimental preview models derived from Granite 4.1 base checkpoints (granite-4.1-3b-LLMON-preview and granite-4.1-8b-LLMON-preview) plus a GitHub toolkit, reporting that on the OPI benchmark LLMON models avoid 47% more indirect prompt injection attacks than the best frontier model tested while maintaining general capability on par with Granite 4.1 Instruct. The models ship with their own chat template and lossless JSON-to-LLMON converters, and the post notes the previews are for exploration, not production.

    Why it matters: Useful for teams weighing structured context formats against JSON and for anyone evaluating prompt-injection defenses in small open models.

  1. Amazon Science62

    Mitra-v2: Scaling synthetic pretraining for tabular foundation models

    Mitra-v2 is a second-generation tabular foundation model for classification and regression, pretrained entirely on synthetic tables with 10x as many rows and roughly 3x as many columns as Mitra-v1, plus a new hybrid SCM prior and hybrid optimizer. On TabArena it leads the single-model field, beating Mitra-v1 on 32 of 33 datasets where both run natively and completing all 51 datasets within the one-hour budget, and fine-tuned Mitra-v2 ranks first on ScoringBench. The fine-tuned models and inference/fine-tuning code are released under Apache-2.0 on Hugging Face.

    Why it matters: Useful for readers tracking tabular foundation models, as it reports concrete benchmark rankings and an open Apache-2.0 release.

  1. Hugging Face Blog71

    A Closer Look at Phonon TTS. Launching High-Quality On-Device Speech That Tops the Benchmarks.

    Gradium details Phonon, a small on-device text-to-speech model released two weeks ago that needs no server or network, with Phonon 31m (English) under Apache 2.0 and Phonon 40m covering English, French, German, Spanish and Portuguese under a non-commercial license. The models, about 65 MB and 75 MB, offer over 100 built-in voices plus voice cloning and voice design, and on Hugging Face's Open TTS Leaderboard Phonon ranks first in German and Spanish on intelligibility and tops the CPU streaming benchmark on time-to-first audio. The post also covers the ptts inference framework, Transformers integration from v5.21, launch demos, and more than 200,000 downloads in the first two weeks.

    Why it matters: It offers a detailed look at how a small on-device TTS model was built, benchmarked and integrated into developer tooling.

  1. Hugging Face Blog80

    Welcome Le Chonk: Mistral Large 4 on Hugging Face

    Mistral Large 4 ("Le Chonk") is a multimodal, multilingual Mixture-of-Experts model with about 1T total and 49B active parameters and a 1M-token context window, released in FP8 and NVFP4 variants under the Mistral Ecosystem Open-Weight License. It combines a 72-layer text decoder using MLA with a DeepSeek Sparse Attention indexer and a 1.6B Pixtral vision encoder, and the post reports 82% on the Artificial Analysis Cyber Index vulnerability reproduce-and-patch test and 93% on Cybench. Day-0 support covers Transformers, vLLM, llama.cpp, TRL fine-tuning, Inference Endpoints and Dell Enterprise Hub, with GGUFs from Unsloth and the llama.cpp team.

    Why it matters: A detailed, hands-on release guide that pairs architecture specifics and benchmark claims with runnable deployment and fine-tuning recipes for a large open-weight model.

  1. Hugging Face Blog78

    NVIDIA Nemotron 3.5 Transcribe and Granary v2: Intelligent Multilingual Transcription You Can Prompt and Adapt

    NVIDIA released Nemotron 3.5 Transcribe, an open-weight, promptable model that handles transcription in 40 languages, translation of 31 to or from English, speaker attribution in 13 languages, and audio question answering in one checkpoint, running on a single NVIDIA GPU. It ranks first among open-weight models on the Hugging Face Open ASR Leaderboard for English at 5.33% average WER and posts the lowest diarization error rate on David AI's 21-language leaderboard. The release also includes Granary v2, an open data curation pipeline covering 463,062 hours across 48 languages, and NeMo Speech fine-tuning recipes that cut held-out WER by 45.8% relative to the best prompt in a medical case study.

    Why it matters: It documents concrete benchmark standings, an open data pipeline, and a reproducible fine-tuning recipe for teams evaluating or adapting open speech models.

  1. Hugging Face Blog62

    Turning Database Grading into RL Rewards: Post-Training Agents with ThinkingBox

    Microsoft and Hugging Face describe using ThinkingBox's executable terminal-database-state checks as binary rewards to fine-tune Qwen3.8-27B with GRPO for 50 steps on an offline-selected pool of 187 tasks, raising pass@1 from 51.70% to 60.78% and tasks passing all 20 attempts from 38 to 107 on the 507-task ThinkingBox-Bench, while pass@20 dipped slightly from 453 to 446. The post details offline policy-relative difficulty selection via Jeffreys posteriors, the reward loop, cost-per-dependable-task falling from $24.36 to $8.00, and releases the training stack in microsoft/thinkingbox-training.

    Why it matters: It offers a concrete, reproducible recipe for converting stateful agent grading into RL rewards, plus an honest account of the repeatability-versus-coverage tradeoff.

  1. Hugging Face Blog75

    NVIDIA Kumo Relational Outperforms Supervised Machine Learning on Relational Data, No Training Required

    NVIDIA introduces Kumo Relational, a pre-trained relational foundation model that predicts directly on enterprise databases via in-context learning in a single forward pass, requiring no task-specific training, feature engineering, or table flattening. Across 41 tasks on 15 databases, it beats supervised relational deep learning models and expert-engineered gradient-boosted tree pipelines, and on the SAP SALT benchmark it surpasses AutoGluon ensembles by 8% in mean reciprocal rank (MRR). It scales to databases with 500B+ rows and is available through NVIDIA's open-source structured-data-models and kumo-engine libraries or as an NVIDIA NIM.

    Why it matters: Useful for ML teams weighing whether to replace production XGBoost pipelines with a pre-trained relational model, though the reported gains come from NVIDIA's own paper and benchmarks.

  1. NVIDIA Blog73

    NVIDIA Open Models Advance Europe’s Sovereign Intelligence Across Industries

    NVIDIA is expanding its family of open models across language, robotics, biology and quantum computing, including the new Nemotron 3.5 Super VL and Nemotron 3.5 Bolt models, Nemotron Retriever models, the Kumo family for structured business data, Cosmos 3.5 world models, Alpamayo 2 Edge for autonomous vehicles, BioNeMo for healthcare and science, and Ising for quantum computing. The company says the open models give organizations a foundation they can customize with local data and deploy on infrastructure they control, with Nemotron built using data and expertise from the NVIDIA Nemotron Coalition including European partners Black Forest Labs, H-Company and Mistral. Availability details include Nemotron 3.5 Super VL on Hugging Face, ModelScope, OpenRouter and build.nvidia.com, with Nemotron 3.5 Bolt E4B 4GB expected Friday, Oct. 23.

    Why it matters: The piece is a broad product roundup that shows how NVIDIA is positioning open models as a sovereignty-friendly foundation for European enterprises and researchers.

  1. Hugging Face Blog65

    Hugging Face ❤️ TorchTPU: TPUs, Natively

    TorchTPU adds TPU as a native PyTorch backend, letting Transformers, Diffusers and Kernels run on TPU by sending models to "tpu" instead of going through torch_xla or JAX, and Optimum TPU is no longer required. The post shows loading a model with device_map="tpu", running Diffusers pipelines with pipe.to("tpu") plus optional torch.compile, and using Pallas kernels from the Kernels Hub, with reported speedups of 21.5× on Qwen3-30B-A3B and 12.8× on Gemma 4 26B-A4B at batch size 64. It also reports that 96.5% of tests run on TPU pass, with 34 issues filed on the TorchTPU repo and 19 already fixed.

    Why it matters: It documents a new native PyTorch TPU backend and concrete usage patterns for the Hugging Face stack, useful for readers weighing TPU support.

You have reached the end