iCreatAI News
Back to main site
Skip to content
#Open source ecosystem
Oct 29Thu
  1. PyTorch Blog47

    PyTorch 2.15 Release Blog

    PyTorch 2.15 makes the rewritten NCCL backend the default for all nccl process groups, with a flight recorder that dumps diagnostics on hangs and TORCH_DIST_USE_NCCL2=0 or nccl-legacy as rollback paths. It adds one-sided transports for torch.distributed with a NIXL backend, finer FSDP2 and pipeline parallelism memory and communication controls, NVFP4 decode improvements on Blackwell, FP8 and faster decode on Apple Silicon, and broader platform support including FlyDSL on AMD gfx950, ROCm 10.0 wheels, CUDA 13.2 as the default wheel, and torch.compile on Python 3.15. The release contains 3,117 commits from 583 contributors since 2.14, and Python 3.10 and macOS 14 are no longer supported.

  2. AWS Machine Learning Blog36

    Distributed training with Ray Train DLCs and EFA on EKS

    This AWS post shows how to fine-tune Qwen2.5-1.5B with PyTorch FSDP across eight NVIDIA L4 GPUs on two EFA-enabled g6.12xlarge instances on Amazon EKS, using the published Ray Train DLC (public.ecr.aws/deep-learning-containers/ray:train-ml-cuda-v1.1) without building any image. KubeRay creates the Ray head and worker pods from one RayCluster manifest, while hardware, transport and per-job Python packages are configured from outside the image via resource requests, environment variables and Ray runtime_env. The sample repository includes idempotent deploy scripts that locate g6.12xlarge capacity, provision the cluster and node group, install the GPU and EFA device plugins and KubeRay, and submit the job from inside the head pod, with the script failing if NCCL did not use EFA.

  4. Baseten Blog55

    The fastest, lowest-cost batch transcription with Qwen3-ASR

    Baseten optimized Qwen3-ASR 1.7B, an Apache 2.0 open-weight speech recognition model supporting over 30 languages and 22 Chinese dialects with a 5.4% average WER on the Open ASR Leaderboard, for batch transcription on a single RTX PRO 6000. The optimized stack transcribes 7x more audio per second than out-of-the-box vLLM at high concurrency, reaching 2,645x real-time factor on 5-minute clips and 3,128x on hour-long files, with median latency for 5-minute clips at 64 concurrent requests falling from 50 seconds to 7.3 seconds. Baseten reports a cost of about $0.0013 per audio hour, 8x lower than the same model on vanilla vLLM and roughly 277x less than popular closed-weight providers.

  5. Hacker News AI22

    A living document tracking my personal AI usage policy

    The author publishes a living personal policy for using AI safely, effectively and ethically, organized into sections on general principles, ethics, code, art, informative illustrations, writing, research, critique, emotional support, and social/political/environmental impact. Core positions include full human accountability for AI output, restricting AI-driven development to codebases with no external dependencies or hardened stable APIs, avoiding AI for art and emotional support, and treating AI search as "better Google" that must be verified. The guide is framed as applying to a best-case scenario, with the author noting current AI usage appears heavily subsidized and advising against overspending or becoming dependent.

Oct 28Wed
  1. TechCrunch · AI65

    Voice AI in vogue: Nvidia releases new open transcription model

    Nvidia released Nemotron 3.5 Transcribe, a free, open-weight model that transcribes audio in up to 40 languages and translates 31 languages to and from English, alongside version 2 of its open source Granary speech dataset. Nvidia claims it handles recordings up to an hour long, distinguishes up to eight speakers, and beats rivals on benchmarks including Hugging Face's Open ASR Leaderboard; the 30-billion-parameter model runs on a single chip but works with recorded audio, not livestreams. The release targets developers building business meeting and medical transcription apps and joins other recent voice model launches from Mistral, ElevenLabs and Salesforce.

  2. Nathan Lambert Interconnects42

    Artificial Analysis v5 and the benchmarker's dilemma

    Interconnects AI analyzes Artificial Analysis's Intelligence Index v5, which weights Knowledge Work, Coding, Science and General at 25% each across benchmarks including AA-Briefcase, FrontierCode 2.0, Terminal-Bench 4.0 and HLE-Diamond, and questions the new ranking that places eight closed models ahead of the best open-weight model, Kimi K3.1 Pro. The author argues that aggregating scores into a single number always involves trade-offs, that the shift to private benchmarks trades community bug-finding for trust in the benchmark builder, and that Artificial Analysis's business model of paid verification by labs creates a trust dilemma. The piece calls for more independent intelligence indices with different biases, noting that closed labs like Anthropic and OpenAI have largely moved past caring about these indices while they remain existential for smaller labs.

  3. Hacker News AI12

    AI is the real Soylent Green

    The post compares corporate control of AI to the film Soylent Green, arguing that mega-corporations scan libraries, websites and centuries of human creativity and then destroy the originals, making people dependent on them for facts and truths. It names Palantir as an example of intelligence companies that collect data and sell it to governments, which it says then outsource their intelligence and dilute their own power. The author calls for holding LLM providers accountable, building decentralized language models and local agents, funding projects like Wikipedia and the Internet Archive, protesting officials, and helping each other instead of blaming differences of race, religion or belief.

  4. MarkTechPost69

    Liquid AI Releases LFM3: 6 Open-Weight 2B-Class Multimodal Models

    Liquid AI released LFM3, a family of six open-weight 2B-class models built on one shared tri-hybrid backbone covering text, vision, audio, omni and decision tasks, each fine-tunable on a single GPU. LFM3-1.7B has 1.73B parameters and a 256K context window, runs at about 1 GB of memory at 4-bit, and averages 49.37 across 29 benchmarks (Liquid's own eval), above Qwen3.5-9B at 47.24, while trailing it on GPQA Diamond (63.37 vs 80.40) and SWE-bench Verified (43.40 vs 51.20). Weights are on Hugging Face, the Liquid AI Playground and the Liquid API, with GGUF, MLX, ONNX, FP8 and NVFP4 checkpoints, and free commercial use stops at $10M annual revenue under the LFM Open License v1.0.

  5. Pydantic AI Articles22

    I received the AAIF Outstanding Technical Contribution Award

    The author received the Agentic AI Foundation's Outstanding Technical Contribution Award at AGNTCon + MCPCon North America for their work as one of the two maintainers of the MCP Python SDK, including the v2 release shipped alongside the 2026-07-28 MCP specification revision with a new MCPServer API and multi-round-trip requests. They also sponsored SEP-1288 for the WebSocket transport and thanked colleague Laís Carvalho for the nomination and Pydantic for funding their open source work. The post notes that the Logfire MCP server runs on the same Python SDK and is where this work lands first.

  6. Hacker News AI60

    Giotto Sovereign European AI Models

    Giotto is a sovereign AI operating system that combines a reasoning model with an assistant, code, integrations, documents, agents and infrastructure monitoring, deployable on European cloud or private infrastructure. It offers two models, Giotto Alto and Giotto Solo, with benchmark comparisons against OpenAI, Anthropic, Google, Moonshot AI, Mistral, Nvidia and DeepSeek models across AIME 2026, GPQA-Diamond, HLE and Math-500. Giotto is available via its cloud, as a download for your own GPUs, or as a certified appliance with Giotto preinstalled.

  7. Hacker News AI60

    AI co-authored commits: 3 open-source projects in 2023, 686 of 874 in 2026

    Borehole's analysis of 984 public projects finds that 686 of 874 projects had at least one commit declaring an AI agent as co-author in 2026, up from 3 of 839 in 2023, with the average share of AI-declared commits rising from under 1% in 2023 to 8.9% in 2026. Of the 984 projects, 249 state an AI policy and 737 have AI-declared commits, with 206 doing both; Claude appears in 655 projects and GitHub Copilot in 470. The report notes that no AI-declared commits does not mean no AI was used, since a declaration is a co-author line the contributor chose to keep and a rebase can remove it.

  8. Hacker News AI35

    At 14 Justine Tunney published software. Now she makes AI models run from a file

    Justine Tunney, who began publishing software at 14 and later worked at Google on TensorBoard, created Cosmopolitan Libc, a five-year project enabling a single binary to run natively across Linux, Windows and macOS. In 2023 she combined Cosmopolitan with llama.cpp to create llamafile, which packages an AI model and the software needed to run it into a single executable file, announced by Mozilla's innovation group in November 2023. Her other projects include the single-file web server redbean and tools such as blink and sectorlisp.

  10. Hacker News AI23

    Leaf PHP: looking back at 740k installs and our crazy AI plan

    Leaf PHP's packages have passed 740,000 combined installs on Packagist since the framework's first release in October 2019. The author traces major turning points to v3, which introduced modules, and v5, an AI-native rebuild with a new route parser, AI-readable docs and a .leaf/CONTEXT.md file, noting installs have roughly doubled since v5 shipped in August. He also says Leaf MVC's share of installs fell from about one in two at the start of 2025 to about one in three today as more projects are started by agents.

Oct 27Tue
  1. Trail of Bits Blog36

    Backporting security fixes to stable releases

    Trail of Bits argues that stable and LTS software often lacks backported fixes for known CVEs, leaving users exposed to exploitation by AI agents, and cites kernel and Debian/Ubuntu CVE counts as a measure of the gap. The post describes using Codex with GPT-5.6 to find fixes that apply cleanly to stable kernel trees, with 142 fixes covering 90 CVEs now applied, and says the team has begun sending backported patches to Linux distributions. It invites open source projects and distributions to apply at trailofbits.com/patch-the-planet for help.

  2. n8n Blog55

    Introducing n8n 3.0

    n8n released version 3.0.0 BETA, focused on internal changes for reliability, stability and security, with a stable release planned for early December. The release includes breaking changes such as removal of legacy nodes (Function, Item Lists, Cron, Interval), Docker-only self-hosting, safer security defaults, and a Migration Report under Settings to identify affected workflows and settings. Upgrading to 3.x is one-way, so users are advised to test on a staging instance and take a full backup first.

  3. Cloudflare Blog74

    Cross-request KV cache exposure in the GLM-5.3 Workers AI model, and our remediation with SGLang

    Cloudflare reports that from August 27 to September 9, 2026, 155 responses from the GLM-5.3 Workers AI model (@cf/zai-org/glm-5.3) to prompts longer than 681,280 tokens contained data from other customers' requests, caused by a prefill KV pool smaller than the 1,048,576-token context window combined with an SGLang bug that let rejected over-length requests proceed through disaggregated prefill/decode handoff. The model was taken offline on September 9 and restored the same day after a corrected configuration and an engine patch, and Cloudflare says it found no evidence of deliberate exploitation. Cloudflare recommends operators of disaggregated SGLang upgrade to v0.5.22 or later and verify KV pool size against context length on every node.

    Why it matters: A detailed first-party incident report that is useful for anyone operating disaggregated LLM inference, with concrete configuration checks and upstream patch references.

  4. The Decoder50

    Reddit's r/opensource bans all AI-related projects, sparking backlash and a rival subreddit

    The r/opensource subreddit has banned all posts about projects that use AI, were built with AI, or are designed for AI, with moderators saying AI in its current form doesn't fit the open-source community. New rules also require projects to be at least a year old, actively maintained, and have multiple contributors, and bar posts from non-English speakers. Critics call the rules too broad and vague, noting the Linux kernel now contains AI-generated code, and a rival forum, r/TrueOpenSource, has appeared that does not exclude AI.

  5. Latent Space36

    Supabase’s Plan for a Billion AI-Built Apps

    Supabase co-founders Paul Copplestone and Ant Wilson join swyx to discuss running long-lived workloads alongside the database, making schemas easier for agents to understand, and designing infrastructure for a world with many more applications. The conversation also covers Postgres reliability and scaling, Turso, open source, community-led distribution, and how Supabase uses AI internally, recorded ahead of Supabase Select 2026.

  6. Meta Engineering40

    Meta Networking at the 2026 OCP Global Summit: Open Innovation for Scale-Up, Scale-Out, and Scale-Across AI Networks

    At the 2026 OCP Global Summit, Meta presented networking work supporting its AI models and gigawatt-scale Prometheus cluster, including the liquid-cooled IcePack/IceCube rack with 102.4T switch blades, the Flattened Planar Fabric for scale-out, BAG super-spine and SRv6 backbones for scale-across, and Tahan, an Ethernet scale-up switch for MTIA 300. Meta also introduced OSPA, an OCP initiative co-led with Microsoft and Alibaba to standardize the switch platform layer with a v1.0 spec submitted to OCP, and said its MetaRoCE RDMA transport is going open source, starting with a user-space version on GitHub. Recorded talks and slide decks from the event are available on the 2026 OCP Global Summit website.

Oct 25Sun
  1. The Verge · AI38

    r/opensource just banned AI, non-English speakers, and more

    The moderators of r/opensource posted new submission rules banning projects that use, are made by, or are intended for AI, which sparked backlash in the comments and led to the creation of a rival subreddit, r/trueopensource. The rules also require submitted projects to be at least one year old, actively maintained, and have multiple contributors, and effectively bar non-English speakers because moderators say they cannot distinguish AI-written from AI-translated text.

Oct 23Fri
  1. The Verge · AI42

    Retro gaming is being overrun with AI

    AI coding tools have sharply accelerated decompilation and recomposition projects that port retro games to new platforms, but the surge has strained preservation communities, with one tracking site shutting down over hostile forks and AI-assisted "finishing" of others' work. The article weighs the boom in interest and accessibility against preservationists' concerns that AI-driven speed sacrifices understanding of how games were built, while noting Xbox has set up an Xbox Labs division to explore the space.

  2. AWS Machine Learning Blog34

    Train Qwen3 on AWS Trainium with torchtitan

    This post walks through training Qwen3 three ways on a single trn2.48xlarge using torchtitan-neuron: via Hugging Face Transformers v5 as a modeling backend, via torchtitan's native Qwen3 by changing config.model_spec, and via NKI mixture-of-experts kernels from the torchtitan-neuron recipes, all using the same torchrun launch pattern. It also shows how to load and save published safetensors checkpoints, attach a custom NKI rope_hf kernel through torchtitan's override registry, and scale with data and tensor parallelism across 64 logical NeuronCores.

  3. NVIDIA Blog34

    NVIDIA Open Models Power a New Wave of European Public Sector Projects

    NVIDIA partners and European governments are adopting open models for public-sector AI, including the European Commission's deepset-based AI@EC platform, Poland's healthcare and employment agentic systems, and Germany's Materna Sinfonie and secunet sovereign cloud. New Nemotron-Personas datasets for the UK and Germany provide 1 million synthetic personas each for testing public-service models, while France's CANUT selected LINAGORA and Docaposte for a sovereign workspace and Greece's KIEFER builds an agentic factory on DGX SuperPOD. NVIDIA's Open Models Codefest named Pleias, Zehnlab.ai, Disseqt, Algoritmica GmbH and ABA Technology as its top five teams.

  4. Simon Willison58

    Donating Agent Skills to the Agentic AI Foundation

    Anthropic announced it is donating the Agent Skills standard to the Agentic AI Foundation (AAIF) under the Linux Foundation, which it co-founded with Block and OpenAI last year and to which it previously donated the Model Context Protocol (MCP). The post notes that the author predicted this outcome last December when Anthropic first declared skills an "open standard," and that he found that earlier post by prompting Claude via the datasette-mcp plugin.

Oct 22Thu
  1. NVIDIA Blog40

    Leading European Financial Services Organizations Embrace Open Models to Build Proprietary Intelligence

    At GTC Berlin, European banks, payment companies and data providers showcased production-scale AI built on NVIDIA accelerated computing and open weight models running on their own infrastructure, including Revolut's PRAGMA foundation model serving an initial 80 million customers and Starling Bank's agentic model trained on U.K. sovereign cloud. Open weight models let institutions like bunq, NatWest, Modulr and Santander build proprietary intelligence at controlled cost, while LSEG, RavenPack, HSBC and Stripe reported speedups such as 10x faster tick-data analysis and 42x faster data pipelines for fraud detection.

  2. NVIDIA Blog60

    NVIDIA Cosmos Opens New Tools to Train, Evaluate and Deploy World Models

    NVIDIA expanded its Cosmos platform with new training tools, simulation checkpoints and Cosmos Data Factory blueprints, including five cloud-native blueprints for tasks such as autonomous vehicle dataset generation and defect image generation. Cosmos Framework now extends training, optimization and deployment tools as agent skills to open models like GR00T, Alpamayo, QWEN and Pi0.5, while new Cosmos 3 Nano simulation variants and updated NIM microservices offer up to 2x faster inference. The post cites Porsche, ANYbotics, Ultralytics and ADNOC as users of the platform.

    Why it matters: The post details concrete tooling, model support and named customer deployments, useful for readers tracking physical AI and world-model infrastructure.

Oct 21Wed
  1. NVIDIA Blog60

    Bringing the Spark to Europe: Local Intelligence Powers Next Wave of Agents

    At GTC Berlin, NVIDIA showcased its local AI hardware lineup: RTX Spark for personal agents on Windows PCs, DGX Spark for Linux developers, and DGX Station for enterprise workloads, with a Windows version due in December. Announcements included Underdog Desktop Agent for RTX Spark, DGX Spark 64GB systems rolling out Oct. 23, support for clusters of up to eight DGX Sparks, NVIDIA Sync Model Launcher, and the new Recursive Flint local coding model. NVIDIA also added day-zero support for new Nemotron, GLM, DeepSeek, Qwen, MiniMax and FLUX.3 models, plus accelerations for llama.cpp and vLLM.

    Why it matters: It offers a detailed roundup of NVIDIA's local AI hardware and software announcements for developers and enterprises.

  2. NVIDIA Blog62

    NVIDIA Agent Toolkit Expands, Grounding Enterprise Agents in Company Data

    NVIDIA has expanded its open source Agent Toolkit, adding the Agent Knowledge Foundation with CUDA-X libraries and an Auto-Ontology library, Nemotron Retriever and Kumo open models, the OpenShell secure agent runtime, NemoClaw blueprints and tools such as NeMo Relay and NeMo Compass. The company says enterprises can use Agent Knowledge Foundation without moving data, rebuilding workflows or changing governance controls, and cites adoption by Palantir, Databricks, Snowflake, SAP, ServiceNow, Zoom, AWS and others.

    Why it matters: Useful for readers tracking how vendors are packaging data grounding, runtime security and governance for enterprise agents.

Oct 7Wed
  1. Google DeepMind72

    EmbeddingGemma 2: an open, lightweight multimodal embedding model

    Google DeepMind announced EmbeddingGemma 2, a 740-million-parameter model built on the Gemma 4 architecture and released under the Apache 2.0 license, which maps text, code, images, video, and audio into a unified embedding space for on-device use. It offers modular encoders (as little as 270M parameters for text-only, with optional 170M vision and 300M audio encoders), Matryoshka Representation Learning to truncate vectors from 768 down to 128 dimensions, an 8K token context window, and on a Google Pixel 11 Pro requires as little as ~191MB active RAM for text-only weights and ~567MB for the full multimodal model. The company reports a 9.92-point improvement on MTEB Code (68.76 to 78.68) over EmbeddingGemma and says the model is available on Hugging Face and Kaggle, with support across tools including transformers, vLLM, llama.cpp, Ollama, and Qdrant.

    Why it matters: It documents a new open, commercially licensed embedding model with concrete size, memory, and benchmark figures relevant to developers building on-device search and RAG.

Sep 16Wed
  1. Mistral AI58

    Mistral and Mozilla are bringing open, private and multilingual AI to your web browser

    Mistral announced a partnership with Mozilla under which its models now power Firefox Smart Window (beta), Mozilla's AI browsing assistant, for users in France and North America, with the UK and Germany expected later this year. Mistral says it fine-tunes models on regional languages and dialects, and that Smart Window conversations are not saved on Mozilla's servers by default, with partners agreeing to zero data retention. Mozilla CEO Anthony Enzor-DeMeo and Mistral CEO Arthur Mensch framed the deal as two open source advocates working together on privacy, control and choice in AI-powered browsing.