What a decentralized mixture of experts (MoE) is, and how it works
Did you know? The core idea behind Mixture of Experts (MoE) models dates back to 1991 with the paper “Adaptive Mixture of ...
Ant Group’s use of China-made GPUs, not Nvidia, cuts AI model training costs by 20%
The fintech affiliate of Alibaba said its Ling-Plus-Base model can be ‘effectively trained on lower-performance devices’.
Indiatimes1mon
Mixture of experts: The method behind DeepSeek's frugal success
The key to DeepSeek’s frugal success? A method called "mixture of experts." Traditional AI models try to learn everything in one giant neural network. That’s like stuffing all knowledge into a ...
Chain-of-experts (CoE): A lower-cost LLM framework that increases efficiency and accuracy
Chain-of-experts chains LLM experts in a sequence, outperforming mixture-of-experts (MoE) with lower memory and compute costs.
The American Bazaar7h
Alibaba’s Ant Group uses a mix of US and Chinese semiconductors for AI
Alibaba-affiliate Ant Group is reportedly using a mix of U.S.- and Chinese-made semiconductors to enhance the efficiency of ...
Outlook Business10h
DeepSeek Rolls Out V3 Model Updates, Strengthen Programming Capabilities to Outpace OpenAI
Chinese AI startup DeepSeek upgrades its V3 model with the V3‑0324 update, enhancing programming capabilities and shifting to ...
Gulf News1d
Jack Ma-backed Ant touts AI breakthrough built on Chinese chips
Ant used domestic chips to train models using Mixture of Experts machine learning approach Jack Ma-backed Ant Group Co. used Chinese-made semiconductors to develop techniques for training AI ...
ByteDance says new AI technology boosts model training efficiency by 1.7 times
TikTok owner ByteDance said it has achieved a 1.71 times efficiency improvement in large language model (LLM) training, the latest Chinese tech company to achieve a breakthrough that could potentially ...