<?xml version="1.0" encoding="utf-8" standalone="yes"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:dc="http://purl.org/dc/elements/1.1/">
  <channel>
    <title>Kimi on KbWen Blog</title>
    <link>https://www.kbwen.com/tags/kimi/</link>
    <description>KbWen is a practical technology blog about AI systems, machine learning, Python, data engineering, and software development.</description>
    <generator>Hugo</generator>
    <language>zh-tw</language>
    <image>
      <url>https://www.kbwen.com/images/og-default.png</url>
      <title>KbWen Blog</title>
      <link>https://www.kbwen.com/</link>
    </image>
    
    <lastBuildDate>Tue, 04 Aug 2026 04:30:00 +0800</lastBuildDate><atom:link href="https://www.kbwen.com/tags/kimi/index.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Kimi K3 Benchmarks vs Claude Fable 5 and GPT-5.6 Sol</title>
      <link>https://www.kbwen.com/kimi-k3-benchmarks-vs-fable-5-and-gpt-5-6-sol/</link>
      <pubDate>Tue, 04 Aug 2026 04:30:00 +0800</pubDate><dc:creator>KbWen</dc:creator>
      <guid>https://www.kbwen.com/kimi-k3-benchmarks-vs-fable-5-and-gpt-5-6-sol/</guid>
      <description>Moonshot&amp;#39;s model card scores Kimi K3 against Claude Fable 5 and GPT-5.6 Sol across 45 benchmarks. Some rows go to K3 and some to the others, with margins running from fifteen points down to a tenth — plus what $3/$15 per million tokens buys.</description>
      <content:encoded><![CDATA[<p>Moonshot AI released Kimi K3 on July 16 and put the weights on Hugging Face eleven days later. It is a 2.8-trillion-parameter model with 104 billion active per token, a context window of one million, and native vision. You can call it through Moonshot&rsquo;s API, or <a href="https://huggingface.co/moonshotai/Kimi-K3">download the weights</a> and find hardware for a model this size.</p>
<p>The README that ships with them carries a comparison table: K3 against Claude Fable 5, GPT-5.6 Sol, Claude Opus 4.8, GPT-5.5 and GLM-5.2, every model at its maximum setting, every score Moonshot&rsquo;s own. Forty-five benchmarks sit in four sections — reasoning and knowledge, coding, agentic work, vision — and forty of them report a score for all three of K3, Fable 5 and Sol.</p>
<h2 id="benchmark-scores">Benchmark scores</h2>
<table>
  <thead>
      <tr>
          <th>Benchmark</th>
          <th>Section</th>
          <th>Kimi K3</th>
          <th>Claude Fable 5</th>
          <th>GPT-5.6 Sol</th>
      </tr>
  </thead>
  <tbody>
      <tr>
          <td>HLE-Full</td>
          <td>Reasoning</td>
          <td>43.5</td>
          <td>53.3</td>
          <td>44.5</td>
      </tr>
      <tr>
          <td>AA-LCR</td>
          <td>Reasoning</td>
          <td>74.7</td>
          <td>70.0</td>
          <td>73.7</td>
      </tr>
      <tr>
          <td>FrontierSWE</td>
          <td>Coding</td>
          <td>81.2</td>
          <td>86.6</td>
          <td>71.3</td>
      </tr>
      <tr>
          <td>SWE-Marathon</td>
          <td>Coding</td>
          <td>42.0</td>
          <td>35.0</td>
          <td>39.0</td>
      </tr>
      <tr>
          <td>MCPMark-Verified</td>
          <td>Agentic</td>
          <td>94.5</td>
          <td>87.4</td>
          <td>92.9</td>
      </tr>
      <tr>
          <td>OSWorld 2.0</td>
          <td>Agentic</td>
          <td>58.3</td>
          <td>66.1</td>
          <td>62.6</td>
      </tr>
      <tr>
          <td>OmniDocBench</td>
          <td>Vision</td>
          <td>91.1</td>
          <td>89.8</td>
          <td>85.8</td>
      </tr>
      <tr>
          <td>BabyVision w/ python</td>
          <td>Vision</td>
          <td>85.7</td>
          <td>90.5</td>
          <td>88.9</td>
      </tr>
  </tbody>
</table>
<p>Each of the three finishes first somewhere, and by very different amounts. Fable 5 takes HLE-Full by nearly ten points and BabyVision by close to five. Sol takes CritPt at 32.3, where K3 scores 23.4. K3 takes MCPMark-Verified at 94.5 and SWE-Marathon at 42.0. FrontierSWE spreads the three over fifteen points, from Fable 5 at 86.6 down to Sol at 71.3.</p>
<p>Other rows barely move at all. SpreadsheetBench 2 has K3 at 34.8 and Fable 5 at 34.7. OfficeQA Pro has K3 at 63.3 and Sol at 63.2. Terminal-Bench 2.1 puts all three within 0.8 of each other, at 88.3, 88.0 and 88.8.</p>
<p>Counted as wins and losses, the answer moves with the comparator. Against Sol, K3 is ahead on 27 of the forty comparable rows. Against Fable 5 it is ahead on 15, behind on 24, and level on one — ZeroBench (pass@5), where both score 23.0. Section by section against Fable 5, that runs two-two in reasoning, three-six in coding, seven-twelve in agentic and three-four in vision, with the tie falling in vision.</p>
<p>The size of a lead moves with the comparator too. MCPMark-Verified gives K3 7.1 points on Fable 5 and 1.6 on Sol. BrowseComp gives it 3.2 and 0.8. AA-LCR gives it 4.7 and 1.0, and AA-LCR is the only row in the reasoning section where K3 finishes above Sol. SWE-Marathon puts K3 seven points above Fable 5&rsquo;s 35.0, with Claude Opus 4.8, also in the table, at 40.0.</p>
<p>Twenty-two of the forty-five rows are agentic work, so most of any win-and-loss count is decided there: browser search, MCP and tool calls, OS control, spreadsheets and office documents, and a run of domain agents — Harvey Lab-AA, CorpFin v2, Finance Agent v2, Legal Research Bench. Two of those rows report Elo ratings instead of percentages. The 61 points between K3&rsquo;s 1686 and Fable 5&rsquo;s 1747 on GDPval-AA v2 are not the same unit as the 61 points that would separate two percentage scores, and nothing in the table converts between them.</p>
<h2 id="price-and-speed">Price and speed</h2>
<p>K3 lists at $3 per million input tokens and $15 per million output, with cached input at $0.30. Fable 5 is $10 and $50 — the same rate Anthropic <a href="/anthropic-keeps-fable-5-in-subscriptions/">kept for Pro and Team Standard in July while folding Fable 5 back into the top plans</a>. Sol is $5 and $30. Against those two, K3 is the cheap one.</p>
<p>A comment on the Hacker News launch thread reads:</p>
<blockquote>
<p>pricing is $3/$15 for 1M tokens (cache $0.3), which is extremely high for a Chinese open-weight model</p>
</blockquote>
<p>The thread under it drifted into whether per-token prices can be compared at all. Tokenizers differ, so the same page of text becomes a different number of tokens depending on which model is counting it, and more than one person wanted a price per page or per byte instead.</p>
<p>Artificial Analysis measures K3&rsquo;s output at 34.9 tokens per second, 57th among the 101 models on its list, running on hosted infrastructure. One Hacker News post is titled <code>Run Kimi K3 using 29 GB of RAM at 0.50 tok/s</code> — thirty tokens a minute, which is what the downloadable weights come to on a machine that size.</p>
<p>The model is under three weeks old and a version bump can move any of these numbers. If you have run K3 next to Fable 5 or Sol on the same job, which rows held up? And if something here is wrong, tell me and I will fix it.</p>
]]></content:encoded>
    </item>
    
    <item>
      <title>Kimi K3 適合什麼任務？跟 Fable 5、GPT-5.6 Sol 的對照表怎麼看</title>
      <link>https://www.kbwen.com/kimi-k3-vs-fable-5-gpt-5-6-sol/</link>
      <pubDate>Tue, 04 Aug 2026 04:00:00 +0800</pubDate><dc:creator>KbWen</dc:creator>
      <guid>https://www.kbwen.com/kimi-k3-vs-fable-5-gpt-5-6-sol/</guid>
      <description>Moonshot 七月發表的開源模型 Kimi K3，README 附了一張跟 Fable 5、GPT-5.6 Sol 的對照表。這篇挑六項分數來看，也整理了價格與輸出速度，談哪些任務可以交給它。</description>
      <content:encoded><![CDATA[<p>Moonshot 七月中發表了新的開源模型 Kimi K3，月底放上 Hugging Face 可以下載。總參數 2.8T，每次實際啟用 104B，context 一百萬。</p>
<p>開源模型發表的時候通常會附一張跟閉源模型的比較表。K3 這張比的對象是 <a href="/claude-fable-5-stays-in-subscriptions/">Claude Fable 5</a> 跟 GPT-5.6 Sol，下面用到的數字都來自 Moonshot README 裡的對照表，表上所有模型都跑 max 設定。</p>
<h2 id="對照表上的位置">對照表上的位置</h2>
<p>表分成四塊：推理與知識、寫程式、agent 任務、視覺。</p>
<p>整體的方向一致。對上 Sol，K3 多數列領先；對上 Fable 5，多數列落後。位置大致就在兩者之間，比較靠近 Sol。</p>
<p>有意思的是 Moonshot 的講法比這張表保守。官方部落格上只說 K3 的整體表現仍然落在 Fable 5 跟 Sol 後面，達到的是 frontier level，把兩家並列放在前面。但表上 K3 對 Sol 是多數列領先的。</p>
<p>這份文件裡還有一列容易被跳過的 Kimi Code Bench 2.0。Kimi Code Bench 2.0 是 Moonshot 自家使用的 benchmark，K3 拿 72.9，Fable 5 是 76.9。同樣也可以拿來參考，但是評分細節我們可能就不知道了。</p>
<p>不過整體排名我們大概能看出 K3 落在哪一區，可是還不夠拿來直接判定工具好壞。比較值得關注的是它贏在哪幾列、又輸在哪幾項。</p>
<h2 id="輸贏的比較">輸贏的比較</h2>
<p>下面這幾項是差距比較明顯的，分數都取自同一張對照表：</p>
<table>
  <thead>
      <tr>
          <th>Benchmark</th>
          <th>測什麼</th>
          <th style="text-align: right">Kimi K3</th>
          <th style="text-align: right">Claude Fable 5</th>
          <th style="text-align: right">GPT-5.6 Sol</th>
      </tr>
  </thead>
  <tbody>
      <tr>
          <td>SWE-Marathon</td>
          <td>長流程程式任務</td>
          <td style="text-align: right"><strong>42.0</strong></td>
          <td style="text-align: right">35.0</td>
          <td style="text-align: right">39.0</td>
      </tr>
      <tr>
          <td>MCPMark</td>
          <td>工具操作</td>
          <td style="text-align: right"><strong>94.5</strong></td>
          <td style="text-align: right">87.4</td>
          <td style="text-align: right">92.9</td>
      </tr>
      <tr>
          <td>BrowseComp</td>
          <td>網頁搜尋</td>
          <td style="text-align: right"><strong>91.2</strong></td>
          <td style="text-align: right">88.0</td>
          <td style="text-align: right">90.4</td>
      </tr>
      <tr>
          <td>AA-LCR</td>
          <td>長上下文</td>
          <td style="text-align: right"><strong>74.7</strong></td>
          <td style="text-align: right">70.0</td>
          <td style="text-align: right">73.7</td>
      </tr>
      <tr>
          <td>CritPt</td>
          <td>物理推理</td>
          <td style="text-align: right">23.4</td>
          <td style="text-align: right">28.6</td>
          <td style="text-align: right"><strong>32.3</strong></td>
      </tr>
      <tr>
          <td>HLE-Full</td>
          <td>研究級問答</td>
          <td style="text-align: right">43.5</td>
          <td style="text-align: right"><strong>53.3</strong></td>
          <td style="text-align: right">44.5</td>
      </tr>
  </tbody>
</table>
<p><img
  src="/images/figures/fig-kimi-k3-taskfit-zh.png"
  alt="六個 benchmark 的點狀圖，橫軸 0 到 100。SWE-Marathon、MCPMark、BrowseComp、AA-LCR 四項 Kimi K3 的點在最右邊，其中三項三家的點幾乎重疊；CritPt 與 HLE-Full 兩項 K3 的點在最左邊，線段明顯較長"
  loading="lazy"
  fetchpriority="auto"
  decoding="async" width="1040" height="620"
>
</p>
<p>先看 SWE-Marathon。K3 是 42.0，Fable 5 拿 35.0，Sol 是 39.0。</p>
<p>這波是長時間、多回合的任務。題目不會跑一輪就結束，模型得要根據前一輪的結果繼續接著往下改，而且任務拖得愈長，前面留下來的資訊就愈重要。</p>
<p>換成平常會碰到的工作，大概是把整個 repo 的 lint 修過一遍，或者讀完幾十份文件再整理成一張表。每一個步驟和任務單獨處理都不難，難的是好幾個步驟加在一起後，是否還能完成任務不走歪。</p>
<p>同個方向上還有三個分數，括號裡是 Fable 5 跟 Sol。長上下文的 AA-LCR 是 74.7（70.0、73.7），工具操作的 MCPMark 94.5（87.4、92.9），BrowseComp 91.2（88.0、90.4）。</p>
<p>這四項來自不同的 benchmark 家族，題目長相也不一樣，可是排出來的順序一樣。共通的地方是任務都要撐得久、中間要記得前面發生過什麼，而且多半得接外部工具。K3 比較好的地方大多在這個類別。</p>
<p>相較之下，輸的地方集中在推理與知識。</p>
<p>CritPt 是 K3 23.4、Fable 5 28.6、Sol 32.3；HLE-Full 是 K3 43.5、Fable 5 53.3、Sol 44.5。兩列的對手還不一樣，CritPt 對兩邊都輸，HLE-Full 主要輸給 Fable 5，跟 Sol 只差一分。</p>
<p>這個差別呈現的資訊不只是分數高低。如果是較長流程的題目跑不好、跑不出來還能多跑幾輪、多給一點上下文、多接不同工具慢慢補回來；但推理補不了。上下文再長、工具再多，模型想不出來就是想不出來，能力到哪就是在哪。</p>
<h2 id="價格">價格</h2>
<p>價格則是個重要的關注點。</p>
<table>
  <thead>
      <tr>
          <th>模型</th>
          <th style="text-align: right">input（每 100 萬 token）</th>
          <th style="text-align: right">output</th>
          <th style="text-align: right">cache</th>
      </tr>
  </thead>
  <tbody>
      <tr>
          <td>Kimi K3</td>
          <td style="text-align: right">$3</td>
          <td style="text-align: right">$15</td>
          <td style="text-align: right">$0.3</td>
      </tr>
      <tr>
          <td>GPT-5.6 Sol</td>
          <td style="text-align: right">$5</td>
          <td style="text-align: right">$30</td>
          <td style="text-align: right">有，本篇未查</td>
      </tr>
      <tr>
          <td>Claude Fable 5</td>
          <td style="text-align: right">$10</td>
          <td style="text-align: right">$50</td>
          <td style="text-align: right">有，本篇未查</td>
      </tr>
  </tbody>
</table>
<p>K3 的數字取自 Artificial Analysis 的模型頁。換算下來大約是 Fable 5 的三分之一、Sol 的六成。同樣一筆預算，改用 K3 可以跑到 1.7 到 3.3 倍的量，這就讓開發有不同的使用和想像空間。</p>
<p>cache 的 0.3 美元只有一般 input 價的十分之一。如果流程會反覆讀同一批文件，第二次之後就是按這個價算，跑得愈久差距愈明顯。</p>
<p>輸出速度也有提供。K3 是 34.9 tok/s，在 101 個模型裡排第 57。這個速度吐一千個 token 大概要半分鐘，單次問答就感覺得到了，流程變長更明顯，任務跑上幾十輪，等待時間會顯著的變長。</p>
<h2 id="可以交給它的任務">可以交給它的任務</h2>
<p>照這張表，我們可以看出 K3 適合的任務有幾個共通點：流程可以長、中間要回頭看前面做過什麼、還有去接外部工具的任務。</p>
<p>長流程的程式修改、資料整理，還有串 MCP 或別的工具的自動化，大致都在這個範圍。這類工作本來就要跑很多輪，三倍的價差會一路累積下去。</p>
<p>推理上的題目就是另一回事。如果需要推論到答案、而且要有效率的答對，Fable 5 跟 Sol 都領先不少。便宜換到的很可能就是弱一點的答案。</p>
<p>所以工作類型較多元的話，也不用只挑一個模型。長流程交給 K3，難題留給 Fable 5 或 Sol，可以有很多不同的搭配和嘗試。</p>
<p>寫在最後，模型的發展很快，說不定改天 Gemini 又彎道超車，幾個月後又是不同的世界，我們該做的就是保持彈性和學習的心態，有甚麼想討論的歡迎聯絡～</p>
]]></content:encoded>
    </item>
    
  </channel>
</rss>
