Archive
GitHub 熱門專案、開源工具、框架、runtime 與重要 release。
推論系統
Tevatron-Elastic unifies early exit, Matryoshka vectors, and inter-layer token compression into configurable operating points, allowing one checkpoint to serve multiple cost profiles. In the authors’ test environment, the Qwen3‑0.6B reranker retained full quality at layer 16 while achieving a 1.75× speedup.
推論系統
Rather than merely comparing aggregate long-context scores, KVDiagnosis creates a paired FullCache baseline for every compression configuration to track evidence retention, attention, and probability drift. An implementation audit also led the team to exclude 7,800 PyramidKV records with identical results, highlighting how adapter errors can contaminate cross-method evaluations.
AI 安全
SHE decomposes an agent safety harness into a system prompt, rule library, safety memory, and tool policy, then locally revises them based on failure traces. On Agent-SafetyBench, it reduces both attack success and false refusal rates, though real-world deployments must still guard against evaluator bias and unchecked rule growth.
最新模型
New research suggests that diffusion LLMs converted from autoregressive models may also inherit safety mechanisms concentrated in a small number of neurons. The researchers also used an open diffusion model to generate adversarial prompts offline, but the promised full code has not yet been released.
推論系統
A publicly available, reproducible community vLLM recipe deploys Laguna S 2.1 INT4 on four 24GB RTX 3090 GPUs and handles a real 190K-token request using a precision-matched DFlash draft model. The reported 282.5 tokens/s is a peak under a specific configuration, not sustained throughput, while the quality and compatibility of low-bit quantization remain highly dependent on the checkpoint and inference engine.
PTQ4SNN 把脈衝神經網路長期保留的浮點膜電位納入後訓練量化，按通道配置 2、4 或 8 位元。論文在分類與語意分割上接近浮點模型，但硬體收益仍來自分析模型，且專用程式尚未公開。
代理工具
SkillProx does not retain model-proposed skill modifications outright. Instead, it reruns tasks, rolls back regressive versions, and removes knowledge units with negative utility. All three Qwen models improved on table tasks, but the authors have so far published only a skeletal repository with two commits.
RAG／文件理解
DocMemo does not treat the top-k pages from the initial retrieval as final. Instead, it feeds reasoning feedback back into the page-relevance distribution and resamples. Its three-layer memory improves long-document question answering, but evaluation relies on GPT-4.1, and the public repository remains quite minimal.
代理工具
The Shanghai AI Laboratory has released A²E, which uses the Agent Task Protocol to decouple benchmarks, agent harnesses, and trajectory scoring. Its 1,035 paired runs show that the harness affects tool use and token costs, but the sample size is too small to support framework rankings.
代理工具
TEPA adds a revocable validity state to long-term memory, removing content overturned by new evidence from standard retrieval while preserving an audit trail. The method can resolve single-hop conflicts but becomes almost entirely ineffective on multi-hop tasks or with a 262K long context.
RAG 與金融 AI
FinRank requires systems to find evidence in SEC filings that matches the correct company, period, and disclosure context, rather than merely generating a numerically correct answer. The dataset and evaluation code are public, but the noncommercial license and annotation limitations will affect how they can be adopted.
代理工具
Orcetra originally claimed to substantially outperform FLAML and AutoGluon across 513 OpenML datasets, but an author audit uncovered test-set leakage and unequal compute allocation. Under the corrected protocol, the three systems showed no statistically significant differences on the rerun subset.