2026-08-21 | CS.LG机器学习 | 共 65 篇
[机构]信息由AI分析生成,可能存在错误,仅供参考,以论文实际显示为准
快速导航
1. 深度学习架构与训练方法 3 篇
2. 表示学习、自监督与对比学习 1 篇
3. 强化学习与序列决策 5 篇
4. 生成模型与概率建模 1 篇
5. 优化、泛化与理论分析 2 篇
6. 高效学习、压缩与部署 1 篇
7. 鲁棒性、不确定性与可信学习 2 篇
8. 图学习与结构化数据 1 篇
9. 迁移、元学习与持续学习 5 篇
10. 数据集、基准与评测 3 篇
11. 机器学习应用 8 篇
12. 其他/综合机器学习 33 篇
1. 深度学习架构与训练方法 | 3 篇
1. DeltaMomentum: A Key-Value based Anisotropic Momentum Update via Delta Rule
DeltaMomentum:基于键值结构的Delta规则各向异性动量更新
AI 总结:DeltaMomentum将方向感知融入动量更新,可作为优化器动量缓冲器的即插即用替代,在预训练中减少AdamW步数,在多模型和数据集上验证了其有效性。
链接:https://arxiv.org/abs/2608.19491
机构:Carnegie Mellon University(卡内基梅隆大学)
作者:Euijin Hong, Guannan Qu
英文摘要:Most modern optimizers form their momentum as an exponential moving average (EMA) of past gradients, forgetting every direction at one fixed rate. However, the inputs a deep network sees during training can be highly anisotropic, with a few directions queried frequently while most are seen rarely. Recent methods address this anisotropy by wrapping extra processing around this buffer, leaving the momentum update itself unchanged. We propose DeltaMomentum, which builds direction-awareness into the momentum update rule. The main observation is that the gradient of a linear layer splits into an input that acts as a key and an output-side error that acts as a value. Exploiting the key-value structure, DeltaMomentum updates the momentum buffer by the canonical delta rule, so each direction is forgotten at a rate set by how often it appears. We prove that it is a valid momentum, that it applies the input-side curvature correction without matrix inversion, and that it clears stale directions faster than EMA under both a fixed and a drifting optimum. It is a drop-in replacement for the momentum buffer of any optimizer, its coefficient transfers across widths under $\mu$P, and its extra compute stays between $22.2\%$ and $25.0\%$ of a gated-MLP block's linear cost with no persistent memory. In FineWeb-Edu pretraining, AdamW with DeltaMomentum (DeltaAdamW) reaches AdamW's validation loss in up to $46.39 \pm 4.32\%$ fewer steps at 67M and $22.12 \pm 0.80\%$ at 370M over three seeds, and the gain persists at 1B on a Chinchilla-optimal budget. A Muon baseline tuned under the same protocol sits above DeltaAdamW at both language-model scales, and the gain holds for SGD, ResNet-18, and ViT-Tiny on CIFAR-10. Training-time diagnostics confirm the predicted mechanism, better gradient tracking and healthier input directions.
2. Let's Scale Step by Step: Compute-Efficient Hyperparameter Transfer for Large-Scale Mixture-of-Experts
逐步扩展:面向大规模混合专家模型的计算高效超参数迁移
AI 总结:本文提出两步超参数迁移框架,利用小型代理模型外推大规模混合专家模型的最优学习率,仅需极低成本即可准确预测全规模模型的最优配置。
链接:https://arxiv.org/abs/2608.20061
机构:Kakao Corp.(Kakao公司); Upstage AI(Upstage人工智能公司)
作者:Nayeon Kim, Hojin Lee, Yunju Bak, Jaesun Park, Boseop Kim
英文摘要:Mixture-of-Experts (MoE) architectures significantly expand model capacity without a proportional increase in computational cost. However, optimizing their hyperparameters---particularly the learning rate---at extreme scales of both model size and token budget via sweeping remains computationally prohibitive. In this paper, we propose a compute-efficient, two-step hyperparameter transfer framework that estimates optimal learning rates for training large MoE models by transferring them across scaling model widths, and subsequently extrapolating to trillion-token horizons. First, we formulate a Maximal Update Parameterization ($\mu$P) adaptation for MoE architectures utilizing Multi-head Latent Attention (MLA) and the Muon optimizer, demonstrating that optimal learning rates transfer consistently across width-scaled models. Second, we extend this transferability along the token dimension by establishing a predictive scaling law. By applying linear regression to the optimal values derived from small proxy models on limited budgets, we successfully extrapolate the ideal learning rate to massive training horizons (e.g., 10 trillion tokens) with high fidelity ($R^2=0.95$). Consequently, this indicates that proxy training on small models is sufficient to determine the optimal learning rate for the extensive training of large-scale MoEs. We apply the proposed methodology to pretrain our foundation model (155B total, 17B active parameters) from scratch, and the stable training and evaluation results validate that optimal configurations for full-scale target models can be accurately predicted with minimal ablation costs.
3. A Standardized Framework for Machine Learning in Power System Protection
电力系统保护中机器学习的标准化框架
AI 总结:该研究提出电力系统保护机器学习的标准化框架,明确7个评估维度,通过PROTECT-90基准案例验证MLP等模型性能,为机器学习电力系统保护的可复现、可审计评估提供基础。
链接:https://arxiv.org/abs/2608.20181
机构:Friedrich-Alexander-Universität Erlangen-Nürnberg(弗里德里希-亚历山大-埃尔兰根-纽伦堡大学); Ostbayerische Technische Hochschule Amberg-Weiden(东巴伐利亚应用技术大学安贝格-魏登分校)
作者:Julian Oelhaf, Georg Kordowich, Paula Andrea Pérez-Toro, Christian Bergler, Johann Jäger, Andreas Maier, Siming Bayer
英文摘要: Studies of machine-learning-based power-system protection increasingly report near-perfect scores, yet the meaning of those scores depends strongly on the evaluation setting. Protection task, physical scope, measurements, timing, targets, preprocessing, and validation often vary jointly and remain incompletely specified. This paper proposes a standardization-oriented framework that treats evaluation design as part of the scientific contribution. It defines seven required study dimensions: protection objective, physical scope, observability, timing and decision windows, targets and sample validity, validation protocol, and evaluation outputs. The framework is instantiated in a bounded case study on the public PROTECT-90 electromagnetic-transient benchmark, comprising 9022 simulated episodes from a 90 kV double-line topology, for onset-conditioned fault classification and localization. Under centralized sensing, simulation-metadata-aligned 20 ms windows, and episode-grouped validation, a multi-layer perceptron (MLP) achieved a five-fold mean macro-averaged F1 score of 0.991 +/- 0.001 for classification and a localization mean absolute error of 10.20 +/- 0.25% of line length (mean +/- std across episode-grouped folds). Extending the decision horizon to 50 ms preserved this task-dependent performance asymmetry, while reduced observability approximately doubled the MLP localization error but had little effect on classification. A synchronized two-ended conventional locator outperformed the learning locators under its richer clean information set, and measurement degradation showed that clean predictive performance did not determine robustness. The framework turns evaluation assumptions into explicit, reproducible evidence and provides a basis for more comparable, auditable evaluation and future certification-oriented assessment of machine-learning protection functions.
2. 表示学习、自监督与对比学习 | 1 篇
4. Quantifying Event Impacts on Time Series via Multiscale Contrastive Learning
基于多尺度对比学习量化事件对时间序列的影响
AI 总结:本文提出多分辨率框架EventTime,结合多维度信息与动态对比目标,在自主构建的SECURE数据集上,实现了对网络安全事件后短期金融异常损失的更精准估计。
链接:https://arxiv.org/abs/2608.19447
机构:Rutgers University(罗格斯大学); NEC Laboratories America(美国NEC实验室)
作者:Yiming Sun, Shengyu Chen, Zhengzhang Chen, Haoyu Wang, Xiaowei Jia, Haifeng Chen
英文摘要:Shocks that spread through the web, such as cybersecurity breach disclosures, can abruptly disrupt financial time series and cause substantial abnormal losses. While these events are disclosed as discrete records through news reports, regulatory filings, or public databases, their consequences unfold through continuous market dynamics. This creates an event-conditioned impact prediction problem: given pre-event market history and limited event metadata, the goal is to estimate short-term post-disclosure abnormal loss rather than reconstruct the full post-event trajectory. However, most time-series forecasting models focus on endogenous regularities such as trend, seasonality, and autocorrelation, and thus struggle with rare and heterogeneous external events. The challenge is further amplified by sparse high-impact events and background market noise. We introduce EventTime, a multi-resolution framework that combines long-horizon market context, short-horizon pre-event dynamics, and event metadata. It incorporates an event fusion module that couples temporal representations with event attributes to identify relevant recent market patterns. To mitigate sparse supervision, EventTime further introduces a dynamic contrastive objective that constructs event- and time-series-aware positive and negative pairs during training. We also construct SECURE, a real-world dataset aligning cybersecurity incidents with stock-market time series and structured and LLM-derived semantic features. Experiments show that EventTime consistently outperforms state-of-the-art time-series and event-aware baselines in estimating post-event financial losses. Further analyses demonstrate more event-sensitive representations, greater robustness to incomplete metadata, and more interpretable estimates of short-term market impact following cybersecurity disclosures.
3. 强化学习与序列决策 | 5 篇
5. Unregularized Convergence of Single-Loop, Entropy-Regularized Natural Actor-Critic
单循环熵正则化自然演员-评论家算法的无正则化收敛性
AI 总结:本文分析单循环熵正则化自然演员-评论家算法,通过指数平移机制实现无正则化收敛加速,在随机和确定性场景中均突破传统统计屏障。
链接:https://arxiv.org/abs/2608.19587
机构:Rutgers University(罗格斯大学)
作者:Zhiqiang Tan
英文摘要:While entropy regularization is widely used to stabilize and accelerate Natural Policy Gradient methods, its ability to yield faster convergence rates for the unregularized objective remains underexplored. Existing analyses often rely on double-loop architectures and invoke a linear entropy penalty. To bridge the gap between theory and practice, we analyze a single-loop, entropy-regularized Natural Actor-Critic algorithm under compatible linear function approximation. By training an uncentered critic, our critic tracking can remain stable even as the training policy approaches determinism and the Fisher information matrix degenerates. We focus on two primary regimes for the optimization landscape: a Stochastic Regime, where we fuse coupled actor-critic updates into a joint Lyapunov recurrence, and a Deterministic Regime, where we pivot to a Policy Mirror Descent framework to circumvent the collapse of Euclidean geometry. By exploiting a positive Minimal Action Gap in the unregularized Markov decision process, we introduce an Exponential Translation mechanism that maps the regularized gap to the unregularized one up to an exponentially decaying tail. By tuning the fixed temperature, our algorithm achieves accelerated unregularized convergence rates, up to approximation-error terms: $\tilde{\mathcal{O}}(T_{total}^{-1})$ in the Stochastic Regime, and $\tilde{\mathcal{O}}(T_{total}^{-2/3})$ for the average iterate alongside $\tilde{\mathcal{O}}(T_{total}^{-1/3})$ for the last iterate in the Deterministic Regime. Here, $T_{total}$ denotes the total number of stochastic critic updates (or Monte Carlo rollouts). Furthermore, in the tabular setting, our positive-action-gap analysis yields a $\tilde{\mathcal{O}}(T_{total}^{-2/3})$ average-iterate rate, surpassing the $\mathcal{O}(T_{total}^{-1/2})$ worst-case statistical barrier that applies without a positive action margin.
6. Time-Uniform Self-Normalized Concentration for Discounted Least Squares: Limits and Corrections
折扣最小二乘的时间一致自归一化集中性:极限与修正
AI 总结:本文针对折扣最小二乘的时间一致自归一化集中性,指出现有加权扩展的证明错误,修正了有限与无限时间的边界,为相关强化学习等下游分析提供了理论基础。
链接:https://arxiv.org/abs/2608.19643
机构:Research Center for Information Technology Innovation, Academia Sinica(中央研究院资讯科技创新研究中心)
作者:Yi-Shan Wu
英文摘要: Self-normalized concentration inequalities are standard tools in bandit and reinforcement-learning analyses. A widely used weighted extension claims an analogous time-uniform guarantee for discounted least-squares estimators in non-stationary problems. A simple scalar Gaussian counterexample with a fixed parameter shows that the claimed bounded radius is crossed with probability one. For fixed discount and regularization parameters, we further show that, when $\delta\leq1/2$ and $T/\delta$ is sufficiently large, any deterministic anytime boundary valid uniformly over the stated conditionally sub-Gaussian model class must be at least of order $R\sqrt{\log(T/\delta)}$ at some time by horizon $T$; for nondecreasing boundaries, this order is required at time $T$. We identify the proof error: different terminal times use different Gaussian mixing distributions, so the fixed-time mixtures do not form one supermartingale, and the stopping-time argument does not repair this failure. Finally, we show that the weighted inequality remains valid at each fixed deterministic time, give valid finite- and infinite-horizon corrections, and discuss consequences for downstream analyses.
7. Adaptive Probabilistic Shielding by Learning MDPs for Safe Reinforcement Learning
通过学习马尔可夫决策过程(MDP)实现自适应概率屏蔽用于安全强化学习
AI 总结:本文针对已知MDP转移图但转移概率未知的场景,提出将概率屏蔽与在线模型学习结合的自适应方法,通过实验验证其在安全强化学习中的有效性。
链接:https://arxiv.org/abs/2608.19836
机构:Aalborg University(奥尔堡大学); Radboud University(拉德堡德大学); Ruhr University Bochum(波鸿鲁尔大学)
作者:Astrid Horn Brorholt (1), Maris F. L. Galesloot (2), Nils Jansen (2) (3), Kim Guldstrand Larsen (1), Christian Schilling (1) ((1) Aalborg University, Aalborg, Denmark (2) Radboud University, Nijmegen, Netherlands (3) Ruhr University Bochum, Bochum, Germany)
英文摘要:Probabilistic shielding is a technique for safe reinforcement learning (RL). Typically, a static observer -- called the shield -- constrains the learning agent's actions to those for which acting safely remains feasible. Traditionally, the shield is computed from the transition probabilities of the underlying Markov decision process (MDP). Thus, this technique is not applicable when the MDP model is not given a priori, which, unfortunately, is the case in typical RL applications. In this paper, we study the problem of computing a shield in the setting where the transition graph of the MDP is known, but the transition probabilities are unknown. Our approach integrates probabilistic shielding with online model learning: as the RL agent explores the environment, we estimate the transition probabilities. From this estimate, we compute a shield. While the shield may be conservative initially, it adapts as the model estimate becomes more precise. Thus, the shield improves in tandem with the RL agent. This paradigm of adaptive probabilistic shielding raises a number of challenges, such as when to recompute the shield and how to balance between exploration and safety during learning. We empirically evaluate multiple variants of this paradigm across several environments.
8. Inadvertent Context Leakage in Language Models
语言模型中的无意上下文泄漏
AI 总结:该研究发现语言模型的上下文窗口会无意泄漏敏感用户信息,提出自适应攻击方法,在8个专有模型上验证了2、4位数秘密的重建准确率,还展示了两种实际攻击方式,指出泄漏是模型能力的副产品。
链接:https://arxiv.org/abs/2608.19857
机构:FAIR, Meta Superintelligence Labs(Meta超级智能实验室FAIR); University of California, Berkeley(加利福尼亚大学伯克利分校); Google DeepMind(谷歌DeepMind)
作者:Jaiden Fairoze, Neal Mangaokar, Kamalika Chaudhuri, Sanjam Garg, Saeed Mahloujifar
英文摘要:For AI agents to be useful beyond simple chat, they must hold sensitive user context such as calendars, credentials, health records, and financial data. We study whether the mere presence of such secrets in a model's context window introduces hidden correlations into the model's benign outputs, allowing reconstruction even when the model correctly refuses direct extraction. We further study whether an adversary can actively engineer prompts that amplify this effect, using the model as a covert carrier to transmit secrets through seemingly innocuous text. In both cases, this limited leakage is exploited using a novel adaptive attack that assumes black-box access to the underlying model. In controlled experiments across eight proprietary models, we find that 2-digit in-context secrets are reconstructed with near-perfect accuracy and 4-digit secrets at 82\% exact match, all from outputs the model produces in response to ordinary, non-adversarial requests. We observe that more capable models leak more: stronger instruction-following amplifies sensitivity to in-context secrets, suggesting leakage is a byproduct of capability as opposed to a patchable bug. We show this leakage enables two practical attacks: (1) a trained classifier that infers semantic predicates about user memories (e.g., health conditions, financial events) from routine natural-language outputs, and (2) an RL-trained adversary that extracts full Social Security Numbers from a production-style agent.
9. End-to-end Early Classification of Time Series in Non-Stationary Environments
非平稳环境下时间序列的端到端早期分类
AI 总结:本研究针对非平稳环境下的时间序列早期分类问题,提出基于强化学习的DQeND端到端架构,联合学习表示、分类与触发决策,其鲁棒性和性能优于可分离基线,验证了端到端学习的优势。
链接:https://arxiv.org/abs/2608.20044
机构:Orange Research(奥朗日研究中心); AgroParisTech(巴黎高等农业工程师学院)
作者:Aurélien Renault, Alexis Bondu, Antoine Cornuéjols, Vincent Lemaire
英文摘要:Early Classification of Time Series (ECTS) requires making accurate decisions as early as possible in inherently online and evolving environments. Yet, most existing methods assume stationarity and rely on separable designs, where classification and triggering are optimized independently, an assumption that fundamentally limits their adaptability under drift. In this work, we challenge this paradigm and study ECTS under non-stationary conditions. We provide the first systematic comparison between separable and end-to-end approaches across controlled drifting scenarios. Building on Reinforcement Learning, we introduce DQeND, a unified architecture that jointly learns representation, classification, and triggering decisions, while remaining directly comparable to state-of-the-art separable baselines. Across a wide range of drifts, DQeND demonstrates strong robustness across various non-stationary scenarios, consistently outperforming separable baselines. An ablation study further highlights that jointly updating representation and decision modules is critical to these gains. Overall, our results indicate that end-to-end learning can offer improved adaptation capabilities for ECTS in dynamic environments, and motivate further investigation of alternatives to separable designs.
4. 生成模型与概率建模 | 1 篇
10. Unsupervised Anomaly Detection Using Flow Matching on Tabular Data
基于表格数据的流匹配无监督异常检测
AI 总结:本研究针对受污染训练数据下的表格异常检测,对比TCCM与Forest-Flow,发现轨迹类异常评分更稳定,Forest-Flow表现可与TCCM媲美甚至更优,凸显异常评分的重要性。
链接:https://arxiv.org/abs/2608.19801
机构:University of Mannheim(曼海姆大学); MPI for Informatics(马克斯·普朗克信息学研究所); Saarland Informatics Campus(萨尔兰信息学园区)
作者:Philip Konz, Tejaswini Medi, Margret Keuper
英文摘要:Financial anomaly detection often relies on large unlabeled transaction logs, where anomalous samples may already be present during training. Such training-set contamination violates the clean-normal data assumption underlying many anomaly detection methods. Although flow matching has demonstrated strong performance in generative modeling, its robustness in unsupervised tabular anomaly detection remains underexplored. In this work, we study flow-matching-based anomaly detection under contaminated training data by comparing Time-Conditioned Contraction Matching (TCCM) with Forest-Flow and evaluating multiple anomaly scoring functions. Our results show that the choice of anomaly score is critical. The original single-step Decision score used by TCCM is sensitive to contamination, whereas trajectory-based Deviation and Reconstruction scores provide more stable anomaly signals. With these scores, Forest-Flow becomes competitive with, and in some cases outperforms, TCCM. These findings highlight the importance of anomaly scoring for flow-matching methods in financial anomaly detection under severe class imbalance.
5. 优化、泛化与理论分析 | 2 篇
11. Quantum Kernel Estimation for the Discovery of Early Lung Cancer Detection
用于早期肺癌检测发现的量子核估计
AI 总结:本研究将量子-经典混合机器学习应用于 cfDNA 肺癌检测,通过量子核方法分析 DNA 片段组学与甲基化数据,其在部分任务中性能优于经典模型,为早期肺癌检测提供了新途径。
链接:https://arxiv.org/abs/2608.19304
机构:Cleveland Clinic Research(克利夫兰诊所研究院); IBM Quantum(IBM量子计算部门); IBM Thomas J Watson Research Center(IBM托马斯·J·沃森研究中心); Pulmonary Department, Cleveland Clinic(克利夫兰诊所肺科)
作者:Hamed Javidi, Alex Zajichek, Hakan Doga, Laxmi Parida, Filippo Utro, Peter J. Mazzone
英文摘要:Lung cancer screening with low-dose chest computed tomography reduces mortality, but its impact is limited by uptake, adherence, and management challenges. Blood-based cell-free DNA (cfDNA) biomarkers offer a complementary approach, although early detection remains difficult because of lung cancer heterogeneity and high-dimensional, nonlinear molecular signals. We evaluated quantum-classical hybrid machine learning for lung cancer detection using DNA fragmentomics and DNA methylation. After feature selection, models were trained using 20- and 40-feature subsets. Features were encoded into quantum Hilbert space using angle and dense-angle feature maps with multiple entanglement strategies. Fidelity-based quantum kernels were computed with exact statevector simulation and integrated with precomputed-kernel SVM and kernel-PCA logistic regression and compared with an SVM model trained on the original features. This framework enabled systematic evaluation of how encoding and entanglement design affect classification. Across repeated held-out evaluations, quantum-kernel models achieved competitive performance on both datasets. For fragmentomics, several 20-feature configurations improved AUC relative to a classical SVM baseline, suggesting effective capture of nonlinear cfDNA fragmentation structure. For methylation, the classical SVM achieved the highest AUC, although selected quantum models remained competitive and improved specificity in some cases. Increasing features from 20 to 40 did not consistently improve performance and often increased variability. Overall, these results support quantum kernel methods as a promising approach for cfDNA-based lung cancer detection.
12. Kähler landscapes for complex neural network descents and guarantees including a search and destroy of the Calabi-Yau manifold
用于复杂神经网络下降的凯勒流形及保证,包括对卡拉比-丘流形的搜索与破坏
AI 总结:该研究将复几何与深度学习结合,以凯勒流形为框架分析复杂神经网络下降的损失景观,揭示卡拉比-丘流形相关特性及负曲率对损失景观的破坏,为深度学习理论提供几何分析视角。
链接:https://arxiv.org/abs/2608.19584
机构:Purdue University(普渡大学)
作者:Andrew Gracyk
英文摘要:We study landscapes for complex-parameterized networks. Our approach is motivated with an information-theoretic manifold perspective of the parameter and via classical optimization guarantees although of complex geometric variety such as through Dolbeault asymptotics. The descent path admits a Kähler information metric under a cross-entropy via the Wirtinger Hessian on the log-likelihood potential. We restrict attention to a descent update rule with natural gradient descent via a differentiated loss scaled by the inverse metric, so the descent path remains in the holomorphic tangent bundle. We emphasize Calabi-Yau information manifolds which profane theoretical guarantees via an ill-curvature-conditioned landscape. Under a Calabi-Yau metric, specifically in a non-compact setting with a global potential so defined geometrically rather than invoking the topological requirements of the Calabi conjecture, a wedged nowhere-vanishing holomorphic form is the top exterior product of the Kähler form up to constants, yielding a constant determinant condition. Under a fixed determinant, a metric almost low rank up to an eigenvalue tolerance implies a blow-up effect. Moreover, it has been discovered that negative curvature subverts the loss landscape, specifically sectional curvature, so we expand on this and draw interconnections to negative-definite Ricci curvature. Our arguments primarily exist in a geometric analytic modality, although we establish roots in deep learning theory such as through asymptotics at initialization and connections through failure modes of neural network guarantees under vanishing and negative Ricci curvature.
6. 高效学习、压缩与部署 | 1 篇
13. Truncate Bad, Upweight Good: BoN-Style Distillation via Rank-Based Classification
截断不良项,提升优良项:基于排名分类的BoN式知识蒸馏
AI 总结:该研究提出TUP策略,通过截断低排名候选、重加权高排名项实现BoN式蒸馏,在离线对齐任务中表现与强基线相当。
链接: https://arxiv.org/abs/2608.19748
机构:Technion–Israel Institute of Technology(以色列理工学院)
作者:Yarin Bar, Yaniv Romano
英文摘要:Inference-time selection methods, such as Best-of-N, improve generation by sampling a pool of candidates and selecting the top-ranked completion according to a reward model. Distillation seeks to amortize this procedure into a single policy by replacing raw rewards with in-pool ranks and learning a policy that upweights higher-ranked completions. However, existing rank-based policies typically use smooth full-support reweighting, so low-ranked completions receive less mass but remain in the target support. Although a sharper reweighting reduces lower-tail mass, it also increases reliance on brittle ranking at the top made by a single reward model. We propose TUP: a Truncate-bad, Upweight-good Policy that removes low-ranked completions from the support and reweights only the retained upper tail with a tunable sharpness. TUP admits a closed-form, prompt-independent normalization and can be trained fully offline via binary cross-entropy, using shifted-truncated win-rates as soft labels and distilled-to-reference log-likelihood ratios as logits. Theoretically, under certain assumptions, we show that for any unknown oracle reward, the best monotone rank-reweighting can be matched by a lower-tail truncation rule, providing formal support for removing the lower tail rather than merely downweighting it. Empirically, we show that TUP is competitive with strong offline alignment baselines.
7. 鲁棒性、不确定性与可信学习 | 2 篇
14. Improved Confidence Estimates for Black-Box Large Language Models
黑盒大型语言模型的改进置信度估计
AI 总结:本研究针对黑盒大型语言模型的不确定性量化问题,利用目标数据集构建基于现有分数和相似查询正确性的简单分类器,以改进置信度估计,且计算开销极小。
链接:https://arxiv.org/abs/2608.19323
机构:Layer 6 AI; TD Insurance(TD保险)
作者:Sokhna Diarra Mbacke, Mouloud Belbahri, Gabriel Loaiza-Ganem
英文摘要:Uncertainty quantification (UQ) is essential for the safe deployment of large language models (LLMs). Existing methods, from verbalized confidence to ones requiring multiple generations, are often zero-shot and produce scores quantifying uncertainty without the need for labelled data. Nonetheless, in practice one must always evaluate their performance on a dataset of interest before deployment. In this work we show that, by leveraging this dataset, we consistently outperform these existing scores. Specifically, we build simple classifiers that predict LLM response correctness by using these scores and the correctness of similar queries as features. Our method produces minimal computational overhead, making it a cheap and straightforward enhancement for UQ in LLMs for real-world applications.
15. MileGPO: Milestone Inference with Local Evidence for Graph-Based Policy Optimization of Long-Horizon LLM Agents
MileGPO:面向长 horizon LLM 智能体的基于图策略优化的里程碑推理
AI 总结:针对长 horizon LLM 智能体强化学习的信用分配难题,提出 MileGPO 方法,通过里程碑发现、RCS、PCC 三项设计提升性能,在 ALFWorld 和 WebShop 上达 SOTA 且分布差距小。
链接:https://arxiv.org/abs/2608.19803
机构:Beijing Jiaotong University(北京交通大学)
作者:Bo Qian, Yuting Wu, Shuang Zeng, Huaiyu Wan, Dalin Zhang, Jiqiang Liu
英文摘要:Credit assignment is challenging in long-horizon agentic reinforcement learning, where supervision often comes only from final rewards. Existing methods refine trajectory-level signals into step-level credits through step grouping or graph-based advantage estimation, but can overlook meaningful intermediate milestones. We propose MileGPO (Milestone Inference with Local Evidence for Graph-Based Policy Optimization), which derives process-level credit from grouped on-policy rollouts through three designs. Milestone Discovery identifies candidate milestones on successful rollouts and recurring traps on failed ones. Reliability-Calibrated Shaping (RCS) weights these candidates by outcome-based confidence, strengthening reliable milestones and traps while down-weighting uncertain ones. Progress-Contrastive Calibration (PCC) further tests whether a candidate reflects local progress and whether its incoming ansition outperforms observed alternatives from the same this http URL requires neither auxiliary models nor additional environment interaction. Experiments on ALFWorld and WebShop show state-of-the-art performance and a small in-distribution to out-of-distribution gap on ALFWorld. Ablations and credit diagnostics indicate that reliability weighting, local progress, and same-state branch evidence complement milestone discovery and resolve ambiguous intermediate credit.
8. 图学习与结构化数据 | 1 篇
16. SAGE-XGBoost: Spatially Augmented Graph Embeddings--Machine Learning Framework for Natural Hazards Susceptibility Mapping under Data Scarcity
SAGE-XGBoost:空间增强图嵌入——数据稀缺条件下的自然灾害易发性制图机器学习框架
AI 总结:本研究针对数据稀缺下自然灾害易发性制图的问题,提出SAGE框架结合XGBoost构建SAGE-XGBoost模型,经滑坡、野火案例验证,其性能优于传统空间机器学习模型,为地理空间预测提供高效可迁移方案。
链接:https://arxiv.org/abs/2608.19672
作者:Mohammad H. Vahidnia, Ali Pourkarimi
英文摘要: Natural hazard susceptibility mapping is often constrained by limited labeled data, reducing the generalizability of conventional machine learning and limiting the applicability of complex deep learning models. This study proposes SAGE (Spatially Augmented Graph Embeddings), a structurally informed feature-engineering framework that combines controlled noise-based data augmentation with neighborhood-based graph embeddings to improve prediction under data-scarce conditions. A K-nearest neighbor graph is constructed to derive local spatial statistics, which are reduced using principal component analysis and integrated with environmental covariates and spatial coordinates. The resulting features are used with XGBoost to develop the SAGE-XGBoost model. The framework was evaluated for landslide and wildfire susceptibility mapping. SAGE-XGBoost consistently outperformed conventional and spatially explicit machine learning models. Compared with Spatial XGBoost, it achieved an absolute improvement of above 33 percentage points across the two case studies. The model reached AUC values of approximately 0.97 for landslide susceptibility and 0.95 for wildfire susceptibility. Feature importance analysis confirmed the contribution of graph embeddings to prediction, while their integration improved spatial coherence and reduced local noise amplification. Overall, SAGE-XGBoost provides an efficient and transferable alternative to deep representation learning for environmental hazard assessment and other geospatial prediction tasks under limited supervision.
9. 迁移、元学习与持续学习 | 5 篇
17. In Two Minds about Lifelong Learning: Exploring Hemispheric Redundancy and Specialisation in Neural Models
对终身学习的两种思考:探索神经模型中的半球冗余与特化
AI 总结:本文针对机器学习的持续学习挑战,提出4MAS架构,结合经验重放、REM睡眠与双侧性,利用不对称半球的长短时记忆机制,在三个分割数据集上取得有竞争力的准确率。
链接:https://arxiv.org/abs/2608.19514
机构:Monash University(莫纳什大学); CSIRO(联邦科学与工业研究组织); Cerenaut(塞雷诺特公司)
作者:Benjamin Smith, Levin Kuhlmann, Kaushik Roy, Gideon Kowadlo
英文摘要:Persistent intelligent systems require the ability to learn continually, but current machine learning approaches face significant challenges in this area compared to biological learning systems. Machine learning algorithms typically trade off retention of previously learned information and adaptation to new or changing data patterns. When continual learning capabilities are absent, algorithms must undergo retraining using the entire data set, an approach that becomes impractical when original training data are unavailable due to storage constraints, financial or computational costs, or privacy restrictions. However, biological animals can learn continually, without experiencing catastrophic forgetting. This paper attempts to build a high-level framework for how animals learn and preserve knowledge by modelling neural components and states that are known to be related to memory consolidation. We focus on three concepts: experience replay, REM sleep, and bilaterality. We propose 4MAS (4 Module Awake/Sleep), a novel macroarchitecture demonstrating how machine learning models might benefit from asymmetric hemispheres, each with their own long- and short-term memory mechanisms, and how a period of sleep between incremental learning tasks might benefit memory consolidation. Finally, we present results showing that our architecture achieves competitive results on the Split-MNIST, Split-Fashion-MNIST and Split-CIFAR-100 datasets, with 98.3%, 84.9%, and 29.29% accuracy respectively.
18. Online Test-Time Adaptation for Generalizable Dynamic Graph Anomaly Detection
面向可泛化动态图异常检测的在线测试时适应
AI 总结:针对可泛化动态图异常检测现有方法的局限,提出OTTA-DGAD方法,通过时序自图提取动态原型并结合内存缓冲区,在10个真实世界数据集上实现了最优性能。
链接:https://arxiv.org/abs/2608.19858
机构:The Hong Kong Polytechnic University(香港理工大学); Institute of Information Processing and Automation, Zhejiang University of Technology(浙江工业大学信息处理与自动化研究所); University of Illinois at Chicago (UIC)(伊利诺伊大学芝加哥分校)
作者:Jialun Zheng, Hanchen Yang, Jiannong Cao, Yankai Chen, Yuanjing Feng, Philip S. Yu
英文摘要:Generalizable dynamic graph anomaly detection (DGAD) enables pretrained detectors to identify anomalies in unseen target domains without costly retraining. However, existing methods often fail for two reasons. First, they mainly rely on domain-agnostic patterns and miss domain-specific patterns that keep evolving. Second, they assume access to the full target domain data, whereas in more practical online test-time adaptation settings, target data arrive sequentially in unlabeled chunks. To address these limitations, we formulate online test-time adaptation for generalizable DGAD and propose OTTA-DGAD. OTTA-DGAD first extracts dynamic prototypes, i.e., evolving representations of normal and anomalous patterns, from temporal ego-graphs and stores them in a memory buffer. The buffer selectively retains general patterns shared across the source domains used for pretraining while incorporating new patterns from the target domain. An anomaly scorer then compares incoming edge representations against these prototypes to identify both general and domain-specific anomalies. During adaptation, OTTA-DGAD updates the memory buffer using reliable pseudo-labels identified through confidence-based detection. It further enriches each target chunk with relevant representations retained from previous chunks, compensating for information loss resulting from the sequential arrival of data. Extensive experiments under strict test-then-adapt OTTA settings demonstrate state-of-the-art performance on ten real-world datasets from diverse domains.
19. Reliable Neural Collapse Approximation for Open-World Test-Time Adaptation
面向开放世界测试时自适应的可靠神经塌缩近似
AI 总结:针对开放世界测试时自适应的标签分布偏移问题,提出ReNC方法,利用神经塌缩先验过滤分布外样本并优化原型,在多个开放世界基准上表现优越。
链接:https://arxiv.org/abs/2608.19890
机构:Centre for Frontier AI Research, Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局前沿人工智能研究中心); Sun Yat-sen University(中山大学); School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院); School of Mathematics (Zhuhai), Sun Yat-sen University(中山大学(珠海校区)数学学院)
作者:Jia-Qi Lin, Yuangang Pan, Chang-Dong Wang, Haizhang Zhang, Ivor W. Tsang, Joey Tianyi Zhou
英文摘要:Test-Time Adaptation (TTA) methods aim to bridge the domain gap between the source and target domains. However, traditional TTA methods become ineffective when the label distribution shift occurs, a challenge commonly referred to as an open-world scenario. In this paper, we introduce a new method named Reliable Neural Collapse approximation (ReNC) for Open-World Test-Time Adaptation (OWTTA). Specifically, we leverage neural collapse as a structural prior for reliable target-domain adaptation. Guided by this prior, we justify that the pre-trained classifier weights can serve as the prototypes of the source domain. By measuring the similarity between samples and prototypes, we filter out the Out-Of-Distribution~(OOD) samples for reliable updates. Furthermore, we propose a neural collapse approximation mechanism to refine these prototypes, ensuring they can gradually adapt to the target domain while maintaining the neural collapse structure. Extensive experiments on several open-world benchmarks demonstrate the superiority of the proposed method. Our empirical analysis suggests that ReNC better preserves NC-related properties in the target domain, providing useful evidence for explaining reliable OWTTA and offering new insights for model design. Code is available at this https URL.
20. PETA:Parameter-Efficient Test-Time Adaptation for Virtual Screening
PETA:用于虚拟筛选的参数高效测试时自适应方法
AI 总结:本研究提出参数高效测试时自适应框架PETA,仅更新预训练虚拟筛选模型约0.03%的LayerNorm参数,在测试时通过构建特定负样本等方式自适应,性能优于预训练及全重训练基线。
链接:https://arxiv.org/abs/2608.19906
作者:Jia-Qi Lin, Yinghua Yao, Chang-Dong Wang, Yew-Soon Ong, Yuangang Pan
英文摘要:Accurately ranking active ligands for a target protein pocket from massive chemical libraries remains a central challenge in virtual screening. DrugCLIP and its recent extensions substantially accelerate this process by encoding protein pockets and molecules into a shared embedding space. Despite this progress, further performance improvements typically require retraining the entire model, incurring substantial computational overhead and making target-specific customization inefficient. In this work, we formulate the specialization of pretrained virtual screening models to individual pockets as a test-time adaptation problem and propose PETA, a parameter-efficient framework that directly adapts pretrained model at test time. Given a target pocket, PETA constructs pocket-specific negatives through molecular diffusion and chemical validity filtering, and further moves them toward the reference ligand retrieved from structural databases via embedding-space mixup to create more challenging ranking tasks. A ranking objective then places greater emphasis on suppressing high-scoring invalid candidates that could contaminate the top-ranked screening results, providing structured supervision for lightweight adaptation. Experiments across diverse benchmarks demonstrate that this lightweight, pocket-specific adaptation outperforms both pretrained and fully retrained baselines while updating only the LayerNorm parameters, which account for approximately $0.03\%$ of the full model.
21. An Inclusive and Lightweight Approach to Federated Continual Learning for Cultural Heritage
面向文化遗产的联邦持续学习的包容性轻量级方法
AI 总结:针对文化遗产数据分布受限且时序演变的问题,提出轻量级联邦持续学习策略FedCurv-DR,经WikiArt数据集评估可减轻遗忘,平衡性能、公平性与能效。
链接:https://arxiv.org/abs/2608.20038
机构:Information Technologies Institute, Centre for Research and Technology Hellas(希腊研究与技术中心信息技术研究所); School of Electronic Engineering and Computer Science, Queen Mary University of London(伦敦大学玛丽女王学院电子工程与计算机科学学院)
作者:Ioannis Theologitis, Debin Meng, Stylianos Eleftheriadis, Vasileios Lolis, Konstantinos Votis
英文摘要:Artificial intelligence can support cultural heritage and digital humanities through large-scale retrieval and analysis of digitized collections. However, cultural heritage data are often distributed across institutions, constrained by ownership and access restrictions, and continuously evolving over time. Federated Continual Learning (FCL) is well suited to this setting, as it enables models to learn from distributed and sequential data without sharing raw collections. In this paper, we propose FedCurv-DR, a lightweight, regularisation-based FCL strategy. The method accumulates parameter-importance estimates across clients and experiences to protect learned knowledge, while updating them only at fixed intervals to minimize communication and computation overhead. We evaluate FedCurv-DR in a continual learning scenario using the WikiArt image dataset for genre classification with evolving styles, reporting performance, energy, and fairness metrics. Our results show that FedCurv- DR reduces forgetting and balances performance, fairness, and energy efficiency for sustainable AI in cultural heritage.
10. 数据集、基准与评测 | 3 篇
22. Holtercare-Bench: A Multimodal Benchmark for Evaluating Long-Term Dynamic ECG Analysis
Holtercare-Bench:用于评估长期动态心电图分析的多模态基准
AI 总结:该研究针对现有多模态大语言模型在长期动态心电图分析中的不足,构建了含22980个问答对的Holtercare-23K数据集及Holtercare-Bench基准,评估发现零样本模型处理超长病理序列性能差,微调后提升显著,为长期医疗多模态大语言模型提供基础基准。
链接:https://arxiv.org/abs/2608.19297
机构:Zhejiang University(浙江大学); Beijing Institute of Technology(北京理工大学); University of Electronic Science and Technology of China(电子科技大学)
作者:Yihan Xie, Hanwen Cui, Runze Ye, Juekai Lin, Haoyang Wang, Jinhao Mao, Bo Zhang, Wenqiao Zhang, Xiaogang Guo, Jun Xiao, Lei Zhang
英文摘要:While multimodal large language models (MLLMs) excel in medical applications, most of them favor static images or short-term signals. In the critical field of dynamic electrocardiograms (ECG), models struggle with complex temporal reasoning and diagnostic report generation due to a lack of high-quality datasets and benchmarks. To address this, we introduce (i) Holtercare-23K, a large-scale multimodal dynamic ECG dataset comprising 22,980 QA pairs derived from 788 clinical Holter records and featuring a novel signal-video-text tri-modal alignment. Based on this dataset, we present (ii) Holtercare-Bench, a multimodal benchmark that evaluates models on temporal localization, clinical diagnosis, and global summarization. Zero-shot evaluations of leading MLLMs reveal a significant performance gap in processing ultra-long pathological sequences. However, fine-tuning representative models yields substantial improvements. This work illuminates the limitations of current MLLMs in electrophysiology and provides a foundational benchmark for long-term medical MLLMs. Our project is available at this https URL.
23. When to Retrain: An Empirical Study of Retraining Policies for Streaming ML Under Concept Drift, Budget, and Latency Constraints
何时重新训练:针对概念漂移、预算与延迟约束下的流式机器学习重新训练策略的实证研究
AI 总结:该研究对比三种模型刷新策略与不重新训练基准,发现增量学习是关键,无增量时定期重新训练在多数场景优于反应式策略,还揭示反应式策略失效模式及延迟预算交互问题。
链接:https://arxiv.org/abs/2608.19488
作者:Sawan Dasari
英文摘要: Production machine learning systems degrade under concept drift, yet practitioners have little principled guidance on when to retrain. Retraining is costly, retraining budgets are finite, and a retrained model does not take effect instantly: training and deployment latency leave a stale model serving predictions while the data continues to move. We present a controlled empirical study of three practical model-refresh policies (periodic retraining, error-threshold triggering, and statistical drift-triggered retraining with ADWIN) against a no-retrain baseline, evaluated under a unified system model that makes retraining budgets and training-plus-deployment latency explicit. Across 3,933 experiment runs spanning three drift regimes, three budget levels, up to five latency levels, three datasets, and two learning modes, we find that the single most consequential design decision is not the retraining policy but whether the deployed model learns incrementally. With per-sample incremental updates, and for the linear online learner with immediate labels studied here, no policy differs from the no-retrain baseline by a practically significant margin in any of 54 paired comparisons, even at extreme latency. Without incremental updates, policy choice separates outcomes by 15-55 percentage points of post-drift accuracy, and simple periodic retraining significantly outperforms both reactive policies under abrupt and gradual drift, while reactive policies retain an advantage only under recurring drift. We document systematic failure modes of reactive policies and a latency-budget queueing interaction that silently halves effective retraining budgets, and release the full simulator, dataset pipelines, and per-run artifacts for reproducibility.
24. DeltaML-Bench: Evaluating Machine Learning Agents on Real-World Research Repositories
DeltaML-Bench:基于真实研究仓库评估机器学习智能体
AI 总结:该研究推出DeltaML-Bench基准,评估发现基于搜索的ARG框架可提升GPT-5在机器学习实验任务中的成功率,且能避免规范博弈,为自主ML智能体部署提供了关键考量
链接:https://arxiv.org/abs/2608.19653
机构:Algorithmic Research Group(算法研究组)
作者:Josias Moukpe, Priyanka Aryal, Matthew Kenney
英文摘要:Autonomous agents for machine learning experimentation must navigate heterogeneous repositories, repair training pipelines, and evaluate candidate improvements under realistic compute constraints. Existing benchmarks only partially capture these conditions. We introduce DeltaML-Bench, a benchmark comprising 48 tasks sourced from research papers that require agents to improve published baselines within imperfect, open-source repositories. We evaluate GPT-5 and Claude Sonnet 4 with a standard Modular agent and a search-based ARG scaffolding. In the 4 x 6h allocation, ARG raises GPT-5's per-run success rate from 9.4% to 33.9%; in the 2 x 12h allocation, GPT-5 ARG reaches 49.0%. Modular configurations exhibit specification gaming rates as high as 47.9%, while no gaming is observed in the evaluated ARG configurations. These results indicate that scaffolding design and integrity checks are important considerations when deploying agents for autonomous ML experimentation.
11. 机器学习应用 | 8 篇
25. LLM as Detector: An In-context Learning Approach for Tabular Anomaly Detection
作为检测器的大语言模型:一种用于表格异常检测的上下文学习方法
AI 总结:本研究提出LLM-Detector框架,利用LLM的上下文学习能力进行表格异常检测,在24个数据集上对比15个SOTA基线均获提升,且无需微调或神经网络训练,降低了计算成本。
链接:https://arxiv.org/abs/2608.19463
机构:Applied Artificial Intelligence Initiative (A2I2), Deakin University(应用人工智能计划(A2I2),迪肯大学); Adelaide University(阿德莱德大学); Monash University(莫纳什大学)
作者:Tu Anh Hoang Nguyen, Dang Nguyen, Thuc Duy Le, Trung Le, Sunil Gupta
英文摘要:Anomaly detection in tabular data is challenging because abnormal samples often arise as violations of cross-feature dependencies rather than simple marginal deviations. Existing detectors rely on geometric or reconstruction signals, while prior LLM-based approaches mainly fine-tune LLMs with normal samples or generate synthetic anomalies. We propose LLM-Detector, a framework that utilizes the in-context learning capacity of LLMs for structured, prompt-conditioned scoring synthesis, enabling LLMs to derive anomaly detection logic from structured normal-state knowledge. Specifically, normal training data are converted into statistical summaries, causal dependencies, and distilled prototypes that are organized into a prompt for code generation. The resulting scoring engine evaluates statistical deviation, structural inconsistency, and density-based abnormality then computes an anomaly score for each test sample. We evaluate LLM-Detector on 24 tabular datasets, comparing against 15 SOTA baselines. Results show consistent improvements across both mixed-type and continuous-only settings. Moreover, this design eliminates the need for LLM fine-tuning or neural network training, reducing computational cost and enabling practical anomaly detection in real-world tabular systems.
26. Empirical Characterization of Learning Geometry in Hybrid Quantum Forecasting Models
混合量子预测模型中几何学习的实证表征
AI 总结:该研究对比混合量子预测模型与经典基线,通过NTK分析其学习动态,发现二者泛化能力相当但学习轨迹不同,混合模型参数量更少且多数频率条件下收敛更快。
链接:https://arxiv.org/abs/2608.19497
机构:CINVESTAV Guadalajara(墨西哥国立理工学院瓜达拉哈拉分校); Cinvestav Unidad Tamaulipas(墨西哥国立理工学院塔毛利帕斯分校)
作者:Sandra Leticia Juárez-Osorio, Jorge I. Hernandez-Martinez, Jesus Ivan Ruiz-Martinez, Andres Mendez-Vazquez, Eduardo Rodriguez-Tello
英文摘要:We characterize the learning dynamics of a compact hybrid quantum forecasting model through comparison with a structurally aligned classical baseline. Using stationary harmonic-mixture and nonstationary chirp benchmarks with controlled spectral complexity and data availability, we analyze empirical Neural Tangent Kernel dynamics through kernel-target alignment, kernel drift, spectral concentration, and training loss. The classical model exhibits stronger early target alignment, whereas the hybrid model generally develops a less concentrated kernel spectrum and smaller kernel drift. Despite these distinct optimization geometries, both architectures attain similar held-out performance across the evaluated regimes. Notably, the hybrid model uses 125 trainable parameters compared with 281 for the classical baseline and reaches its validation-selected checkpoint earlier in 15 of 18 frequency conditions. A Fourier-augmented classical baseline does not reproduce the observed training behavior, while a controlled re-uploading ablation shows that repeated encoding systematically modifies both optimization and kernel geometry. These results demonstrate that comparable generalization can emerge from substantially different learning trajectories and that individual NTK diagnostics do not provide monotonic predictors of validation convergence. Rather than claiming a general quantum advantage, the study identifies architecture-dependent learning behavior that is masked by endpoint accuracy alone.
27. Complementary, Not Cumulative: Interaction Effects in Physics-Informed Neural Networks for Navier-Stokes Vortex Shedding
互补而非累积:用于Navier-Stokes涡脱的物理信息神经网络中的交互效应
AI 总结:本文针对Navier-Stokes涡脱问题,研究物理信息神经网络(PINN)技术的交互效应,发现仅周期性激活函数(SIREN)与因果加权结合可实现4.1%的平均相对L2误差,额外添加技术会导致性能下降,说明PINN干预措施存在非线性交互。
链接:https://arxiv.org/abs/2608.19632
作者:Devesh Shah
英文摘要:Physics-informed neural networks (PINNs) embed governing partial differential equations directly into the training loss, offering a promising alternative to costly CFD solvers for unsteady flows. Yet the growing list of techniques proposed to improve PINN training is typically validated one at a time, leaving open whether these techniques actually compose. We study this question in depth on the DFG/Schafer-Turek unsteady cylinder wake benchmark. In isolation, nearly every technique performs no better than an untreated baseline. However, combining periodic (SIREN) activations with causal weighting unlocks a previously inaccessible regime, reconstructing velocity and pressure fields to within 4.1% average relative L2 error against an OpenFOAM reference solution. Adding further techniques instead causes catastrophic performance degradation, demonstrating that individually effective PINN interventions can interact nonlinearly and that more elaborate training recipes are not necessarily better.
28. FAR-DPO: Feasibility-Aware and Robust Direct Preference Optimization for Cyclic Peptide Design
FAR-DPO:用于环肽设计的可行性感知与鲁棒直接偏好优化
AI 总结:FAR-DPO是一种架构无关的环肽设计框架,通过可行性感知偏好构建与难度感知分组鲁棒优化,在CPSea LNR基准测试中提升了环肽设计的可行性与结合性能。
链接:https://arxiv.org/abs/2608.19808
作者:Guofeng Zhang, Rong Han, Xiaoyu Wang, Zhiyun Li, Zongbo Han, Xiaohong Liu, Guangyu Wang
英文摘要:Cyclic peptides are emerging as promising molecular scaffolds in drug discovery due to their high binding affinity and structural stability. However, extending generative models from linear to cyclic peptide design remains challenging, as cyclization sharply restricts the feasible design space through coupled geometric and biophysical constraints. Moreover, limited training data has led existing approaches to rely largely on zero-shot generation or post hoc filtering, resulting in low yields of feasible designs and limited control over multi-objective trade-offs. To address these limitations, we propose FAR-DPO (Feasibility-Aware and Robust Direct Preference Optimization), an architecture-agnostic framework that steers generative models toward structurally and biophysically feasible cyclic peptide designs, particularly for challenging targets. FAR-DPO integrates feasibility-aware preference construction with difficulty-aware group-robust optimization. Specifically, it constructs within-target preference pairs through feasibility-gated multi-objective dominance and adaptively reweights predefined difficulty groups according to their current preference losses. On the CPSea LNR benchmark, under a fixed generation budget, FAR-DPO increases overall success rate from 46.89% to 57.79% on PepGLAD and from 47.96% to 49.57% on PepFlow. These gains also extend to the hardest target quartile and are accompanied by more favorable best-per-target binding scores. Together, these results demonstrate FAR-DPO's effectiveness in improving feasibility and target-wise robustness.
29. Systematic Evaluation of TabPFN-TS for Zero-Shot Probabilistic Heat Load Forecasting in District Heating Networks
系统评估TabPFN-TS在区域供热网络零样本概率热负荷预测中的应用
AI 总结:本研究系统评估TabPFN-TS用于区域供热网络零样本概率热负荷预测,确定了最优配置,其性能接近Chronos-2且校准更好,相关发现推动了多分辨率残差校正预测器的开发。
链接:https://arxiv.org/abs/2608.20024
机构:RWTH Aachen University(亚琛工业大学); Process Systems Engineering(过程系统工程); Chair of Energy Efficient Buildings Indoor Climate(节能建筑室内气候主席席位)
作者:Ben Spoek, Karim K. Ben Hicham, Kai Derzsi, Philipp Althaus, Alexander Mitsos, Dirk Müller
英文摘要:District heating energy hubs require reliable heat load forecasts for efficient operational scheduling. Conventional forecasting workflows train system-specific models on historical data, which can become burdensome when networks change through new consumers, retrofits, or changing operating regimes. Zero-shot time-series foundation models and in-context forecasting offer a promising alternative: they can adapt at inference time from recent observations rather than by repeated retraining. This study systematically evaluates TabPFN-TS against time-series foundation models and trained machine-learning baselines for probabilistic heat load forecasting in district heating networks. Unlike foundation models pretrained on large collections of real time series, TabPFN-TS relies on synthetic pretraining data, which avoids direct pretraining-test overlap but raises the question of whether the learned prior captures district heating dynamics. We analyze covariate choice, context length, temporal resolution, and prediction horizon on representative operating weeks, validate the selected configuration over a full year, and test transferability on a second network. The results identify hourly 24-hour forecasting with a 12-week rolling context and ambient temperature as a parsimonious high-performing configuration; longer context windows do not improve accuracy. TabPFN-TS remains close to Chronos-2 in deterministic accuracy, reaching CVRMSE values of 13.06% versus 12.48% on the main dataset, and lies within the critical-difference threshold in the daily-rank comparison. Although Chronos-2 achieves the lowest aggregate full-year error, TabPFN-TS shows better empirical calibration. Finally, the diagnostic findings motivate a Multi-Resolution Residual-Correction Forecaster that combines a low-frequency Base Forecaster with a short-horizon Residual Forecaster to improve longer-horizon planning accuracy.
30. CLaST: Context-aware Contrastive VAE for Probabilistic Time Series Forecasting
CLaST:用于概率时间序列预测的上下文感知对比变分自编码器
AI 总结:该研究针对概率时间序列预测中传统模型难以捕捉时间依赖的问题,提出上下文感知对比VAE框架CLaST,通过对比损失学习上下文相似嵌入,在9个基准测试中均优于基线方法,短期与长期预测的CRPS、NMAE均有显著提升。
链接:https://arxiv.org/abs/2608.20025
机构:Applied AI Institute(应用人工智能研究所)
作者:Alexander Marusov, Dmitry Anikin, Petr Sokerin, Vitaliy Pozdnyakov, Ilya Kuleshov, Alexey Zaytsev
英文摘要: Probabilistic forecasting models are widely used for time series forecasting in domains such as energy systems, finance, medicine, and transportation. In recent years, deep generative models have shown strong results on probabilistic forecasting, yet many conventional approaches struggle to capture internal temporal dependencies, leading to latent representations with limited expressive power. To address this limitation, we propose \textit{CLaST}, a VAE framework for probabilistic multivariate time series forecasting. Unlike existing generative models, CLaST learns embeddings that preserve contextual similarity between observations through our contrastive loss function. Experiments across nine widely adopted benchmarks demonstrate that CLaST consistently surpasses strong baseline methods. In short-term forecasting tasks, our approach achieves improvements of up to $16.4\%$ in CRPS and $14.4\%$ in NMAE over the second-best method. Furthermore, in long-term prediction CLaST attains superior overall performance, exceeding the second-best method by up to $48.6\%$ and $25.1\%$ in CRPS and NMAE, respectively.
31. DecoVAE: a Lightweight Interpretable Trend-Seasonal VAE Framework for Efficient Probabilistic Time Series Forecasting
DecoVAE:用于高效概率时间序列预测的轻量级可解释趋势-季节VAE框架
AI 总结:DecoVAE是一种轻量级可解释的趋势-季节VAE框架,通过分解时间序列的趋势与季节组件解决概率时间序列预测的局限,在7个真实基准上精度优于基线且效率显著提升。
链接:https://arxiv.org/abs/2608.20052
机构:Applied AI Institute(应用人工智能研究所)
作者:Alexander Marusov, Dmitry Anikin, Alexey Zaytsev
英文摘要:Probabilistic time series forecasting remains challenging, largely because modeling distinct trend and seasonal dynamics requires specialized approaches. Existing methods often fail to capture the unique inner properties of these components, lack interpretability, or suffer from heavy memory and runtime overhead. To address these limitations, we propose DecoVAE, a lightweight interpretable trend-seasonal VAE framework that explicitly decomposes time series into trend and seasonal components by applying domain-specific inductive biases. The trend stream enforces structural smoothness using a differential regularizer on the latent trajectory, analogous to the Hodrick-Prescott filter. Concurrently, the seasonal stream operates in the frequency domain via a complex Gaussian VAE, natively capturing the amplitude and phase of periodic patterns. Extensive evaluations across seven real-world benchmarks show that DecoVAE consistently outperforms strong baselines. It achieves reductions of up to 14.96\% in CRPS and 23.30\% in NMAE for short-term forecasting, and up to 52.68\% and 26.51\% for long-term horizons. Crucially, DecoVAE yields these accuracy gains while remaining highly efficient, reducing model weight by up to 93\% and accelerating speed by up to 74\% compared to the second-best method.
32. Explainable Transformer Models for Clinical Prediction Tasks on Structured Electronic Health Records
用于结构化电子健康记录临床预测任务的可解释Transformer模型
AI 总结:研究针对结构化EHR预测模型的可解释性缺口,提出BERT-LER模型,在EHRShot等任务中性能优于多数基准模型,归因符合临床风险因素,可推广至多领域。
链接:https://arxiv.org/abs/2608.20315
机构:Sanofi(赛诺菲); Carnegie Mellon University(卡内基梅隆大学)
作者:Jun Ni Du, Lukas Adamek, Maxim Kryukov, Flavio Dormont, Ziv Bar-Joseph, Sven Jager, Brandon Rufino
英文摘要:Predictive models over structured electronic health records (EHRs) remain central to machine learning for healthcare, but few have jointly emphasized quantitative laboratory information and interpretability with respect to input medical events. We present BERT-LER, a BERT-style model for coded EHR timelines pretrained and fine-tuned from a de-identified EHR dataset of 75 million patients, that encodes laboratory test results as discrete tokens while retaining graded information through percentile-based binning, paired with Integrated Gradients for token-level attributions grounded in the input EHR sequence. We benchmark our approach on the public EHRShot benchmark suite and on an asthma severity progression study based on real-world data. This addresses a methodological gap in EHR foundation-style modeling by unifying laboratory value representation and explainability in a single framework, while assessing whether both predictive performance and explanations generalize beyond standard clinical prediction tasks. Across EHRShot and asthma tasks, BERT-LER achieves predictive performance that is competitive with, and on laboratory-related tasks often exceeds, publicly available benchmark models, and provides attributions that align with clinically known risk factors. Our architecture and explainability approach can be applied to many therapeutic areas and prediction tasks using language models trained on structured EHRs.
12. 其他/综合机器学习 | 33 篇
33. Towards On-Board Implementation of ML-Based Helicopter Weight Estimator
面向直升机机载机器学习重量估计器的实现
AI 总结:该研究提出符合EASA及Eurocae ED-324标准的长短期记忆循环神经网络重量估计器,利用空客在役机队数据,可在传统航电计算机上实现机载部署用于关键告警功能。
链接:https://arxiv.org/abs/2608.19210
作者:Nicolas Valot, Ammar Mechouche, Benjamin Lesage, Claire Pagetti, Louis Fabre
英文摘要:This paper focuses on the implementation of a novel supervised Machine Learning model for estimating helicopter weight during takeoff, utilizing extensive datasets from Airbus's global in-service fleet. The study details a learning assurance process aligned with the EASA concept paper for machine learning application, and with the on-going Eurocae ED-324. We propose a set of Machine Learning Requirements, a Machine Learning Model Description, and its implementation for a long short-term memory recurrent neural network. Finally, we verify the requirements on the implementation. Demonstrated on legacy avionics computers, the implementation is suitable for the deployment of the developed Machine Learning Model weight estimator on airborne targets for critical functions such as on-board alerting.
34. Triangular Fuzzy Rescaling Distance
三角模糊重标距离
AI 总结:本文针对异构属性下三角模糊数距离计算需预先归一化的问题,提出三角模糊重标距离$d_{TR}$,其整合线性重标于距离计算,满足度量特性且适用于异构模糊数据相关应用。
链接:https://arxiv.org/abs/2608.19234
作者:Eddy Soria, Aida Valls, Ana Beatriz Hernández-Lara
英文摘要: Decision-making in complex systems often involves dealing with imprecise or uncertain information, frequently represented using fuzzy sets, particularly Triangular Fuzzy Numbers (TFNs). A crucial aspect of many fuzzy methods is the quantification of distance between TFNs. Many distance measures assume that all values are in the same scale, requiring a preliminary normalization stage when applied to heterogeneous attributes with different scales or units. This paper proposes the Triangular Fuzzy Rescaling Distance (d_{TR}), a metric designed to address this challenge. The d_{TR} uniquely integrates Linear Rescaling (LRE) directly into the distance calculation, ensuring normalization during the comparison of fuzzy numbers. We formally prove that d_{TR} satisfies the properties of a metric, including non-negativity, identity, symmetry, and the triangle inequality. Furthermore, we demonstrate that d_{TR} is bounded, scale-invariant, and origin-invariant. These properties, combined with a weighting vector for prioritizing dimensions, make d_{TR} suitable for applications involving heterogeneous fuzzy data, such as the construction of synthetic indicators, distance-based machine learning algorithms or multicriteria-decision aiding.
35. Mechanistic Tomography: Designed Measurement for Control-Oriented Interpretability
机制层析:面向控制的可解释性的设计测量方法
AI 总结:该研究提出机制层析方法,通过设计测量恢复模型内部机制与干预效应,在不同模型访问场景下验证其有效性,还在GPT-2-small IOI、Qwen-2.5-7B上完成相关实验。
链接:https://arxiv.org/abs/2608.19338
作者:Vijay Erramilli
英文摘要:Mechanistic interpretability seeks quantities that models do not expose directly: represented states, component effects, interactions, and responses to interventions. Patching, gradients, Hessian-vector products, and subset interventions provide different measurements under different access assumptions and may target different quantities. We formulate their shared measurement structure as mechanistic tomography: designed measurement for recovering internal mechanisms and intervention effects. For a chosen basis and intervention family, measurements take the form y = Ax + w, where A describes the interventions, x is the target map, and w contains nonlinear response, sampling error, and basis misspecification. This language gives a practical procedure: start with the least costly measurements, test on held-out interventions at the intended scale, calibrate simple mismatch, and expand the measurement family when structured residuals remain. Control provides a demanding validation setting because an estimate that guides an intervention acts as an observer. In a two-HMM model, control error rises with observer error, while target improvement can hide nuisance-state movement. Under forward-only access, sparse aggregate measurements recover a finite-effect map with fewer interventions than coordinate patching. With gradient access, finite probes improve a local attribution map. Lifted measurements and Hessian-vector products recover interactions missed by first-order maps, while Tracr shows that the required family depends on the basis. On GPT-2-small IOI, the Name Mover-Negative Name Mover interaction is the largest held-out predictive term among three tested cross-group pairs. On Qwen-2.5-7B, finite calibration makes an additive refusal-response map adequate, so held-out error does not support pairwise lifting.
36. Uncovering the Limits of Proof Sharing for Neural Networks
揭示神经网络证明共享的局限性
AI 总结:本研究系统探究神经网络证明共享的局限性,提出联合稳定神经元指标解释模板包含率差异,研发FastCert技术,在$L_0$-验证任务中较现有模板复用技术实现平均1.13倍加速。
链接:https://arxiv.org/abs/2608.19351
机构:University of California, Riverside(加州大学河滨分校); University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校); University of Colorado Boulder(科罗拉多大学博尔德分校); Amazon(亚马逊公司)
作者:Kanak Das, Shubham Ugare, Bor-Yuh Evan Chang, Sasa Misailovic, Gagandeep Singh, Manu Sridharan
英文摘要:Robustness verification of neural networks is increasingly important, due to their use in many critical domains. In certain scenarios, proof sharing has been shown to accelerate incomplete verification techniques by reusing intermediate-layer abstract states, or templates, across queries. However, questions remain as to the robustness of template-based acceleration across varying network architectures, properties, datasets, and training methods. In this work, we perform a systematic study of the effectiveness of template-based acceleration and its limits. Our study shows that template subsumption rates can vary widely across scenarios. We present a novel metric of jointly stable neurons to explain this variation, showing that in some cases template-based techniques are very unlikely to provide any speedup. Then, we present FastCert, a novel technique for automatically distributing templates across neural network layers to increase performance impact, eschewing templates entirely if they are unlikely to produce a speedup. Across a large set of covering-design based $L_0$-verification tasks, FastCert achieved an average speedup of 1.13x over an extant template-based reuse technique.
37. Longitudinal Bayesian Learning of Continuous Disease Position across the Alzheimer's Disease Continuum
阿尔茨海默病连续体中疾病位置的纵向贝叶斯学习
AI 总结:该研究针对阿尔茨海默病连续体提出纵向贝叶斯学习框架DCP,推导DCS量化疾病位置,在ADNI队列上验证其性能优于现有方法,可连续评估AD进展。
链接:https://arxiv.org/abs/2608.19436
机构:University of Texas Rio Grande Valley(德克萨斯大学里奥格兰德河谷分校); University of Pittsburgh(匹兹堡大学); Eli and Lilly Company(礼来公司); Washington University in St. Louis(圣路易斯华盛顿大学)
作者:Yingying Zhang, Kun Zhao, Guodong Liu, Qi Huang, Pengfei Gu, Dongchul Kim, Erik Enriquez, Alex D. Leow, Paul M. Thompson, Heng Huang, Hongchang Gao, Liang Zhan, Haoteng Tang
英文摘要:Alzheimer's disease (AD) progresses as a continuous biological process, whereas most existing neuroimaging-based artificial intelligence methods remain limited to discrete diagnosis or clinical score prediction from cross-sectional imaging. In this work, we propose Disease Continuum Positioning (DCP), a longitudinal Bayesian Learning framework that continuously estimates disease severity from longitudinal diffusion tensor imaging (DTI). Specifically, DCP models disease severity as a low-dimensional probabilistic latent variable by jointly integrating longitudinal observations with weak clinical supervision, from which the proposed Disease Continuum Score (DCS) is derived to quantify an individual's position along the Alzheimer's disease continuum together with its associated uncertainty. Extensive experiments on the Alzheimer's Disease Neuroimaging Initiative (ADNI) cohort demonstrate that DCP consistently outperforms representative disease progression methods. More importantly, comprehensive validation analyses show that DCS accurately characterizes disease severity, exhibits strong clinical relevance, preserves longitudinal disease evolution, and predicts future disease conversion. These results suggest that DCS provides a quantitative imaging-derived representation for continuous assessment of Alzheimer's disease progression beyond conventional diagnostic labels and clinical scores.
38. Beyond Multimodal Alignment: Certifying Physical Language through Response Substitution and Ordered Execution
超越多模态对齐:通过响应替换与有序执行验证物理语言
AI 总结:本文提出DBOSC方法,在Cluster Haptic数据集与弹塑性系统中验证了多模态物理表示的可执行含义,明确了执行器、图表等因素对动作组合的影响,区分了多项可测试的操作能力成就。
链接:https://arxiv.org/abs/2608.19492
机构:New York University(纽约大学); Carnegie Mellon University(卡内基梅隆大学); Columbia University(哥伦比亚大学)
作者:Kaizhen Tan, Xin Xu, Siru Tao, Yixiao Li, Hanzhe Hong, Yang Feng, Heqing Du
英文摘要:World models increasingly treat compact multimodal representations as interfaces between perception and physical interaction, yet existing probes do not establish whether different sensors carry the same executable meaning or whether that meaning survives a new action composition. We introduce an operational capability hierarchy and the Disjoint-Bridge Operator-Substitution Certificate (DBOSC), which asks whether independently trained modality compilers enter a frozen response chart interchangeably on evidence outside their training panels. On Cluster Haptic, audio and acceleration representations of the same unseen surface are 4.5x closer in response space than wrong-surface pairings, with the gap holding for all 19 held-out surfaces; unsealing withheld responses confirms that every branch predicts the physics better than the population chart. We then test ordered execution in a controlled elastoplastic system with complementary modality blind spots. At the pre-registered budget, the prerequisite refuses the stack because the frozen executor cannot advance even an exact chart coordinate through a held-out program. At a converged budget, the same rank-three chart executes those programs (oracle NMSE 0.18), fusion improves on both modalities, and 14 of 16 registered checks pass; the two failures arise because a diagonal restriction of the fused information matrix performs as well as the full one. Clearing the gate is a property of the executor, not the chart: an executor emitting whole programs instead of shared per-step dynamics is 38x worse than an entity-blind predictor on the same chart. A matching non-identifiability result explains why compression and fusion alone cannot determine an unseen composition law. These results separate attribute access, response substitution, fusion closure, and ordered execution into distinct, separately testable achievements.
39. Continuous Adversarial MeanFlow Transfer
连续对抗平均流迁移
AI 总结:本研究提出MeanFlow-Transfer与Continuous Adversarial MeanFlow,解决有限数据下新域生成器训练的适配与加速问题,在四个源模型适配五个目标域时,FID等指标相当或更优且NFEs最多减125倍,少步FID平均提29%。
链接:https://arxiv.org/abs/2608.19540
作者:Yara Bahram, Zahra Dehghani, Mélodie Desbos, Eric Granger, Pablo Piantanida, Mohammadhadi Shateri
英文摘要:Training fast generators on new domains with limited data remains challenging for two reasons. First, adapting a pretrained diffusion or flow model to a new domain leaves its costly multi-step sampling unaddressed, and existing acceleration methods are tied to the source parameterization--$\epsilon$, $x$, $v$, or $u$--leaving heterogeneous pretrained models with no common acceleration target. Second, while adversarial refinement is proven effective for few-step quality, it is formulated only for instantaneous-velocity flows, not for the finite-interval average velocities that MeanFlow (MF) models predict. We address both problems. We propose MeanFlow-Transfer, which maps heterogeneous source outputs into a shared velocity representation, uses it to initialize an MF generator from the source weights, and optimizes an MF objective on the target domain. This unifies adaptation and acceleration in a single training loop across a broad range of pretrained models. We then introduce Continuous Adversarial MeanFlow, a post-training stage that extends continuous adversarial flow models from instantaneous velocities to MF's finite-interval average velocities. CAMF contrasts changes in a learned potential between real and predicted interval endpoints, recovering fine detail that MF regression averages away, and reduces to the instantaneous criterion in the vanishing-interval limit. Adapting four ImageNet-based source models--DiT ($\epsilon$), SiT ($v$), JiT ($x$), iMF ($u$)--to five target domains, MF-T with CAMF matches or exceeds the fine-tuned teacher in FID and FDD at up to $125\times$ fewer Neural Function Evaluations (NFEs), while CAMF improves MF-T's few-step FID by $29\%$ on average.
40. DraftFM: A FoundationModel for Day-Zero Drafting in Magic: The Gathering
DraftFM:用于万智牌零日 drafting 的基础模型
AI 总结:该研究针对万智牌 drafting 的零日 regime,提出离散选择策略 DraftFM,用 160 万参数网络拟合 1.49 亿个人类 pick,在预留系列预测达 50.8%-60.4% top-1 一致性,还为未发布的《霍比特人》系列生成卡牌排名,与专家评审表现相当。
链接:https://arxiv.org/abs/2608.19568
作者:Brian Ward
英文摘要:Drafting a new Magic: The Gathering expansion begins before any pick from it has been observed: the complete card list is public, but the draft logs that supervised pick models train on do not yet exist. We study this day-zero regime directly. DraftFM is a discrete-choice policy that scores exactly the cards available in the current pack, conditioned on the drafted pool and the state of the draft. Every card enters as a frozen 775-dimensional function of its public card record, structured features and a fixed text embedding, with no card identities, set identities, or usage statistics anywhere in the model, so an unseen card is scored by the same machinery as a familiar one. A 1.6-million-parameter network fitted on 149 million human picks from 29 expansions predicts held-out picks in three expansions withheld in their entirety, reaching 50.8%, 60.4%, and 56.7% top-1 agreement, where uniform chance at the opening pick is about 7%. Refitted on all 32 observed expansions, the same architecture produced a card ranking for the then-unreleased set The Hobbit, sealed with its complete cryptographic provenance and published roughly 36 hours before the set became draftable on MTG Arena. The sealed ranking agrees with six independent expert reviewers roughly as much as those reviewers agree with one another. Evaluation against realized outcomes is committed to a follow-on note, whatever it shows.
41. A Two-Stage Time-Aware Transformer for Short-Horizon AECOPD Risk Prediction
用于短期AECOPD风险预测的两阶段时间感知Transformer
AI 总结:该研究针对AECOPD预测的延迟问题,提出两阶段时间感知Transformer模型,直接处理家用呼吸机原始波形,在风险分类和时间估计上优于基线,为临床提供预警。
链接:https://arxiv.org/abs/2608.19578
机构:Monmouth University(蒙茅斯大学); Changzhou Yaoyuanxing Electronic Technology Co., Ltd.(常州遥远兴电子科技有限公司)
作者:Dongyang Wang, Weihao Qu, Ling Zheng, Haowen Pan
英文摘要:Acute exacerbation of chronic obstructive pulmonary disease (AECOPD) can worsen rapidly, making timely prediction a clinical priority. Most existing machine learning approaches rely on episodically collected clinical variables, introducing delays that limit their practical utility in home monitoring settings. Home ventilators offer a lower-latency alternative, producing a near-continuous record of respiratory status during daily use. However existing ventilator-based approaches either compress the waveform into handcrafted features or focus primarily on binary risk classification, leaving the timing of an impending event unresolved. In this paper, we present a two-stage framework that operates directly on raw pressure and flow waveforms from the most recent seven days of home ventilator use. The first-stage classification model identifies patients at high risk of a severe exacerbation. The second-stage regression model then estimates how many days remain before the event occurs. Our experimental results demonstrate that the two-stage model outperforms traditional baseline models on both risk classification and time-to-event estimation, with our selected Stage 1 classifier achieving F1 = 0.91 and our Stage 2 regression model achieving RMSE = 1.00 days and R^2 = 0.76, giving clinicians both an early warning and actionable lead time before a severe exacerbation occurs.
42. Rationally Enriched Chebyshev Trunk Bases for DeepONet Surrogates of High Péclet Entrance Transport
用于高佩克莱特入口输运问题DeepONet代理模型的理性富集切比雪夫主干基
AI 总结:本研究提出理性富集切比雪夫主干的DeepONet代理模型,用于高佩克莱特入口输运问题,可降低剖面误差并抑制近壁振荡,在特定摄动参数下优势显著。
链接:https://arxiv.org/abs/2608.19658
机构:Georgia Institute of Technology(佐治亚理工学院)
作者:Mingeun Choi, Satish Kumar
英文摘要:This study demonstrates a rationally enriched Chebyshev (REC) trunk for deep operator network (DeepONet) surrogate models of singularly perturbed and high-Péclet transport problems whose solution profiles are characterized by thin localized boundary or wall layers. The REC trunk combines Chebyshev polynomial dictionary elements with rational dictionary elements constructed using the adaptive Antoulas-Anderson (AAA) algorithm. Over five independent training runs, the resulting REC-trunk DeepONet is evaluated against a vanilla DeepONet and a Chebyshev-trunk DeepONet whose prescribed dictionary consists only of Chebyshev polynomials across three problems whose singular perturbation parameters are diffusion-to-advection ratios: a singularly perturbed scalar boundary-value problem (BVP), the thermal entrance problem with a prescribed wall temperature, and the concentration entrance problem with an absorbing wall. Across the held-out test profiles, the REC-trunk DeepONet improves over the vanilla DeepONet and remains comparable to the Chebyshev-trunk DeepONet in predicting the scalar profile, with its clearest advantage over the Chebyshev-trunk DeepONet appearing when the perturbation parameter lies between $1.00\times10^{-4}$ and $1.78\times10^{-4}$, where it reduces the profile-error metrics by up to $19.5\,\%$ relative to the Chebyshev-trunk DeepONet. In predicting the wall-normal temperature and concentration profiles, the REC-trunk DeepONet reduces the profile-error metrics by up to $60.2\,\%$ and $32.2\,\%$ relative to the vanilla and Chebyshev-trunk DeepONets, respectively, while suppressing artificial near-wall oscillations as the Péclet or mass-transfer Péclet number ranges from $10^{2}$ to $10^{4}$.
43. FleetSieve: Decision-Critical Profiling for SLO-Aware LLM Fleet Configuration
FleetSieve:面向SLO感知的大语言模型集群配置的决策关键型性能分析
AI 总结:FleetSieve是一种面向SLO感知的LLM集群配置的决策关键型性能分析方法,通过联合建模容量与尾部延迟选择测量,可减少GPU资源消耗,避免违反SLO,提升集群决策效率。
链接:https://arxiv.org/abs/2608.19659
机构:Meta
作者:Huang Cheng, Scott Zhang, Aubert Li
英文摘要:Choosing tensor-parallel (TP) degrees and replica counts for an LLM serving fleet is difficult because performance is not monotonic in TP and the feasible choice can change with load. Exhaustive profiling resolves this uncertainty, but measures many configurations that do not affect the final resource allocation. We present FleetSieve, which selects measurements according to their expected effect on a resource-coupled, SLO-aware fleet decision. FleetSieve models capacity and tail latency jointly, compares conservative and optimistic allocations, and stops when their remaining decision gap is below a specified tolerance. On a fixed H100 measurement grid for a 31B-parameter open-weight model, FleetSieve reaches the oracle aggregate decision using 22,200 GPU-seconds, 6.9% less than uniform random profiling in the fixed comparison. Across 200 random reveal orders, its mean saving over random profiling is 5.4% (95% bootstrap CI: 3.5-7.2%). The fixed-comparison saving is 21.5% for Chat, while FleetSieve does not use the fewest GPU-seconds for Code. Joint capacity and tail modeling also avoids selecting a configuration whose 46.4-second completion p99 violates a 30-second SLO. In a 16-GPU allocation, an incorrect sparse-profile decision loses up to 1.93 requests/s and 12.4 percentage points of max-min fulfillment. Boundary repeats and BurstGPT measurements support the observed load-dependent tail-latency mechanism.
44. A Locally Tokenized Generative Model for Robust Time-Series Watermarking
用于鲁棒时间序列水印的局部分词生成模型
AI 总结:针对多变量时间序列水印受后编辑攻击可靠性失效的问题,提出L-VQVAE生成模型与LVQMark水印方法,在保留生成质量的同时稳定了攻击下的检测能力与误报行为。
链接:https://arxiv.org/abs/2608.19727
机构:Nanyang Technological University(南洋理工大学); Seoul National University(首尔大学)
作者:Dongbin Kim, Geonwoo Shin, Yujin Choi, Soyeon Park, Jaewook Lee
英文摘要:Watermarking is a central tool for provenance in generative models, yet its application to multivariate time series remains hindered by reliability failures under post-editing attacks. We show that existing detectors, which rely on globally coupled re-encoding, suffer from bidirectional drift of the null distribution: post-editing attacks can shift the z-score of non-watermarked samples in either direction, invalidating clean-calibrated thresholds. We argue that this instability is a property of the re-encoding, and that reliable detection requires each recovered unit to depend only on a bounded temporal neighborhood. Guided by this principle, we propose L-VQVAE, a generative model in which each discrete token is produced from a short contiguous window, and LVQMark, a watermarking method over this token space that combines logit-bias injection with robust re-encoding for attack-time detection. Experiments on four benchmarks spanning finance, energy, and neuroimaging show that our approach preserves generation quality while stabilizing both detection power and false-positive behavior under post-editing attacks.
45. RecPFN: Prior-Fitted Networks for In-Context-Based Recommendations
RecPFN:用于基于上下文的推荐的先验拟合网络
AI 总结:RecPFN是一种将上下文学习引入序列推荐的先验拟合网络,经合成点击流环境预训练,在八个基准测试中实现最优零样本性能,部署高效且鲁棒,为通用推荐系统提供新路径。
链接:https://arxiv.org/abs/2608.19735
机构:SAP SE(思爱普公司)
作者:En Zhi Tan, Jia Xiang Lim, Bryan Lijie Chew, Tze Minh Ng, Benjamin Yan Han Yap
英文摘要:We introduce RecPFN, a prior-fitted network that brings in-context learning to sequential recommendation. RecPFN is pretrained entirely on synthetic clickstream environments sampled from a broad structural causal prior, enabling it to amortize Bayesian-style inference from a small support set. At inference, a lightweight decoder-only transformer conditions on a handful of domain sequences and produces next-item predictions for queries in a single forward pass, without any weight updates. Across eight public benchmarks, RecPFN achives state-of-the-art zero-shot performance while remaining strongly competitive with supervised methods in low-compute and low-data regimes. It is deployment-efficient and robust to domain shift, outperforming strong zero-shot baselines that rely on large real-interaction corpora. RecPFN provides a practical path toward generalizable, data-efficient recommenders and opens avenues for richer priors, longer-context ICL, and multimodal extensions. Code for training and evaluation is publicly available at this https URL.
46. Credit Without Ground Truth: Auditing Step-Level Credit Assignment in LLM Agents Against Executed Replay
无真实值的信用:针对执行重放的大语言模型智能体的步骤级信用分配审计
AI 总结:该研究针对LLM智能体,在ALFWorld环境中审计步骤级信用分配,发现现有信用信号无法识别关键步骤,提出需匹配有效样本量比较信用规则。
链接:https://arxiv.org/abs/2608.19760
机构:University of Southern California(南加州大学)
作者:Haiyue Zhang
英文摘要:Audited against causal ground truth from executed replay in a single-agent tool environment (ALFWorld), none of the step-level credit signals used to train LLM agents -- LLM-judge scores, outcome-conditioned logprob ratios, or the policy's own confidence -- identifies which steps causally matter better than chance. Existing evaluations grade these signals against annotated step *correctness*; we audit them against step *contribution* -- what re-sampling the policy's own alternatives at each decision point and rolling forward actually changes about the outcome -- and the two come apart. The ground truth itself is structured: causal contribution is sparse (30.5% of decision points where ground truth is defined carry measurable effect), and measurability is model-dependent -- the fraction of points with no policy-supported counterfactual differs by a factor of two (13.1% vs. 26.8%) between two similar-scale policies. The failure mode is identifiable: implicit credit echoes the policy's fluency (median rank correlation +0.75, replicating at +0.70 in a second family under a corrected instrument), while conditioning on the outcome adds no causal information (partial correlation -0.004, Qwen). A confidence-only router recovers pivotal steps at chance level, but cuts judge cost by 13.1% per turn (14.0% per trajectory). In a seven-arm pre-registered training experiment, no arm reliably outperforms the untrained policy, and the checkpoints' apparent instrument signature is fully explained by training dose -- sparser credit retains fewer examples, an order-of-magnitude spread in optimizer steps -- not credit content. Comparisons of credit rules must therefore match effective sample size, or they measure dose, not credit.
47. Finite-Horizon Input-Output Dynamics of Minibatch Perturbations in AdamW
AdamW中小批量扰动的有限时域输入-输出动力学
AI 总结:该研究针对AdamW优化器,建立有限时域ISO系统模型,推导符号响应算子与多步误差分解,通过实验验证小批量扰动的延迟影响机制,为优化器动力学分析提供了理论与实证支撑。
链接:https://arxiv.org/abs/2608.19762
机构:School of Future Technology, Xi’an Jiaotong University(西安交通大学未来技术学院); National University of Singapore(新加坡国立大学)
作者:Kang Liu, Suyan Li
英文摘要:A minibatch can influence training beyond the update at which it is observed because AdamW stores past gradient information in its optimizer states. We study this delayed effect through paired trajectories that differ only in one gradient update and share the same subsequent training sequence. We formulate AdamW as a finite-horizon input--state--output (ISO) system whose state contains the model parameters and first- and second-moment estimates. Linearizing the joint dynamics yields a signed response operator that maps a localized gradient perturbation to its future loss effects, revealing how optimizer memory shapes their magnitude, timing, and sign. We further derive an exact multistep error decomposition and establish first-order finite-horizon accuracy under local smoothness and controlled activation switching. Experiments validate the response mechanism and optimizer-state effects, while repeated-future analyses reveal substantial prospective structure in delayed influence that can be partially recovered from ISO approximations. Code is available at this https URL.
48. Answer-Level Trust Selection for Physical Vision-Language Reasoning
面向物理视觉-语言推理的答案级信任选择
AI 总结:针对VLM部署中预测信任问题,提出模型无关的ATS框架,聚合8种诊断分数评估答案可靠性,可识别稳定错判等失效模式,补充模型级能力评估。
链接:https://arxiv.org/abs/2608.19807
作者:Rongyu Yu, Ke Niu, Fengxiang He
英文摘要: Vision-language models (VLMs) can estimate physical quantities such as duration, speed, and acceleration from visual observations, but existing benchmarks primarily assess overall model performance against annotated ground truth. In deployment, a key question is whether an individual prediction can be trusted when its ground truth is unavailable. Self-consistency alone may fail to capture important failure modes: a VLM may produce stable-but-wrong estimates or rely on textual priors rather than visual evidence. We formulate answer-level selective prediction for quantitative physical reasoning and propose Answer-Level Trust Selection (ATS), a post-hoc, model-agnostic framework for accepting or rejecting individual VLM predictions. ATS requires no fine-tuning, auxiliary verifier, or access to the model's internal logits. Instead, it aggregates eight interpretable behavioral diagnostic scores derived from repeated queries and controlled interventions into a unified trust score. We evaluate ATS in depth on Qwen2.5-VL-7B and across 20 VLM backbones, examining selective performance, diagnostic behavior, and targeted failure modes. Our results show that intervention-based diagnostics help identify stable-but-wrong and prior-tracking predictions that repeated agreement alone may miss. However, improved failure-case rejection can come at the cost of lower retention of correct predictions. ATS therefore complements model-level capability evaluation with answer-level reliability assessment for quantitative VLM predictions. Code will be released upon publication.
49. Separating Covariate Shift from Mechanism Change with Two Discriminators: CJSD, a Conditional Discrepancy with an Exact Covariate-Concept Decomposition
利用两个判别器将协变量偏移与机制变化分离:CJSD,一种具有精确协变量-概念分解的条件差异
AI 总结:该研究针对流系统专家模型复用、生成或弃权决策问题,提出带精确协变量-概念分解的CJSD方法,通过重启e-检测器实现零假生成/复用,性能优于窗口启发式方法。
链接:https://arxiv.org/abs/2608.19885
机构:Center for Management of Information Technologies, Kagoshima University(鹿儿岛大学信息技术管理中心)
作者:Kentaro Oda
英文摘要:Streaming systems that maintain a pool of expert models must repeatedly decide whether to reuse an existing expert for arriving data, spawn a new one, or defer. We present a decision layer that makes all three outcomes statistically meaningful. Reuse and spawn are posed as one-sided sequential hypotheses on a conditional (mechanism-level) discrepancy, separated by an indifference zone; defer is exactly the state in which neither betting e-process has accumulated sufficient evidence. We prove finite-time anytime validity for the observable surrogate discrepancy of a predictable discriminator sequence, and an unconditional one-sided transfer to the population quantity in which each side's slack is the excess risk of a single discriminator; an empirically observed downward-bias regularity makes the spawn side exactly conservative. Recency without sacrificing the guarantee is obtained by a restarted e-detector: a bank of unwindowed betting supermartingales at geometrically spaced restart times (O(log t) memory), with the error budget spent over restart instances, which preserves lifetime anytime validity; spending over expert-creation order likewise controls multiplicity for unboundedly many experts. On synthetic multi-concept streams, Electricity, Covertype, and the recurrence-heavy INSECTS benchmark, the instance-accounted restarted bank achieves zero false spawns and zero false reuses after switches and matches or exceeds the retired windowed heuristic (INSECTS-reoccurring accuracy 0.675), making the deployed algorithm and the guaranteed algorithm one and the same.
50. Evidence Before Expansion: Reuse, Spawn, or Defer in Lifelong Expert Pools
扩展前的证据:终身专家池中的重用、生成或弃权(不执行)
AI 总结:该研究提出终身专家池的决策层,通过重启的e检测器实现零错误生成与重用,在多概念流基准上性能优于窗口启发式算法,保证了统计有效性。
链接:https://arxiv.org/abs/2608.19888
机构:Center for Management of Information Technologies, Kagoshima University(鹿儿岛大学信息管理中心)
作者:Kentaro Oda
英文摘要:Streaming systems that maintain a pool of expert models must repeatedly decide whether to reuse an existing expert for arriving data, spawn a new one, or defer. We present a decision layer that makes all three outcomes statistically meaningful. Reuse and spawn are posed as one-sided sequential hypotheses on a conditional (mechanism-level) discrepancy, separated by an indifference zone; defer is exactly the state in which neither betting e-process has accumulated sufficient evidence. We prove finite-time anytime validity for the observable surrogate discrepancy of a predictable discriminator sequence, and an unconditional one-sided transfer to the population quantity in which each side's slack is the excess risk of a single discriminator; an empirically observed downward-bias regularity makes the spawn side exactly conservative. Recency without sacrificing the guarantee is obtained by a restarted e-detector: a bank of unwindowed betting supermartingales at geometrically spaced restart times (O(log t) memory), with the error budget spent over restart instances, which preserves lifetime anytime validity; spending over expert-creation order likewise controls multiplicity for unboundedly many experts. On synthetic multi-concept streams, Electricity, Covertype, and the recurrence-heavy INSECTS benchmark, the instance-accounted restarted bank achieves zero false spawns and zero false reuses after switches and matches or exceeds the retired windowed heuristic (INSECTS-reoccurring accuracy 0.675), making the deployed algorithm and the guaranteed algorithm one and the same.
51. Multi-Source Wasserstein Distributionally Robust Graph Learning
多源Wasserstein分布鲁棒图学习
AI 总结:该研究针对图信号处理中异质源域数据融合难题,提出MS-WDRO多源Wasserstein分布鲁棒图学习框架,经实验验证其在图恢复等任务上优于多个基线方法。
链接:https://arxiv.org/abs/2608.19914
机构:School of Mathematics, Sichuan University(四川大学数学学院); School of Statistics and Data Science, Southwestern University of Finance and Economics(西南财经大学统计与数据科学学院)
作者:Chuansen Peng, Yifan Xia, Jinshan Zhong, Xiaojing Shen
英文摘要:Network topology inference from graph signals is central to graph signal processing with applications in neuroscience, sensor, and social networks. In practice, target-domain samples are scarce while heterogeneous source-domain data are abundant. Fusing these sources is challenging: Euclidean averaging works for homogeneous sources but degrades sharply as inter-source divergence grows, collapsing distinct geometries into an inflated, biased consensus. We exploit the Wasserstein metric's distribution-preserving properties to counter heterogeneity while preserving each source's intrinsic geometry. We propose MS-WDRO, a multi-source Wasserstein distributionally robust graph learning framework that fuses heterogeneous sources via their weighted Wasserstein barycenter, a geometrically principled nominal distribution, then builds an ambiguity ball around it to hedge residual uncertainty. Minimizing worst-case risk yields a tractable regularized Laplacian estimator solved efficiently via a provably convergent ADMM scheme. We establish non-asymptotic guarantees: a finite-sample concentration bound for the empirical barycenter, a pooling bias lower bound proving naive aggregation is suboptimal, and an out-of-sample excess risk bound decaying at a parametric rate with only logarithmic dependence on source count. To calibrate hyperparameters governing robustness, sparsity, and source fusion, we unroll the solver into a differentiable architecture trained end-to-end, achieving data-adaptive calibration beyond cross-validation while retaining interpretability. Experiments on synthetic benchmarks and the multi-site ABIDE~I neuroimaging dataset show MS-WDRO consistently outperforms seven baselines in graph recovery, sample efficiency, and downstream diagnostic utility, with the largest gains in the sample-scarce regime.
52. Auditing Recorded Predictive Lead Service-Line Classifications Against Physical Verification: A Statewide Study of New York
针对物理验证的已记录预测性服务管线分类审计:纽约州的全州研究
AI 总结:该研究针对纽约州服务管线的预测模型分类与物理验证记录开展全州审计,发现纽约市等区域存在模型分类未记录铅材质、判定数据复制等问题,揭示了预测模型分类在管线材质判定中的偏差。
链接:https://arxiv.org/abs/2608.19922
作者:Muhammad Sarmad Sohail
英文摘要:Under the US Lead and Copper Rule Revisions, a utility may determine a service line's material with a predictive model instead of inspecting it. New York State publishes, per address, which method was used. Almost no address carries both a model classification and a physical verification, so the check is between populations within a utility rather than paired addresses. We screen all 153 New York localities that classified at least 100 addresses this way. Seventy-five (49%), covering 125,990 addresses or 57% of those screened, record one value. Zero variance alone is not misconduct: 68 of the 75 match their own verification or have too little to test. Seven are contradicted by their own crews, six beyond any sampling explanation. Five are boroughs of New York City, which file as one system; one is East Rochester, 550 km away. New York City is the largest case: a predictive model is the recorded basis for 43,215 addresses, and on all of them the recorded material is "Known Other". The city records "Unknown" on 121,779 addresses, 1,880 already excavated, and lead on 120,692. In the model bucket both counts are zero, and the 95% upper bound on the rate is 0.0085%. Across the rest of New York the same method records lead or the hedge "Unknown but could be lead" on 12.21% of 176,888 addresses, a comparison whose weaknesses we report. The model-cleared population is newer, median year built 1984 against 1930, and construction era accounts for about a third of the gap and not the rest: holding era fixed, records-based classification finds lead at 4.3-31.9%, physical verification at 1.5-14.5%, the model in no era. Six era-aware estimators place the expected lead lines among them at 1,150-1,450. Two findings need no comparison: 7,782 of these addresses are in pre-1940 buildings, and the archived 2025 snapshot shows the public-side determination was copied from a customer-side model output.
53. G-MARK: Grounded Multi-Agent Reasoning for Cooperative Driving via Knowledge Graphs
G-MARK:基于知识图谱的协同驾驶接地多智能体推理
AI 总结:提出 G-MARK 框架,通过知识图谱实现协同驾驶多智能体推理,提升遮挡推理与控制选择性能,减小通信负载,效果优于现有基线。
链接:https://arxiv.org/abs/2608.19964
机构:University of California, San Diego(加利福尼亚大学圣迭戈分校); West Virginia University(西弗吉尼亚大学)
作者:Bhavya Gupta, Onat Gungor, Tajana Rosing
英文摘要:Autonomous driving systems must operate under partial observability, where safety-critical objects may be occluded or visible only to neighboring connected vehicles. Vehicle-to-vehicle cooperation can reduce this uncertainty, but existing cooperative driving methods often compress multi-agent evidence into latent features or hidden multimodal states. As a result, they obscure which agent observed each object, whether the object is visible to the ego vehicle, and how conflicting evidence affects downstream decisions. We propose G-MARK, a grounded multi-agent reasoning framework that converts cooperative object-centric observations into explicit provenance-aware knowledge graphs (KGs). The resulting KGs preserve object hypotheses together with their source attribution, ego-versus-partner visibility, uncertainty, conflicts, spatial relations, and planning-relevant context. G-MARK then derives a shared feature representation from these KGs, enabling lightweight task heads to support object reasoning, motion prediction, control selection, and trajectory forecasting. Compared with the state-of-the-art baseline, GMARK improves occlusion reasoning accuracy by 42.2%, reduces control-selection error by 13.1%, and achieves comparable trajectory-planning accuracy with a 25.6x smaller structured communication payload. Our code is available at this https URL.
54. Green BOA: Determining the environmental break-even point for ML-based data compression
Green BOA:确定基于机器学习的数据压缩的环境收支平衡点
AI 总结:该研究以曼彻斯特大学两个暑期实习项目成果为基础,针对基于机器学习的数据压缩算法的环境可持续性收支平衡点,通过对比压缩算法相关基础设施碳当量与存储节省碳当量,探讨了其收支平衡点。
链接:https://arxiv.org/abs/2608.19994
机构:University of Manchester(曼彻斯特大学); CERN(欧洲核子研究中心)
作者:Caterina Doglioni, Akshat Gupta, Thomas Elliott, Hanzila Hussain, Sanjiban Sengupta
英文摘要:We summarise the outcome of two summer internship projects based at the University of Manchester, focused on the break-even point in terms of environmental sustainability for ML-based data compression algorithms. Using the example of a ML-based lossless compression algorithm, we compare estimates for the carbon-equivalent of the infrastructure needed for ML training and inference with the carbon-equivalent savings from reduced disk storage requirements, and discuss their break-even point.
55. Scale-Aware Pretraining of Time Series Foundation Models via Multi-Patch Token Alignment and Hybrid Masking
基于多补丁令牌对齐与混合掩码的时间序列基础模型尺度感知预训练
AI 总结:本文针对时间序列基础模型预训练中处理不同采样频率的问题,提出SATS方法,通过尺度感知令牌对齐与混合掩码策略实现最优性能,同时提升模型效率。
链接:https://arxiv.org/abs/2608.20005
机构:School of Software, Shandong University(山东大学软件学院); Joint SDU–NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University(山东大学-南洋理工大学人工智能联合研究中心(C-FAIR)); Nanyang Technological University(南洋理工大学)
作者:Taihua Chen, Xiang Ma, Yixin Zhang, Tailin Zhan, Manyu Sun, Lizhen Cui
英文摘要: Pretraining time series foundation models across heterogeneous datasets necessitates effective handling of varying sampling frequencies. Current methods either employ dataset-specific patch sizes and separate FFNs, leading to fragmented representations, or enforce a fixed patch size that neglects inherent temporal variations. To address this, we propose SATS, featuring a scale-aware token alignment mechanism that treats patch size as an explicit notion of scale. By incorporating a contrastive-inspired alignment regularizer, SATS aligns representation spaces across scales while preserving distinct modeling capacities. Furthermore, a hybrid masking strategy combining random and contiguous masking is introduced to capture multi-scale temporal structures. Experimental results on LSTF benchmarks demonstrate that SATS achieves a 9.2% improvement in MSE and an 8.3% gain in GIFT-Eval MASE compared to competitive baselines. Notably, SATS consistently delivers SOTA performance while achieving a 65.6% increase in model efficiency over advanced baselines, highlighting its effectiveness and scalability in time series pretraining.
56. Orthogonal JEPA: Factorized Predictive States for Latent World Models
正交JEPA:用于潜在世界模型的分解预测状态
AI 总结:该研究提出正交JEPA框架,通过正交预测分解改进潜在世界模型,在多类任务实验中评估了其表示质量、预测、规划及长时程稳定性。
链接:https://arxiv.org/abs/2608.20065
机构:The Chinese University of Hong Kong (CUHK)(香港中文大学(CUHK))
作者:Taoyong Cui, Pheng Ann Heng, Wanli Ouyang
英文摘要:World models construct latent states that support prediction, planning, and reasoning about an underlying system. Joint-embedding predictive architectures (JEPAs) offer a direct way to learn such states by predicting targets in representation space instead of reconstructing every detail of the observation. Standard JEPAs, however, organize all predictable content through one target embedding and one prediction pathway. In complex systems, this monolithic state can allocate redundant capacity to dominant signals while providing weak or conflicting gradients to less dominant predictive structure. We introduce \method, a latent world-modeling framework based on orthogonal predictive factorization. Learned basis matrices analyze each target state into multiple components, and a dedicated prediction branch estimates each component from a shared context representation. Predictive regression preserves the factor magnitudes required for state synthesis, an orthogonality objective discourages repeated directions, factor-activity regularization maintains variation in projected targets, and online variance regularization discourages coordinate-wise encoder collapse. Predicted components are synthesized into a complete latent state that can be used by a readout, decoder, planner, or autoregressive rollout. The same predictive-state mechanism applies when the target is temporally future, spatially hidden, or another partial observation of the same system. Experiments on controlled vision, single-cell transcriptomics, longitudinal health records, continuous control, and molecular dynamics evaluate representation quality, forecasting, planning, and long-horizon stability.
57. SAE-Xplainers: Rule-Based Feature Interpretation for Extreme Earth Events
SAE-Xplainers:面向极端地球事件的基于规则的特征解释器
AI 总结:针对极端地球事件分析中SAE模型可解释性不足的问题,提出基于地理位置调制输入的SAE及规则型SAE-Xplainers集成模型,在火灾预测等三类任务上验证了其性能与解释能力。
链接:https://arxiv.org/abs/2608.20117
作者:Hugo Porta, Emanuele Dalsasso, Chang Xu, Theo Gnassounou, Devis Tuia
英文摘要:The emergence of large-scale Weather and Climate (W&C) datasets offers new opportunities for modeling extreme Earth events (ExEE) and their impacts using deep learning. However, their adoption in operational settings remains limited by the lack of models' interpretability. While for conventional text and image modalities, tools such as Sparse Autoencoders (SAEs) have proven effective for extracting human-understandable concepts, their use for the analysis of ExEE remains challenging due to the nature of W&C data. To address this, we introduce (i) a geographic location-based modulation of the inputs of SAE to capture the local semantic meaning of environmental patterns, and (ii) an ensemble of rule-based SAE-Xplainers to interpret the resulting high-dimensional features derived from complex, multi-modal environmental predictors. We evaluate our method on three ExEE types: the prediction of fires, and the detection of tropical cyclones and atmospheric rivers. We show that SAE input modulation improves both reconstruction performance and feature utilization, and that our SAE-Xplainers enable faithful interpretation of complex climatic patterns by unfolding them into human-understandable rules that are consistent with the scientific literature, while also supporting the identification of feature absorption.
58. Evaluating Neural Cartographic Relief Shading for Urban Environments: A Downtown Calgary Study Using High-Resolution DEM and DSM Data
评估面向城市环境的神经制图地貌晕渲:基于高分辨率DEM和DSM数据的卡尔加里市中心研究
AI 总结:本文对比分析式与基于Eduard的神经地貌晕渲在卡尔加里市中心的性能,探索山地训练的神经晕渲适配城市环境的可能性,明确其优劣场景并提出未来方向。
链接:https://arxiv.org/abs/2608.20149
作者:Emmanuel Stefanakis
英文摘要:This article explores the performance of analytical and neural-based hillshading methods in a dense urban environment using high-resolution digital elevation model (DEM) and digital surface model (DSM) data for downtown Calgary. The study compares single-direction and multi-direction analytical hillshading with relief shading generated in Eduard, a machine-learning system originally developed to emulate Swiss-style shaded relief trained primarily on mountainous landscapes. Because Eduard was not designed for buildings, bridges, streets, trees, and other urban infrastructures, the central question is not whether it perfectly reproduces urban morphology, but whether parameter tuning can nevertheless produce visually strong, cartographically useful, and in some cases superior results when compared with conventional analytical methods. The analysis focuses especially on terrain type, micro and macro generalization, and flat-area detail parameters, while keeping the large-scale shading style constant throughout the neural experiments. The article is structured as an exploratory comparison rather than a benchmark of universal best practice. It aims to identify where analytical hillshading remains more reliable, where Eduard offers unexpected strengths, and where neural shading fails because of its training bias toward alpine terrain. The study contributes to current work on terrain representation by testing whether a neural approach designed for natural landforms can be adapted to a highly built urban setting, and it concludes by arguing for future model training and evaluation specifically targeted at urban relief shading.
59. Ask Self, Ask Others: Relation Is All You Need
询问自身,询问他者:关系即你所需
AI 总结:该研究提出Relation这一token混合原语,衍生出多种关系变体,在不同规模模型上验证其性能,FlashRelation速度优势明显,Hybrid Relation兼具效率与质量,为token混合提供关系优先思路。
链接:https://arxiv.org/abs/2608.20172
机构:City University of Hong Kong(香港城市大学); Jilin University(吉林大学); National University of Singapore(新加坡国立大学)
作者:Yuting Ge, Pengju Yang, Mingkai Nie
英文摘要:Attention directly derives normalized information flow from pairwise scores. We introduce Relation, an alternative token-mixing primitive that first organizes pairwise evidence into explicit Self and Exchange relations and derives information flow afterward. This relational organization gives rise to Full Relation, FlashRelation, Linear Relation, Hybrid Relation, and a KV-style Relation Cache. Across matched decoder-only models at approximately 10M, 30M, and 100M parameters, Full Relation achieves lower final validation NLL than MHA at all three scales. In a fixed-context reference benchmark, FlashRelation is 3.60-4.41x faster than the materialized Full Relation implementation. Across scale-matched production workloads, it reaches 76.4-84.9% of PyTorch FlashAttention throughput while executing the Full Relation operator. Hybrid Relation uses 75% Linear Relation layers and achieves strong language-modeling quality. These results support a relation-first view of token mixing: ask Self, ask Others, then let Flow follow Relation.
60. Exact Algebraic Computation of Learning Coefficients for Two-Dimensional Singular Models
二维奇异模型学习系数的精确代数计算
AI 总结:本文针对二维奇异模型,提出首个可精确计算局部实对数典范阈值(RLCT)的确定性算法,为校准采样估计器提供真值,在浅层区域比采样方法更快。
链接:https://arxiv.org/abs/2608.20183
机构:Sorbonne Université(索邦大学); Inria(法国国家信息与自动化研究院)
作者:Grégoire Sergeant-Perthuis (1), Elias Tsigaridas (2), Jules Tsukahara (2) ((1) CQSB, Sorbonne Université, (2) Ouragan Team, INRIA)
英文摘要:Classical information criteria such as the Bayesian Information Criterion (BIC) rely on regularity assumptions that break down for singular models, leading to incorrect model selection in settings such as deep learning. The Widely Applicable Bayesian Information Criterion (WBIC) relies on local learning coefficients $\lambda$, which in the analytic case coincides with local Real Log Canonical Thresholds (RLCT) of the Kullback-Leibler divergence of the model, to capture correct marginal likelihood asymptotics. Exact computation of the learning coefficients has been limited to special cases, and only sampling-based estimation methods are generally applicable. We present the first deterministic algorithm that computes local RLCTs exactly for any two-dimensional model whose Kullback-Leibler distance is contact equivalent to a polynomial, derive a bound on its complexity, and demonstrate its effectiveness for a broad class of models, with applications including polynomial neural networks. Beyond providing ground truth to calibrate sampling-based estimators, exact computation reveals algebraic structure in learning coefficients that sampling cannot and out-speeds it in the shallow regime.
61. Decoding silent reading from non-invasive EEG
从无创脑电图解码默读内容
AI 总结:本研究以默读为替代任务,用CLIP式对比训练的卷积EEG编码器结合因果Transformer,从EEG中成功解码开放词汇单词级信息,发现解码受数据限制而非饱和。
链接:https://arxiv.org/abs/2608.20186
机构:nubrain
作者:Ingo Marquardt, Anthilia Alchanat, Priyanka Jain
英文摘要:Non-invasive decoding of inner speech faces a fundamental data problem: a corpus pairing brain activity with a person's spontaneous inner monologue cannot be collected, and the available proxy paradigms (cued repetitive and retrospectively reported generative inner speech) are slow to acquire, poorly time-locked, and subject compliance is unverifiable. We therefore treat silent reading as a scalable proxy task and ask how much lexical and semantic information a contrastive decoder can extract from it. We report an open-vocabulary analysis of approximately 240,000 word presentations recorded from a single densely-sampled participant across 393 runs (ca. 49 h) of 19-channel dry-electrode EEG. Words from continuous narrative text were presented in rapid serial visual presentation, with typography randomised on every trial to partially decorrelate word identity from low-level visual form. A convolutional EEG encoder, optionally followed by a causal transformer, was trained with a CLIP-style contrastive objective to align short EEG windows with hidden-state embeddings of the presented word taken from a large language model. Decoding, evaluated as word-grouped top-10 retrieval against permutation baselines, was reliably above chance, extended to mid-frequency and rare words, and scaled log-linearly with training-data volume with no sign of saturation. Removing occipital and posterior-temporal electrodes reduced the word-level gain by roughly one third but left context tracking unchanged. Control analyses separate word-level decoding from narrative context tracking and from a non-neural positional prior introduced by the transformer's positional embedding. These results establish that open-vocabulary word-level information is recoverable from EEG during silent reading, and that decoding is data-limited rather than saturated.
62. DICS: Data-Informed Centroid Splitting for Decision Tree Classifiers
DICS:面向决策树分类器的数据驱动型质心分裂方法
AI 总结:本文提出DICS框架,通过聚类方法减少决策树训练的分裂搜索空间,可集成到多种模型中,在保持准确率的同时缩短训练时间,提升分类树学习的可扩展性。
链接:https://arxiv.org/abs/2608.20258
机构:University of Texas at El Paso(德克萨斯大学埃尔帕索分校)
作者:MD Saifur Rahman Mazumder, Feng Yu
英文摘要:Decision tree-based models are widely used in machine learning due to their interpretability and strong empirical performance. However, training decision trees can be computationally expensive, particularly for large and high-dimensional datasets, largely due to the exhaustive search over candidate splits at each node. To improve computational efficiency, we propose Data-Informed Centroid Splitting (DICS), a clustering-based framework that constructs a compact and informative set of candidate splits using data-driven priors. By incorporating class-aware structure, DICS significantly reduces the split search space for classification tasks while preserving predictive performance. We further provide theoretical analysis showing that under the stated assumptions, DICS does not degrade the performance of classification trees compared to exhaustive split search. DICS can be incorporated into classification trees, random forests, and gradient-boosting models. Extensive experiments demonstrate that DICS achieves comparable accuracy while substantially reducing training time across synthetic and benchmark datasets, highlighting the benefit of integrating data-informed priors into split selection for scalable classification tree learning.
63. Dynamic Structural Causal Modeling for Sleep
用于睡眠的动态结构因果建模
AI 总结:该研究针对睡眠呼吸障碍因果动力学复杂的问题,采用PCMCI+算法结合HSAT记录学习动态因果图,揭示了不同性别年龄亚队列的因果结构差异,为睡眠相关研究提供了新的分析方法。
链接:https://arxiv.org/abs/2608.20285
机构:The University of Texas at Dallas(德克萨斯大学达拉斯分校); TU Darmstadt(达姆施塔特工业大学); ENT & Sleep Medicine of Dallas(达拉斯耳鼻喉与睡眠医学中心)
作者:Ranveer Singh, Saurabh Mathur, Pranuthi Tenali, Arun Badi, Sriraam Natarajan
英文摘要:The causal dynamics of sleep-disordered breathing are complex and vary across patient populations, hindering the development of targeted interventions. We learn dynamic causal graphs of sleep-disordered breathing from Home Sleep Apnea Test (HSAT) recordings, revealing systematic differences in causal structure across sex and age subcohorts. We do so using the PCMCI+ algorithm on windowed fractional variables derived from 105 HSAT recordings, exploiting domain knowledge via edge blacklisting and employing bootstrap aggregation to address small subcohort sizes. The learned graphs show that temporal self-dependencies and the apnea-desaturation relationship persist across all cohorts, while other relationships vary substantially.
64. Physical-Support Confidence Sets for Highly Coherent Dictionaries
高相干字典的物理支撑置信集
AI 总结:针对高相干字典的物理意义不确定性,提出感知分辨率的物理支撑推理方法,引入自适应有限组的AEB算法,实验显示其能避免无支撑细化且评估候选更少。
链接:https://arxiv.org/abs/2608.20295
机构:National Chung Hsing University(中兴大学); Institute of Data Science and Information Computing(数据科学与信息计算研究院)
作者:Guan-Ju Peng
英文摘要:Sparse pursuit after dictionary learning can yield a precise atom support even when its physical interpretation is not justified by the calibration data, especially for highly coherent dictionaries where alternative calibration-compatible dictionaries may assign different physical meanings to the same selected support. We develop resolution-aware physical-support inference that jointly accounts for uncertainty in the learned dictionary and in the representation of a deployment signal. Our cross-dictionary confidence correspondence retains calibration-compatible dictionaries and deployment-compatible sparse representations, then projects the surviving explanations onto physical-support space. For local coherent-atom classes with separation scale s, once the deployment data resolve the coherent-block explanation and its atom support, the minimax physical resolution from N calibration signals satisfies $\delta_{\mathrm{opt}}(N,s)\asymp\min\{s,\frac{1}{\sqrt{N}s^2}\}$, with relative resolution governed by the orientation-information scale $Ns^6$. Deployment replication improves physical localization only when orientation changes cannot be absorbed by adjusting the active coefficients. For computation, we introduce active endpoint bracketing (AEB), an adaptive finite-bank procedure that evaluates only candidates that can still affect the physical report and otherwise safely coarsens or abstains. Finite-bank experiments, including a four-region synthetic application, show that a point-valued plug-in selector can be physically overprecise, whereas AEB avoids unsupported refinement with fewer candidate evaluations.
65. A comparison between ceiling-mounted FMCW, IR-UWB and Wi-Fi radar for in-bedroom human activity monitoring and sleep interruption detection
天花板安装的FMCW、IR-UWB与Wi-Fi雷达在卧室内人体活动监测及睡眠中断检测中的对比
AI 总结:本文对比天花板安装的FMCW、IR-UWB与Wi-Fi雷达的卧室人体活动及睡眠监测性能,发现IR-UWB活动识别精度最高、FMCW布局泛化性最优,三者睡眠监测均超92%,为医疗RF感知系统设计提供指南。
链接:https://arxiv.org/abs/2608.20322
机构:Ghent University(根特大学); imec; KU Leuven(鲁汶大学); Flanders Make(佛兰德斯制造); Televic Healthcare(泰莱维克医疗)
作者:Anton Lambrecht, Reda El Hail, Xianjun Jiao, Pieter Crombez, Dominique Schreurs, Peter Karsmakers, Adnan Shahid, Eli De Poorter
英文摘要:Despite their growing importance for contact-free radio frequency (RF) based healthcare monitoring, different radio technologies such as frequency-modulated continuous wave (FMCW) radar, impulse radio ultra-wideband (IR-UWB), and Wi-Fi sensing are rarely compared under identical deployment conditions, as existing studies typically differ in hardware, datasets, and evaluation methodologies. In addition, the performance of ceiling-mounted radars, despite their practical deployment and cost advantages in healthcare environments, remain underexplored. Therefore, this paper presents a controlled comparison and analysis of ceiling-mounted FMCW, IR-UWB, and Wi-Fi sensing using synchronized recordings from 20 participants across six room layouts. All technologies are evaluated with the same convolutional neural network (CNN) on both a fine-grained 10-class human activity recognition (HAR) task and a coarse 4-class sleep monitoring task. IR-UWB achieves the highest cross-subject activity recognition performance (89.0% macro F1), while FMCW generalizes best to unseen room layouts (83.8% macro F1). For sleep monitoring, all technologies exceed 92% macro F1 in unseen environments. The results reveal a fundamental trade-off between recognition performance and environmental robustness, which can be explained through differences in range resolution, antenna diversity, Doppler resolution, and spatial information retention. These findings provide practical guidelines for the design of healthcare-oriented RF sensing systems.