← 返回信息流

arXiv cs.LG论文

SACQ:用于长周期预测的结构化解码与记忆条件细化方法

arxiv.org作者:Guo Cheng, Zhengzhuo Xu, Chenchen Jing, Jingyi Hou论文AI评分:70/100

该论文针对长期时间序列预测(LTSF)中传统基于patch的编码器将历史记忆映射到未来步骤时存在的隐式耦合问题,提出了一种名为SACQ的新方法。该方法通过结构化解码和记忆条件细化技术,改善了特定位置的历史-未来对齐效果,并降低了对输入噪声和极端监督噪声的敏感度。

这篇是正式发表的长论文,站内提供中文解读,全文请到原文阅读 PDF。

Abstract:Long-term time series forecasting (LTSF) models predominantly employ patch-based encoders terminated by a flatten readout head that maps the entire encoded historical memory to all future steps through a single shared projection. This implicit coupling of future positions obscures position-specific historical-to-future alignment and amplifies sensitivity to corrupted inputs and extreme supervision noise. We present SACQ, a plug-in structured prediction head that replaces flatten readout while keeping the encoder unchanged. SACQ adopts a two-stage decoding pipeline: it first establishes a coarse patch-grid forecast scaffold, then refines each future position through cross-attention over historical memory and merges the attention-derived correction with the coarse scaffold via a learned per-patch gate. To stabilize optimization under long horizons and noisy labels, we further propose a batch-adaptive scaled log-cosh loss that automatically calibrates robustness to the current residual scale, suppressing outlier gradients while preserving MSE-like sensitivity for typical errors. SACQ attains top-tier test MSE/MAE across PatchTST, DLinear, and patch-Mamba backbones with only modest incremental overhead in parameters and latency. Under inference-time input corruption and training-set label-noise stress tests, SACQ substantially outperforms flatten readouts, with ablation studies validating each architectural component.

阅读原文