IEEE

Deformable Convolution-Guided Multiscale Feature Learning and Fusion for UAV Object Detection

Abstract: Object detection (OD) in unmanned aerial vehicle (UAV) images faces many challenges, with diverse-scale objects and small objects being particularly prominent issues. To alleviate these ...
IEEE

Mixing Self-Attention and Convolution: A Unified Framework for Multisource Remote Sensing Data Classification

Abstract: Convolution and self-attention are two powerful techniques for multisource remote sensing (RS) data fusion that have been widely adopted in Earth observation tasks. However, convolutional ...
GitHub

Benjamin-Walker/structured-linear-cdes

Don't be Dense, SLiCE the Cost! Structured Linear Controlled Differential Equations (SLiCEs) are a new class of sequence models that combine the maximal expressivity (i.e., universality) of dense, ...
GitHub

Simple linear attention language models balance the recall-throughput tradeoff.

Based is an efficient architecture inspired by recovering attention-like capabilities (i.e., recall). We do so by combining 2 simple ideas: Short sliding window attention (e.g., window size 64), to ...