Arxiv Papers

This study identifies unique output patterns in Large Language Models, achieving 97.1% classification accuracy in distinguishing models based on text, revealing insights into their semantic content and training implications. https://arxiv.org/abs//2502.12150 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:07:38

Idiosyncrasies in Large Language Models

Duration:00:20:37

[QA] SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features

https://arxiv.org/abs//2502.14786 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:07:36

SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features

Duration:00:20:03

[QA] Position: Graph Learning Will Lose Relevance Due To Poor Benchmarks

The paper advocates for improved benchmarking in graph learning, emphasizing real-world applications and collaboration with domain experts to enhance drug design and molecular property prediction. https://arxiv.org/abs//2502.14546 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:07:31

Position: Graph Learning Will Lose Relevance Due To Poor Benchmarks

Duration:00:27:24

[QA] RocketKV: Accelerating Long-Context LLM Inference via Two-Stage KV Cache Compression

RocketKV is a training-free KV cache compression strategy that reduces memory demands during decoding, achieving up to 3x speedup and 31% memory reduction with minimal accuracy loss. https://arxiv.org/abs//2502.14051 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:07:37

RocketKV: Accelerating Long-Context LLM Inference via Two-Stage KV Cache Compression

Duration:00:20:26

[QA] Autellix: An Efficient Serving Engine for LLM Agents as General Programs

Autellix is an LLM serving system that optimizes program execution by minimizing latencies and improving throughput by 4-15× through advanced scheduling algorithms, addressing head-of-line blocking issues. https://arxiv.org/abs//2502.13965 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:08:03

Autellix: An Efficient Serving Engine for LLM Agents as General Programs

Duration:00:35:50

[QA] Small Models Struggle to Learn from Strong Reasoners

The study reveals the Small Model Learnability Gap, showing that smaller models benefit more from simpler reasoning chains. Mix Distillation improves their performance by balancing reasoning complexity. https://arxiv.org/abs//2502.12143 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:06:48

Small Models Struggle to Learn from Strong Reasoners

Duration:00:13:23

[QA] TokenSkip: Controllable Chain-of-Thought Compression in LLMs

TokenSkip enhances LLM reasoning by selectively skipping less important tokens in Chain-of-Thought outputs, reducing inference latency while maintaining performance, demonstrated through extensive experiments. Code available online. https://arxiv.org/abs//2502.12067 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:07:10

TokenSkip: Controllable Chain-of-Thought Compression in LLMs

Duration:00:18:04

[QA] Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention

https://arxiv.org/abs//2502.11089 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:07:40

Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention

Duration:00:26:01

[QA] (How) Can Transformers Predict Pseudo-Random Numbers?

This paper investigates Transformers' ability to learn pseudo-random sequences from linear congruential generators, revealing their capacity for in-context prediction and generalization to unseen moduli through algorithmic structures. https://arxiv.org/abs//2502.10390 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:07:57

(How) Can Transformers Predict Pseudo-Random Numbers?

Duration:00:21:33

[QA] Do Large Language Models Reason Causally Like Us? Even Better?

The study compares causal reasoning in humans and four large language models, revealing varying degrees of normative behavior and highlighting the importance of assessing AI biases in decision-making. https://arxiv.org/abs//2502.10215 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:08:02

Do Large Language Models Reason Causally Like Us? Even Better?