Arxiv Papers

HYPERSTEER introduces hypernetwork architectures for generating effective steering vectors in language models, outperforming existing methods and achieving strong performance on unseen prompts. Code available at GitHub. https://arxiv.org/abs//2506.03292 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:07:49

HYPERSTEER: Activation Steering at Scale with Hypernetworks

Duration:00:09:15

[QA] Data Recipes for Reasoning Models

The OpenThoughts project creates open-source datasets for reasoning models, achieving state-of-the-art results with OpenThinker3-7B, trained on 1.2M examples, available at openthoughts.ai. https://arxiv.org/abs//2506.04178 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:08:06

Data Recipes for Reasoning Models

Duration:00:18:07

[QA] Accelerating Diffusion LLMs via Adaptive Parallel Decoding

The paper introduces adaptive parallel decoding (APD), enhancing diffusion large language models' speed by dynamically adjusting token sampling, improving throughput while maintaining quality compared to autoregressive models. https://arxiv.org/abs//2506.00413 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:08:08

Accelerating Diffusion LLMs via Adaptive Parallel Decoding

Duration:00:21:09

[QA] Reflect, Retry, Reward: Self-Improving LLMs via Reinforcement Learning

This paper presents a self-reflection and reinforcement learning method that enhances large language models' performance on complex tasks, achieving significant improvements even with limited feedback. https://arxiv.org/abs//2505.24726 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:07:34

Reflect, Retry, Reward: Self-Improving LLMs via Reinforcement Learning

Duration:00:16:44

[QA] Esoteric Language Models

Eso-LMs combine autoregressive and masked diffusion models, improving perplexity and inference efficiency with KV caching, achieving state-of-the-art performance and significantly faster inference rates. Code and checkpoints available online. https://arxiv.org/abs//2506.01928 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:08:08

Esoteric Language Models

Duration:00:34:16

[QA] Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoning

This study explores Reinforcement Learning with Verifiable Rewards (RLVR) through token entropy patterns, revealing that high-entropy tokens significantly enhance reasoning performance in Large Language Models. https://arxiv.org/abs//2506.01939 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:08:08

Beyond the 80/20 Rule: High-Entropy Minority Tokens Drive Effective Reinforcement Learning for LLM Reasoning

Duration:00:23:02

[QA] ALPHAONE: Reasoning Models Thinking Slow and Fast at Test Time

ALPHAONE is a framework that enhances reasoning in large models by dynamically modulating thinking phases, improving efficiency and performance across various challenging benchmarks. https://arxiv.org/abs//2505.24863 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:07:21

ALPHAONE: Reasoning Models Thinking Slow and Fast at Test Time

Duration:00:17:12

[QA] ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Models

This paper introduces ProRL, a training method that enhances reasoning in language models through reinforcement learning, revealing novel strategies and outperforming base models in various evaluations. https://arxiv.org/abs//2505.24864 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:07:40

ProRL: Prolonged Reinforcement Learning Expands Reasoning Boundaries in Large Language Models

Duration:00:23:32

[QA] Are Reasoning Models More Prone to Hallucination?

This paper investigates hallucination in large reasoning models, analyzing post-training effects, cognitive behaviors, and model uncertainty, revealing insights into their impact on factual accuracy. https://arxiv.org/abs//2505.23646 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:07:52

Are Reasoning Models More Prone to Hallucination?

Duration:00:20:24

[QA] How does Transformer Learn Implicit Reasoning?

This paper explores implicit multi-hop reasoning in large language models, revealing a developmental trajectory and introducing diagnostic tools to enhance interpretability and understanding of reasoning processes. https://arxiv.org/abs//2505.23653 YouTube: https://www.youtube.com/@ArxivPapers TikTok: https://www.tiktok.com/@arxiv_papers Apple Podcasts: https://podcasts.apple.com/us/podcast/arxiv-papers/id1692476016 Spotify: https://podcasters.spotify.com/pod/show/arxiv-papers

Duration:00:08:56

How does Transformer Learn Implicit Reasoning?