Top Important LLM Papers for the Week from 18/12 to 24/12

Stay Updated with Recent Large Language Models Research

Every week, several top-tier academic conferences and journals showcased innovative research in computer vision, presenting exciting breakthroughs in various subfields such as image recognition, vision model optimization, generative adversarial networks (GANs), image segmentation, video analysis, and more.

This article provides a comprehensive overview of the most significant papers published in the third week of December 2023, highlighting the latest research and advancements in computer vision. Whether you’re a researcher, practitioner, or enthusiast, this article will provide valuable insights into the state-of-the-art techniques and tools in computer vision.

Table of Contents:

1. LLM Progress & Benchmarking

2. LLM Fine Tuning

3. LLM Reasoning

4. LLM Training & Evaluation

5. Responsible AI & LLM Ethics

6. Transformers & Attention Models

---

---

1. LLM Progress & Benchmarking

1. Amphion: An Open-Source Audio, Music, and Speech Generation Toolkit

2. Challenges with unsupervised LLM knowledge discovery

3. Extending Context Window of Large Language Models via Semantic Compression

4. M3DBench: Let’s Instruct Large Models with Multi-modal 3D Prompts

5. Gemini: A Family of Highly Capable Multimodal Models

6. Paloma: A Benchmark for Evaluating Language Model Fit

7. Mini-GPTs: Efficient Large Language Models through Contextual Pruning

8. LLM in a flash: Efficient Large Language Model Inference with Limited Memory

9. PowerInfer: Fast Large Language Model Serving with a Consumer-grade GPU

10. Cascade Speculative Drafting for Even Faster LLM Inference

11. Topic-VQ-VAE: Leveraging Latent Codebooks for Flexible Topic-Guided Document Generation

12. Faithful Persona-based Conversational Dataset Generation with Large Language Models

---

2. LLM Fine Tuning

1. Time is Encoded in the Weights of Finetuned Language Models

---

3. LLM Reasoning

1. ReST meets ReAct: Self-Improvement for Multi-Step Reasoning LLM Agent

---

4. LLM Training & Evaluation

1. Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervision

2. Self-Evaluation Improves Selective Generation in Large Language Models

3. G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language Model

4. ProTIP: Progressive Tool Retrieval Improves Planning

5. Catwalk: A Unified Language Model Evaluation Framework for Many Datasets

---

5. Transformers & Attention Models

1. Point Transformer V3: Simpler, Faster, Stronger

2. Weight subcloning: direct initialization of transformers using larger pretrained ones

3. Cached Transformers: Improving Transformers with Differentiable Memory Cache

---

Are you looking to start a career in data science and AI and do not know how? I offer data science mentoring sessions and long-term career mentoring:

• Mentoring sessions: https://lnkd.in/dXeg3KPW

• Long-term mentoring: https://lnkd.in/dtdUYBrM