Open challenges in LLM research

→ https://huyenchip.com/2023/08/16/llm-research-open-challenges.html

Reduce and measure hallucinations

Optimize context length and context construction

Incorporate other data modalities

Make LLMs faster and cheaper

Design a new model architecture

Develop GPU alternatives

Make agents usable

Improve learning from human preference

Improve the efficiency of the chat interface

Build LLMs for non-English languages