Challenge, approach, and impact

• Optimization patterns

  Customizing large language models for specific business problems is challenging because there are many options, and the approaches and language are often inconsistent. The choice comes down to optimizing the prompt for a general model or fine-tuning a model on your data.

• Scaling prompt engineering

  While it’s straightforward for simple use cases, when building production applications, you run into many challenges, such as ambiguity in how large language models ingest and generate results, compatibility of prompts between different large language models, and maintaining them.