Nice post Clouded! I think about it like this. General purpose LLMs are like the desktop PC. They can be for specific use cases or general. They can have different specs, “context window” = RAM. System prompts (and controller prompts) are the OS of an LLM telling it what it knows, how to behave, what to prioritize. This is similar to a computer OS which knows, the file system, the boot instructions, drivers and so on. Finally, the user’s prompts are like software, which tell the PC or in this case the LLM what the user needs. Today, I need a recipe for pulled pork :). It’s all pretty cool.
Agree - some nice references to use cases close to my heart.
Nice post Clouded! I think about it like this. General purpose LLMs are like the desktop PC. They can be for specific use cases or general. They can have different specs, “context window” = RAM. System prompts (and controller prompts) are the OS of an LLM telling it what it knows, how to behave, what to prioritize. This is similar to a computer OS which knows, the file system, the boot instructions, drivers and so on. Finally, the user’s prompts are like software, which tell the PC or in this case the LLM what the user needs. Today, I need a recipe for pulled pork :). It’s all pretty cool.