File input grounding in Prompt Builder
Key Takeaway
When a prompt must process and analyze visual information, ground a Flex prompt template on file inputs (images and PDFs), and use a model that supports file inputs.
File input grounding lets a prompt template in Prompt Builder include images and PDF files. The model can then analyze visual information along with your instructions and record data. The extra context leads to more accurate and relevant responses. The main design choice is whether to ground on specific files you select, or on the Salesforce Files attached to a record through its related list.
When to use file inputs, and what they need
Choose file input grounding when the prompt must process and analyze visual information. A prompt template that uses file inputs needs the following:
- A Flex prompt template. Both ways to add file inputs use one.
- Supported file types: .pdf, .png, and .jpeg. Unsupported files are excluded from the request. After processing, the resolution panel lists the files that were excluded.
- A model that can process file inputs, such as GPT 4 Omni. Not all models support file inputs.