Skip to main content

VLLM Provider

Prerequisites​

You must first install Vllm download a model like Qwen/Qwen2.5-VL-7B-Instruct, and run the server. Here is some quick reference to get started with Qwens 2.5 VL models.

Most Basic Schema​

~/.config/gowall/schema.yml
schemas:
  - name: "vllm"
    config:
      ocr:
        provider: "vllm"
        model: "Qwen/Qwen2.5-VL-7B-Instruct"
gowall ocr img.png -s vllm

Please refer to the schemas section for more information on how to use schemas with rate limiting,pre/post processing options,text correction etc...