Demo Platform vLLM Master Class
Links
Red Hat

Default Title

    • vLLM Master Class
      • Deploying vLLM
        • Deploying vLLM with S3
        • Deploying vLLM with PVCs
        • Deploying vLLM with ModelCar Image
          • Building ModelCar Image
          • Deploying ModelCar Image
        • Deploying vLLM via Helm
      • Deplying Multi-Node vLLM
      • Securing vLLM Endpoints
      • Load Testing vLLM
      • Understanding LLM Models
      • Customizing vLLM Instances
  • Default Title
    • master
  • Default Title
  • vLLM Master Class
  • Deploying vLLM
  • Deploying vLLM with ModelCar Image

Deploying a vLLM instance with ModelCar

Objective

In this section, you will deploy a vLLM instance using Model Car.

Instructions

Let’s go over how to build then deploy our model car image.

  • Building a ModelCar Image

  • Building a ModelCar Image

Deploying vLLM with PVCs Building ModelCar Image

Powered by

Demo Platform