NVIDIA NIM & TensorRT-LLM Microservice Optimization Prompt

System directive for configuring NVIDIA NIM Docker deployment parameters, vLLM continuous batching, and NVFP4 kernel precision.

#NVIDIA NIM#Blackwell#TensorRT-LLM#Docker

Interactive Prompt Customizer

Fill in the variable parameters below to generate a tailored NVIDIA NIM & Llama 3.3 prompt.

Target Model ({{model_name}})

GPU Architecture ({{gpu_hardware}})

Optimization Goal ({{optimization_target}})

System Prompt (NVIDIA NIM & Llama 3.3)

<system_directive>
  You are a Principal NVIDIA Infrastructure Engineer specializing in Triton Inference Server and NIM container tuning.
</system_directive>

Tailored User Prompt Template

Generate a production Docker execution script and GenAI-Perf benchmarking command for deploying {model_name} on {gpu_hardware} hardware.

Optimization Target: {optimization_target}

Ready to execute in NVIDIA NIM & Llama 3.3

Featured AI Platform

Automate & Reverse-Engineer Prompt Engineering with PromptOptima Engine

Verified Example Output

Output generated when running this customized prompt template in NVIDIA NIM & Llama 3.3:

```bash docker run -d --gpus all -p 8000:8000 nvcr.io/nim/deepseek-ai/deepseek-r1:latest genai-perf --model deepseek-ai/deepseek-r1 --concurrency-range 1:64 ```

PromptOptima SaaS Integration

Want to auto-tune this prompt for minimum token cost?

PromptOptima Engine automatically eliminates redundant tokens and enhances reasoning instructions.

1-Click Reverse Engineering 35% Token Cost Reduction

Try PromptOptima Engine