📊Analyse de donnéesAdvancedAll AIs

Profile model inference latency

Optimize model inference speed

Paste in your AI

Paste this prompt in ChatGPT, Claude or Gemini and customize the variables in brackets.

Write Python code to profile the inference latency of a [model type] across different batch sizes (1, 8, 32, 128, 512). Measure: p50, p95, p99 latency and throughput (predictions/second). Identify the optimal batch size, memory usage per batch, and recommend optimizations (quantization, ONNX export, TorchScript).

Personalize this prompt with Léa

Answer 3 questions and Léa tailors the prompt to your situation.

Use Cases

Optimize model inference speed

Improve this prompt

Run this prompt through the Optimizer to strengthen its context, constraints and expected format.

Improve this prompt with the Optimizer

Comments

Be the first to comment on this prompt.

Glossary Terms

Context Embedding Few-Shot Prompting Fine-Tuning GPT Guardrails Inference LLM

📬 Get new prompts every week

Join our newsletter and never miss a prompt.

Go further

Improve this prompt with the Optimizer

Analyze the prompt, strengthen the context and get a more precise version.

Prompt Engineering

Cross-model principles for writing more reliable prompts.

Similar Prompts

📊Analyse de donnéesAdvancedAll AIs

Build a recommendation system

Build recommendation systems

0103

📊Analyse de donnéesBeginnerAll AIs

Create an automated EDA report

Generate EDA reports automatically

098

📊Analyse de donnéesIntermediateAll AIs

Statistical Power Analysis

Planning a statistical experiment

0121

📊Analyse de donnéesAdvancedAll AIs

Create a data strategy proposal

Propose data initiatives strategically

0116