DIFFLET: A Fast Inference Engine for Diffusion Transformer Models on AWS Trainium
硬件推理加速，非通用模型，暂不可用
On AWS Trainium2, every component of a diffusion model runs as a program compiled ahead of time for fixed shapes, while pipelines differ across models, prompt lengths across requests, and caching decisions across denoising steps. We present Difflet, a serving engine in which five
判断口径 agnes-3.0-flash · 入库 #86 · 回首页