DIFFLET: A Fast Inference Engine for Diffusion Transformer Models on AWS Trainium
AWS专用推理引擎论文，未放权重或开源代码，普通用户不可用
On AWS Trainium2, every component of a diffusion model runs as a program compiled ahead of time for fixed shapes, while pipelines differ across models, prompt lengths across requests, and caching decisions across denoising steps. We present Difflet, a serving engine in which five
判断口径 agnes-3.0-flash · 入库 #2256 · 回首页