Home Sign Up Sign In
Advertisement
lyang

请教， torchrun 多卡启动大模型，可以用 fastapi 调用吗

  •   
  •   lyang · May 17, 2024 · 1090 views
    This topic created in 726 days ago, the information mentioned may be changed or developed.

    如题，可以把 fastapi 写进代码里面，torchrun 调用吗

    还是通过 torchrun 读取数据库接口等信息，fastapi 写入数据库读取结果

    No Comments Yet
    torchrunFastAPI多卡
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Solana   ·   5651 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 31ms · UTC 07:31 · PVG 15:31 · LAX 00:31 · JFK 03:31
    ♥ Do have faith in what you're doing.