• PolarisFx@lemmy.dbzer0.com
    link
    fedilink
    arrow-up
    2
    ·
    edit-2
    1 year ago

    I had couple 13B models loaded in, it was ok. But I really wanted a 30B so I got a runpod. I’m using it for api, I did spot pricing and it’s like $0.70/hour

    I didn’t know what to do with it at first, but when I found Simply Tavern I kinda got hooked.