options if im not using langchain? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		spruce_tips on July 18, 2024 \| parent \| context \| favorite \| on: Ask HN: Devs using LLMs, how are you keeping costs... options if im not using langchain?

ricktdotorg on July 18, 2024 [–]

Cloudflare AI gateway [0]

[0] https://developers.cloudflare.com/ai-gateway/configuration/c...

spruce_tips on July 18, 2024 | [–]

options if im not using cloudflare?

retrovrv on July 19, 2024 | | | [–]

there's an open source ai gateway - https://github.com/Portkey-AI/gateway

throwaway888abc on July 18, 2024 | | | [–]

You can do it easily with object caching / function memorization patterns in any modern language which should fit your desired solution. Best of luck!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact