Show HN: JS Local-only AI Apps starter kit: cost $0 to run and test locally
7 by ykhli | 2 comments on Hacker News.
Hi HN! Here's a local-only stack I built over the weekend - hope it can be useful for you! I have been building a lot of AI apps - https://ift.tt/CXwLegn https://ift.tt/2MYQ8Lq ... And there were definitely times I spent way too much $$ before deploying the app to production. So I was looking for a "local only" stack and found a few tools that worked well together. I used the following set of tools but may add more options later: - Inference: Ollama - VectorDB: Supabase pg-vector - LLM orchestration: langchain - Framework: nextjs My learning from building ai-town was also that many people don't have the luxury of swiping a credit card to test an app with a lot of AI workloads -- not surprisingly, many models on Ollama are already very good - I used llama2-7b for majority of my dev work. Hope this can lower the barrier to entry for building AI apps. :)
7 by ykhli | 2 comments on Hacker News.
Hi HN! Here's a local-only stack I built over the weekend - hope it can be useful for you! I have been building a lot of AI apps - https://ift.tt/CXwLegn https://ift.tt/2MYQ8Lq ... And there were definitely times I spent way too much $$ before deploying the app to production. So I was looking for a "local only" stack and found a few tools that worked well together. I used the following set of tools but may add more options later: - Inference: Ollama - VectorDB: Supabase pg-vector - LLM orchestration: langchain - Framework: nextjs My learning from building ai-town was also that many people don't have the luxury of swiping a credit card to test an app with a lot of AI workloads -- not surprisingly, many models on Ollama are already very good - I used llama2-7b for majority of my dev work. Hope this can lower the barrier to entry for building AI apps. :)