Considerations on deploying LLM-based workflows
2025-02-25
Let me start with a disclaimer. These thoughts come from a startup perspective where funds and personnel are a bit scarce. There’s a lot of generalizations and assumptions made here as well; take them with a pinch of salt. In just a short span of time, the speed of improvements to LLMs, especially the mainstream ones, are short of astonishing. The massive ones are getting smarter, faster, and more accurate. And even better, the open ones, such as Llama, DeepSeek, Gemma, Qwen, etc.
AI · Deployment · Genai · Llm · Programming · Software · Systems · Tech
6 minutes
2024-08-25
TL;DR: To my fellow system builders, don’t dismiss it but understand how it works. As the saying goes, “a tool is only as good as the hands that wield it”. As a software craftsman, your tools are important. And equally so, are your skills in using them effectively. ~~ There’s no escaping GenAI nowadays, is there? I’m sure you’ve seen the full spectrum of its effects by now; from total naysayers to skeptics, to cautious optimists, to proponents and fanatics, to full-blown doom-bringers.
5 minutes