GenAI “Riffs”. You Are Going to Have to Deal With It

If you think about it, GenAI is the ultimate improvisation engine. Ask a question and it will take what it knows and any additional guidance you give it and come up with an answer on the spot. With respect to code generation, this is a strength. Instead of writing pages of SQL or Python to cover every possible scenario, you get a dynamic capability that adapts to the request.

However, due to its nature, GenAI rarely answers the question or writes code the same way twice. And that can cause issues. For example, some times it aliases table and column names and some times it does not. Which means some times the SQL runs fine and some times it does not.

This is where AI operations comes in. There are ways to let GenAI know what went wrong and 999 times out of 1000 it will get the code right on the second try.

So if you are looking to use GenAI as a dynamic code generator, remember to take into consideration "riffing" and come up with ways to address it.

Ps. "Riffing" is another attempt to knock coining a commonly used industry term off my career bucket list (the "AI Depot" failed miserably). If you like it, use it gratuitously and send some credit back my way.