How to tackle unreliability of coding assistants

• outlines

  33 6,311 9.7 Python

  Structured Text Generation

  

I feel like the work on using CFGs with LLMs should be low-hanging fruit for improving code assistants, but perhaps someone more knowledgeable could chime in.

At lot of the confabulations we see today - non-existent variables, imports and APIs, out-of-scope variables, etc - would seem (to me) to be meaningfully addressable with this technique.

[1] https://github.com/outlines-dev/outlines

[2] https://github.com/ggerganov/llama.cpp/pull/1773

[3] https://www.reddit.com/r/LocalLLaMA/comments/156gu8c/d_const...

• llama.cpp

  791 59,810 10.0 C++

  LLM inference in C/C++

I feel like the work on using CFGs with LLMs should be low-hanging fruit for improving code assistants, but perhaps someone more knowledgeable could chime in.

At lot of the confabulations we see today - non-existent variables, imports and APIs, out-of-scope variables, etc - would seem (to me) to be meaningfully addressable with this technique.

[1] https://github.com/outlines-dev/outlines

[2] https://github.com/ggerganov/llama.cpp/pull/1773

[3] https://www.reddit.com/r/LocalLLaMA/comments/156gu8c/d_const...

• Scout Monitoring

  www.scoutapm.com featured

  Free Django app performance insights with Scout Monitoring. Get Scout setup in minutes, and let us sweat the small stuff. A couple lines in settings.py is all you need to start monitoring your apps. Sign up for our free tier today.

  

• sysaidmin

  4 138 7.3 Python

  A GPT-powered sysadmin.

I decided to cut out the middleman:

https://github.com/skorokithakis/sysaidmin/

Suggest a related project