GitHub - microsoft/aici: AICI: Prompts as (Wasm) Programs

The Artificial Intelligence Controller Interface (AICI) lets you build Controllers that constrain and direct output of a Large Language Model (LLM) in real time. Controllers are flexible programs capable of implementing constrained decoding, dynamic editing of prompts and generated text, and coordinating execution across multiple, parallel generations. Controllers incorporate custom logic during t

[misshiki]

“Artificial Intelligence Controller Interface (AICI)では、大規模言語モデル(LLM)の出力をリアルタイムで制約し、指示するコントローラを構築することができます。”

[igrep]

"lets you build Controllers that constrain and direct output of a Large Language Model (LLM) in real time. Controllers are flexible programs capable of implementing constrained decoding, dynamic editing of prompts and generated text, and coordinating execution across multiple, parallel generations."