Privacy and Data Collection

At launch, the AI Gateway supports public and private-restricted data classifications. It is not currently appropriate for use with private-highly restricted data (HIPAA, etc). We are actively working to put in place the necessary compliance paperwork to enable those cases.

The gateway does not store any prompt or response data. The models used by the gateway are all "zero retention" models, meaning that they do not retain any data from the prompts or responses. The gateway does not log any prompt or response data to any external systems.