CERTifAI

This project is a SaaS application dashboard for administation of self-hosted private GenAI (generative AI) toolbox for companies and individuals. The purpose of the dashboard is to manage LLMs, Agents, MCP Servers and other GenAI related features.

The purpose of CERTifAIis to provide self-hosted or GDPR-Conform GenAI infrastructure to companies who do not wish to subscribe to non-EU cloud providers to protect their intellectual property from being used as training data.

Overview

The SaaS application dashboard is the landing page for the company admin to view, edit and manage the company internal GenAI tools. The following tasks can be performed by the administrator:

• User management: Can add, remove, set roles, permissions and add restrictions for other users.
• SSO/Oauth/LDAP: Can connect to company internal SSO/LDAP or other identity provider to load users and their respective permissions.
• Turn features on/off: Turn off/on different GenAI features
• Billing: View the current seats being used and token usage per seat for any given billing cycle
• Request support: Request support or new features using feedback form
• GenAI: View currently running LLMs, Agents, MCP Servers. Modify or add more resources, switch to a different model, launch tools like Langchain + Langfuse for creating new agents,tavily for internet search or more complex tools for use with GenAI. View endpoints and generate API Keys for integrations in other applications.

Development environment

This project is written in dioxus with fullstack and router features. MongoDB is used as a database for maintaining user state. Keycloak is used as identity provider for user management.

Features management

All features are detailed and described under the features folder in clear markdown instructions which are valid for both human and AI code developers.

Code structure

The following folder structure is maintained for separation of concerns:

• src/components/*.rs : All components that are required to be rendered are placed here. These are frontend only, reusable components that are specific for the application.
• src/infrastructure/*.rs : All backend related functions from the dioxus fullstack are placed here. This entire module is behind the feature "server".
• src/models/*.rs : All data models for use by the frontend pages and components.
• src/pages/*.rs : All view pages for the website, which utilize components, models to render the entire page. The pages are more towards the user as they group user-centered functions together in one view.

Git Workflow

We follow feature branch workflow for Git and bringing in new features. The main branch is the default and protected branch. Conventional commits MUST be used for writing commit messages. We follow semantic versioning as per SemVer

CI

The CI is run on gitea actions with runner tags docker.