Title: Generative AI service for AIN DAO community members(As a discord bot)
Author: DHBaek#6937
Date posted: 2023/05/22
Summary
- Making service that can be used by members of the AIN DAO community.
- Text to image discord bot based on Stable Diffusion
Background
- The open source text-to-image market has exploded since the introduction of Stable Diffusion in mid-2022.
- Stable Diffusion has also been widely used by the general public because it make users to get the image they want by just typing in text.
- Parameter Efficient Fine Tuning (PEFT) such as LoRA has been used to Stable Diffusion, and users can train their own models using GPUs on their PC(Personal Computer), resulting in a lot of derivative models including animations and realistic images.
- However, there are still barriers to entry, such as the need for a GPU to train and use the model.
- Therefore, many companies have launched services that charge users a fee and return the model “for them”.
- Similarly, i thought that by utilizing the GPU resources in AIN DAO, i could create a service that uses a Stable Diffusion model, and i would like to release it to the AIN DAO Discord community.
Scope of Work
- Goals
- Text to image discord bot based on Stable Diffusion
- Features
- Model Inference Server, Discord bot, community
Timeline
2023 ~
- Step 1 : Making model inference server
- Step 2 : Making discord bot
- Step 3 : Serving discord bot on AIN DAO community(Use GPU for service)
Specification
- The goal of this project is developing Text to image generation discord bot for AIN DAO community members.
- The project can be roughly divided into two parts
- Model inference server
- Inferences the model and response the results
- Model inference server also can be roughly divided into two parts
- API Server
- Receive requests from user
- GPU Worker
- Inference model using GPU
- API Server
- Also, since model inference can take a few seconds to tens of seconds, we use a message queue between the API server and the worker to process requests asynchronously.
- Discord bot
- Can be used by users.
- Image generation can be done with the slash command, like Midjourney, and user can set parameters using image generation as command options.
- Two bots will be released
- Text-to-art : User can use Stable Diffusion models
- Text-to-anime : User can use an fine-tuned animation model based on stable diffusion
- Model inference server
Request
- Description: Resources request for this project
- Resource(Support) type & amount
- For dev
- A100 80G x1 : Text To Art - Stable Diffusion V2.1
- A100 80G x1 : Text To Art - Stable Diffusion V2.0-768
- A100 80G x1 : Text To Art - Stable Diffusion V2.1-768
- A100 80G x1 : Text To Art - Open Journey 2.0
- For Prod
- A100 80G x1 : Text To Art - Stable Diffusion V1.4
- A100 80G x1 : Text To Art - Stable Diffusion V1.5
- A100 80G x1 : Text To Art - Stable Diffusion V2.0
- A100 80G x1 : Text To Art - Stable Diffusion V2.1
- A100 80G x1 : Text To Art - Stable Diffusion V2.0-768
- A100 80G x1 : Text To Art - Stable Diffusion V2.1-768
- A100 80G x1 : Text To Art - Open Journey 2.0
- A100 80G x1 : Text To Anime - Anything v4.0
- A100 80G x2 : Text To Art - SR
- Total
- DGX A100 80G Station x1 + A100 80G x6
- For dev
- Date: 2023 ~
- Impact: Add AI-based service AIN DAO community members can enjoy. For AIN DAO creators, it can be a place to create AI-based content, for AIN DAO developers, it can be a motivation to create another AI service; and for AIN DAO captains, they can see that their resources are being used for AI services. In the future, it may be possible to integrate with AIN Credit, to make content that can burn AIN.
Targets
- Launching 2 discord bot(Text-to-art, Text-to-anime)
- 5,000 users use Discord bot
Participants
- Donghoon Baek : DevRel Engineer at Common Computer. He is interested in making ai services that users can use easily and thinks generative ai realizes it.