Practical overview
When it fits
Use it when you need a repository-based workflow for experimenting with Chinese medical image question answering, rather than a hosted clinical application.
Who it is for
- Researchers and developers building or fine-tuning Chinese medical vision-language models.
- Teams evaluating model responses on medical image question-answering tasks.
Documented uses
- Explore model responses to tissue-slide, chest X-ray and CT images.
- Fine-tune a medical multimodal model using the supplied instruction dataset.
- Generate and score responses against the supplied evaluation set.
- Run an interactive inference chat through LLaMA-Factory.
Requirements & limits
The repository is public and lists an Apache-2.0 license.
- The README's full fine-tuning example uses distributed PyTorch with two CUDA devices.
- The supplied datasets are a 60,000-item instruction-tuning set and a 115-item evaluation set.
- The reported benchmark score is tied to the named evaluation set and scoring approach.
Check current requirements in the official documentation. Source-based guidance does not mean OpenViST has run or independently tested this project.
Set up the documented LLaMA-Factory inference chat
Open an interactive chat interface using the final model and the repository's inference configuration.
Before you start
- The Chinese Llava Med repository and its inference configuration.
- LLaMA-Factory installed in the environment.
Steps
Install LLaMA-Factory using the README's documented installation command.
Run
llamafactory-cli webchat config/llava1_5_full_sft_infer.yamlfrom the repository context.
Expected outcome
The documented command starts an interactive webchat interface using the inference configuration.
Guide limitations
- The README describes the interface but not deployment beyond it.
Fine-tune and export a medical vision-language model
Follow the repository's documented full fine-tuning and export stages with LLaMA-Factory.
Before you start
- LLaMA-Factory installed with the documented
torchandmetricsextras. - The repository's
config/llava1_5_full_sft.yamlandconfig/llava1_5_full_sft_export.yamlfiles. - Two CUDA devices for the README's full fine-tuning example.
Steps
Install LLaMA-Factory using the README's documented commands.
Run the distributed training command with
config/llava1_5_full_sft.yaml.Set
export_hub_model_idandhf_hub_tokeninconfig/llava1_5_full_sft_export.yaml.Run the documented LLaMA-Factory export command.
Expected outcome
The documented workflow trains a model and proceeds to its export stage.
Guide limitations
- The README also offers a LoRA YAML configuration, but its detailed execution steps are not shown in the supplied instructions.
Compare options for Model inference and serving
These projects document a common task and share a project role. This is a source-based comparison, not an execution benchmark or a guarantee of interchangeability.
| Project | Documented purpose | Platform | Access and requirements |
|---|---|---|---|
| Chinese Llava Med | Explore model responses to tissue-slide, chest X-ray and CT images. | CLI, Linux | The repository is public and lists an Apache-2.0 license. |
| Pulse Of Motion | Estimate a video's physical frame rate from its visual dynamics. | Linux | The repository is public. Its README describes a released checkpoint that downloads from Hugging Face on first inference, with a manual download option. The strongest internal model is not fully released; the README directs interested users to contact the project about access. No license information is provided in the repository evidence. |
| Neural Image Assessment | Train the model using AVA images and rating annotations. | Cloud, Linux, macOS, Windows |
Sources & review
Source record details
- Source availability
- Active
- Sources checked
- 16 October 2026
- Original website title
- BUAADreamer/Chinese-LLaVA-Med · Official homepage title · retained in its source language

