TibbScholar is a specialized, 3-billion-parameter language model fine-tuned for medical question-answering. It is based on Meta's Llama-3.2-3B model and is designed to serve as an informational tool for educational and research purposes.
This model was trained on a large subset of the MIRIAD-4.4M dataset to provide concise, structured answers to medical queries.
Model Details:
-
Base Model: unsloth/Llama-3.2-3B-unsloth-bnb-4bit
-
Fine-tuning Dataset: A 100,000 record subset of MIRIAD-4.4M.
-
Prompt Format: A simple Question/Answer structure (see below).
-
Training Framework: Fine-tuned using Unsloth AI's library with QLoRA for efficient training.
