Interpretable Peripheral Blood Cell Classification via Zero-Shot Vision-Language Concept Bottleneck and Soft Decision Tree

<jats:title>Abstract</jats:title> <jats:sec> <jats:title>Motivation</jats:title> <jats:p>Deep learning classifiers for medical image analysis typically function as black boxes, disclosing neither the image features underlying their predictions nor the reasoning by which individual decisions are reached. Peripheral blood cell classification exemplifies this challenge: experienced laboratory professionals identify cell types through structured morphological criteria—nucleus shape, chromatin texture, nucleus-to-cytoplasm ratio, granularity, and staining properties—yet existing automated systems cannot express their reasoning in these same terms, impeding clinical audit and verification.</jats:p> </jats:sec> <jats:sec> <jats:title>Results</jats:title> <jats:p>We present a two-stage interpretable pipeline that addresses both levels of opacity. In the first stage, a frozen domain-adapted vision-language model (ConceptCLIP) projects each cell image onto a 70-dimensional vector of morphological concept scores via zero-shot cosine similarity, eliminating the need for per-image concept annotations. In the second stage, a Soft Decision Tree (SDT) classifies cells solely on these concept scores, producing a deterministic, concept-based decision path for each prediction. On BloodMNIST (eight cell types, 3,421 test images), the full pipeline achieves 94.86% test accuracy—approximately 3 percentage points below the black-box ceiling—while providing fully traceable decision logic. Post-training histological annotation confirms that the learned routing logic aligns with established hematological morphology criteria and reveals an emergent separation of immature granulocyte subtypes (promyelocyte versus metamyelocyte) without subtype supervision, demonstrating that concept-based decision trees can recover clinically meaningful distinctions beyond the granularity of the training labels.</jats:p> </jats:sec> <jats:sec> <jats:title>Availability and implementation</jats:title> <jats:p> The source code, trained SDT weights, precomputed concept score data, and inference scripts are publicly available at <jats:ext-link xmlns:xlink="http://www.w3.org/1999/xlink" ext-link-type="uri" xlink:href="https://github.com/aquamarineaqua/CLIP-CBM-SoftDecisionTree">https://github.com/aquamarineaqua/CLIP-CBM-SoftDecisionTree</jats:ext-link> . </jats:p> </jats:sec>