- Combining literature-based and data-driven methods produced the best performance across tasks. The integrated approach improved improvement of 11.92% over few-shot methods and 16.54% over literature-based methods for GPT, and 6.03% over few-shot methods and 14.97% over literature-based methods for Llama. + Combining literature-based and data-driven methods produced the best performance across tasks. The integrated approach achieved an accuracy improvement of 11.92% over few-shot methods and 16.54% over literature-based methods for GPT, and 6.03% over few-shot methods and 14.97% over literature-based methods for Llama.
Our framework with literature + data showed significant advantages over zero-shot, few-shot, data-driven and literature-based methods, particularly in handling OOD datasets.