Efficient Few-Shot Clinical Task Adaptation with Large Language Models