Explainable Artificial Intelligence (XAI) has the potential to revolutionize healthcare by providing more transparent, trustworthy, and understandable predictions made by AI models. To this end, the present study aims to develop an explainable NLP model for predicting patient admissions to the emergency department based on triage notes. We utilize transformer models to leverage the extensive textual data captured in triage notes, while also delivering interpretable results by using the LIME approach. The results show that the proposed model provides satisfactory accuracy along with an interpretable understanding of the factors contributing to patient admission. In general, this work highlights the potential of NLP in improving patient care and decision-making in emergency medicine.