Overcrowding in Emergency Departments (ED) is considered as an international issue, which could have adverse impacts on multiple care outcomes such as the length of stay for example. Part of the solution could lie in the early prediction of the patient outcome as discharge or hospitalization. This study applies Deep Learning to this end. A large-scale dataset of about 260K ED records was provided by the Amiens-Picardy University Hospital in France. In general, our approach is based on integrating structured data with unstructured textual notes recorded at the triage stage. The key idea is to apply a multiinput of mixed data for training a classification model to predict hospitalization. In a simultaneous manner, the model training utilizes the numeric features along with textual data. On one hand, a standard Multi-Layer Perceptron (MLP) model is used with the standard set of features (i.e. numeric and categorical). On the other hand, a Convolutional Neural Network (CNN) is used to operate over the textual data. The two components of learning are conducted independently in parallel. The empirical results demonstrated that the classifier could achieve a very good accuracy with ROC-AUC approximate to 0.83. The study is conceived to contribute to the mounting efforts of applying Natural Language Processing in the healthcare domain.