This paper examines the significance of the priming effect in designing and developing models for recognizing of affective states. Using a public dataset, often considered a benchmark in automatic stress recognition, the significance of the priming effect is explicated. Two experimental setups confirm the importance of task ordering in this problem. The results demonstrate the statistical significance of the model’s confusion when the subject has previously experienced stress and illustrate the importance for the Affective Computing community to develop methods to mitigate the priming effect where the order of tasks impacts how data should be modelled.