A huge number of studies attest that learning is facilitated if teaching strategies are in accordance with students learning styles, making the learning process more effective and improving students performances. In this context, this paper presents an automatic, dynamic and probabilistic approach for modeling students learning styles based on reinforcement learning. Three different strategies for updating the student model are proposed and tested through experiments. The results obtained are analyzed, indicating the most effective strategy. Experiments have shown that our approach is able to automatically detect and precisely adjust students’ learning styles, based on the non-deterministic and non-stationary aspects of learning styles. Because of the probabilistic and dynamic aspects enclosed in automatic detection of learning styles, our approach gradually and constantly adjusts the student model, taking into account students’ performances, obtaining a fine-tuned student model