The LISSOM (Laterally Interconnected Synergetically Self-Organizing Map) model has previously been used to simulate the development of primary visual cortex (V1) maps for orientation and motion processing. In this work, we show that the same self-organizing processes driving the long-term development of the map result in illusory motion over short time scales in the adult. After adaptation to a moving stimulus, the model exhibits both motion aftereffects (illusory motion for a static test pattern, also known as the waterfall illusion or MAE) and the direction aftereffect (systematic changes in direction perception for moving test patterns, the DAE). Together with previous results replicating
the tilt afferefect (TAE) for stationary patterns, these results suggest that a relatively simple computational process underlies common orientation and motion aftereffects. The model predicts that such effects are caused by adaptation of lateral connections between neurons selective for motion direction and orientation.