If you try to implement recursion that goes into too many branches (or "depth" levels), then you'll see it. :)
Personally I think the limitation on the depth for batch is a bit lame. It's not very high... haha.
edit: Here is the output, as an example, for what my script above does:
Sadly these are the only values that you can possibly calculate in batch with it's 32 bit integer data type limitation. You would need some kind of workaround to generate higher values, otherwise, you would probably just have to store known factorial values higher than 12! in predefined variables lol.