by Juan Leyva.
Yes, currently it should return a message like this one:
The app requires Moodle 2.4 or above
In your case, I'm not very sure what is happening. If you don't mind, you can send me privately your moodle site url and an basic account without privileges in order to find the reason you don't see the correct message.
Regards