This is currently an optional setting at configure time. You need to run:
./configure --enable-perl-modules
Then, make, make install, make test, and make clean, will include the perl modules that are in the perlmods/ directory as expected.
The perl modules are installed into $prefix/perl.