perlconsole - An interactive Perl console like Python's

Installing the package libterm-readline-gnu-perl should get you readline support. 

$ apt-cache show perlconsole
...
Description: small program that lets you evaluate Perl code interactiv
+ely
 Perl Console is a light program that lets you evaluate Perl code
 interactively. It uses Readline for grabing input and provides comple
+tion
 with all the namespaces loaded during your session.
 .
 This is pretty useful for Perl developers that write modules.
 You can load a module in your session and test a function exported by
+ the
 module.

http://www.perlmonks.org/?node_id=816352