It seems that log4j RollingFileAppender has not implemented the MaxBackupIndex parameters. Thus, the files are not rolled off after reaching the match backup.

References

1. Apache Logging