Fix "Too many open files".

Imported from https://youtrack.roxen.com/issue/PIKE-100

Reported by @grubba

Blocking PIKE-236