How to reproduce :
1.
In icon or compact view navigate to the last but one item with the keyboard
2. hit Delete key

Result:
The last but one item is selected: OK
The last item has keyboard focus (dotted line): NOK

The Detailed view handles this better, the last but one item is selected after the delete and the navigation using keyboard after this will start from this selected item.

I think all view modes (icon, compact, detailed) should behave the same.