drm/ttm: cleanup LRU handling further