Specs:
AMD Sapphire RX 560 4GB (GPU/Mem clock @ 1300/1750)
8 GB Ram, DDR3
AMD FX 6350, 6 Cores @3.9 GHZ
Tried to use the 4gb patch, also the Set Affinity system
UPDATE: So the problem also applies to rFactor. Also, while the GPU usage is around 100%, the VRAM usage is at like 0.5 GB Ram. Kinda...